00000001:02000400:3.0F:1789784935.589611:0:3312:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1789784952.187516:0:3536:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1789784953.610049:0:3595:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 606 MB/s 00000001:01000000:2.0:1789784953.860702:0:3595:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 665 MB/s 00000001:01000000:3.0:1789784954.110454:0:3595:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5787 MB/s 00000020:02000000:2.0:1789784954.812790:0:3628:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_110_g5f5d390 00000400:02000000:1.0:1789784955.557122:0:3643:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.146@tcp [8/256/0/180] 00008000:02000000:2.0:1789784958.793416:0:3792:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1789785021.136289:0:5760:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789785035.681271:0:6510:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789785035.681276:0:6510:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789785035.681278:0:6510:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789785035.681445:0:6510:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000006c770b72 00000080:02000400:3.0:1789785035.681455:0:6510:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789785035.690995:0:6510:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789785035.691008:0:6510:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789785035.691040:0:6510:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000005d863039) 00000020:00000080:3.0:1789785035.691057:0:6510:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789785035.735831:0:6510:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789785035.736168:0:6510:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1789785035.767612:0:6510:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789785035.769561:0:6510:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789785035.769570:0:6510:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789785035.769581:0:6510:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f18ee3fd845bd81 00000020:01000004:1.0:1789785035.769587:0:6510:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1789785035.769593:0:6510:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789785035.769597:0:6510:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006c770b72 from MGS 00000020:01000004:1.0:1789785035.769600:0:6510:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789785035.769619:0:6510:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000dd1edbdf) 00000020:00000080:1.0:1789785035.769634:0:6510:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789785035.770740:0:6510:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006c770b72 from MGS, refs=2 00080000:01000000:1.0:1789785035.770751:0:6510:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789785035.770757:0:6510:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f18ee3fd845bd8f 00000100:00100000:1.0:1789785035.770863:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789785035.771019:0:6510:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789785035.771026:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789785035.775295:0:6510:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789785035.775318:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789785035.780657:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789785035.780976:0:6510:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789785035.780983:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789785035.783241:0:6510:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789785035.783254:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789785035.787929:0:6510:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789785035.787943:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789785035.789065:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785035.789070:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785035.789071:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785035.789708:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785035.789710:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785035.789712:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785035.790447:0:6510:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789785035.792159:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1789785036.040509:0:6510:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3143 MB/s 00000001:01000000:0.0F:1789785036.290603:0:6510:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3247 MB/s 00000001:01000000:0.0:1789785036.540918:0:6510:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 559 MB/s 00000001:01000000:0.0:1789785036.791234:0:6510:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 675 MB/s 00080000:10000000:0.0:1789785036.802214:0:6510:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:3.0:1789785036.812207:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789785036.829885:0:6510:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1789785036.832879:0:6524:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789785036.832955:0:6510:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789785036.833005:0:6510:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1789785036.833230:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789785036.833254:0:6510:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789785036.833580:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789785036.833747:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789785036.833759:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789785036.834284:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789785036.834291:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789785036.835330:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789785036.835371:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789785036.837563:0:6510:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789785036.837585:0:6510:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.146@tcp' 00000020:01000004:3.0:1789785036.837587:0:6510:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789785036.837643:0:6510:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.146@tcp (typ=mgc) 00000020:00000080:3.0:1789785036.837654:0:6510:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.146@tcp (000000003086058a) 00000020:00000080:3.0:1789785036.837669:0:6510:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789785036.837779:0:6510:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ba6620cb@MGC192.168.203.146@tcp: add connection 192.168.203.146@tcp at head 00010000:00010000:3.0:1789785036.837921:0:6510:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.146@tcp-0 is initialized 00000040:01000000:3.0:1789785036.837926:0:6510:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.146@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789785036.840130:0:6529:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789785036.846200:0:6531:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789785036.846947:0:6510:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.146@tcp (uuid 8e00759f-51ad-47f9-8892-382c83919083) 00000020:00000080:3.0:1789785036.846973:0:6510:0:(genops.c:1385:class_connect()) connect: client 8e00759f-51ad-47f9-8892-382c83919083, cookie 0x2f18ee3fd845bd9d 00000100:00080000:3.0:1789785036.846985:0:6510:0:(import.c:510:import_select_connection()) MGC192.168.203.146@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789785036.846990:0:6510:0:(import.c:624:import_select_connection()) MGC192.168.203.146@tcp: import 00000000ba6620cb using connection 192.168.203.146@tcp/0@lo 00000100:00100000:3.0:1789785036.847036:0:6510:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a2f9e827 x1876725548974208/t0(0) o250->MGC192.168.203.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789785036.847207:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a2f9e827 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e00759f-51ad-47f9-8892-382c83919083:3658:1876725548974208:0@lo:250: 00000100:00100000:1.0:1789785036.847282:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789785036.847369:0:6510:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8e00759f-51ad-47f9-8892-382c83919083->MGS 00000020:01000004:3.0:1789785036.847389:0:6510:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789785036.847407:0:6510:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789785036.847419:0:6510:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000e89910f3) 00000020:00000080:3.0:1789785036.847430:0:6510:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789785036.849511:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548974208 00000100:00100000:0.0:1789785036.849523:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548974208 00000100:00100000:0.0:1789785036.849569:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789785036.849576:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d62db26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3658:x1876725548974208:12345-0@lo:250: 00010000:00080000:0.0:1789785036.849602:0:6526:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 8e00759f-51ad-47f9-8892-382c83919083@0@lo t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:0.0:1789785036.849629:0:6526:0:(genops.c:1385:class_connect()) connect: client 8e00759f-51ad-47f9-8892-382c83919083, cookie 0x2f18ee3fd845bdab 00000100:00080000:0.0:1789785036.849980:0:6526:0:(import.c:65:import_set_state_nolock()) 00000000857ae9e9 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789785036.852496:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d62db26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+5:3658:x1876725548974208:12345-0@lo:250: Request processed in 2912us (5207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785036.852514:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789785036.854197:0:3658:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.146@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789785036.854214:0:3658:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.146@tcp: connect to target with instance 0 00000100:00080000:1.0:1789785036.854233:0:3658:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.146@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789785036.854238:0:3658:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789785036.854243:0:3658:0:(import.c:65:import_set_state_nolock()) 00000000ba6620cb MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789785036.854247:0:3658:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789785036.854269:0:3658:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789785036.854279:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a2f9e827 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e00759f-51ad-47f9-8892-382c83919083:3658:1876725548974208:0@lo:250: 00000100:00100000:3.0:1789785036.857793:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789785036.858042:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789785036.858049:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789785036.858990:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789785036.859004:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789785036.860002:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789785036.860010:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789785036.861003:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789785036.861991:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789785036.861998:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789785036.865174:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789785036.865193:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789785036.907321:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789785036.907548:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789785036.907842:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789785036.911916:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789785036.912128:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789785036.913582:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789785036.913890:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789785036.913896:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789785036.915311:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789785036.915321:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789785036.916975:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789785036.917940:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789785036.917948:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789785036.918983:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789785036.918994:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789785036.920305:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789785036.920915:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789785036.920921:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789785036.921872:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789785036.921880:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789785036.951366:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789785036.951594:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789785036.951601:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789785036.953954:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789785036.953968:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789785036.955144:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789785036.955168:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789785036.960544:0:6510:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789785036.960574:0:6510:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1789785036.960580:0:6510:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.146@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789785036.960815:0:6510:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.146@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789785036.960859:0:6510:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.146@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1789785036.960866:0:6510:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789785036.960867:0:6510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789785036.960868:0:6510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789785036.960869:0:6510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789785036.960870:0:6510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789785036.960871:0:6510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789785036.960873:0:6510:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789785036.960874:0:6510:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789785036.960875:0:6510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789785036.960876:0:6510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789785036.960877:0:6510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789785036.960878:0:6510:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789785036.960880:0:6510:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1789785036.960881:0:6510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789785036.960882:0:6510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789785036.960883:0:6510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789785036.960883:0:6510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789785036.960884:0:6510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789785036.960885:0:6510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789785036.960886:0:6510:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789785036.960886:0:6510:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789785036.960887:0:6510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789785036.960888:0:6510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789785036.960888:0:6510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789785036.960889:0:6510:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789785036.960919:0:6510:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789785036.960934:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ff604f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548974336:0@lo:253: 00000100:00100000:1.0:1789785036.960997:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785036.961227:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 000000007e67b025 going to sleep for 11 seconds 00000100:00100000:0.0:1789785036.964479:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548974336 00000100:00100000:0.0:1789785036.964494:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548974336 00000100:00100000:0.0:1789785036.964556:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789785036.964564:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000448869e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+5:6510:x1876725548974336:12345-0@lo:253: 20000000:01000000:0.0:1789785036.964636:0:6528:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789785036.964639:0:6528:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1789785036.971722:0:6549:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789785036.972195:0:6528:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1789785036.972511:0:6528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789785036.974148:0:6550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789785036.974920:0:6528:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789785036.974925:0:6528:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789785036.974930:0:6528:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789785036.974933:0:6528:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789785036.974944:0:6528:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789785036.975544:0:6528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789785036.979752:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789785036.979781:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789785036.979817:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789785036.979831:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789785036.979845:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789785036.979917:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789785036.979924:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789785036.979935:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789785036.979940:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789785036.979950:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789785036.979954:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789785036.979963:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789785036.979975:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789785036.979998:0:6528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789785036.980791:0:6528:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789785036.980811:0:6528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789785036.980963:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789785036.980976:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789785036.981014:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789785036.981030:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789785036.981042:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789785036.981050:0:6528:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789785036.981084:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789785036.981092:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789785036.981104:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789785036.981117:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789785036.981128:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789785036.981135:0:6528:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789785036.981169:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789785036.981178:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789785036.981190:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789785036.981202:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789785036.981260:0:6528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789785036.981282:0:6528:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789785036.981303:0:6528:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1789785036.982043:0:6551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789785036.983065:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789785036.983105:0:6528:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.146@tcp for mdt 20000000:01000000:1.0:1789785036.983107:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.146@tcp (null) (null) (null) 00000040:00080000:1.0:1789785036.983122:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789785036.983128:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789785036.983141:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789785036.983146:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.146@tcp (null) (null) 00000040:00080000:1.0:1789785036.983156:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789785036.983475:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789785036.983493:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789785036.983507:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789785036.983533:0:6528:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789785036.983536:0:6528:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789785036.983539:0:6528:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789785036.983602:0:6528:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789785036.983605:0:6528:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789785036.984144:0:6552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1789785036.984551:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1789785036.984573:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1789785036.984590:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1789785036.984604:0:6528:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789785036.984606:0:6528:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789785036.987179:0:6553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789785036.987565:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1789785036.987593:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1789785036.987607:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1789785036.987618:0:6528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789785036.987620:0:6528:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1789785036.987625:0:6528:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789785036.987627:0:6528:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789785036.987631:0:6528:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789785036.987638:0:6528:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789785036.988216:0:6554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1789785036.988546:0:6528:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1789785037.011608:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1789785037.011642:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1789785037.011836:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1789785037.011858:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789785037.011878:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000047d5e0ca/0x2f18ee3fd845bdb2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785037.011907:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000047d5e0ca/0x2f18ee3fd845bdb2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785037.011917:0:6528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000047d5e0ca/0x2f18ee3fd845bdb2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785037.011923:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000047d5e0ca/0x2f18ee3fd845bdb2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785037.011929:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000047d5e0ca/0x2f18ee3fd845bdb2 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785037.011935:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000047d5e0ca/0x2f18ee3fd845bdb2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785037.011941:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000047d5e0ca already unused, calling callback (00000000113dcc6a) 00010000:00010000:0.0:1789785037.011944:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000047d5e0ca/0x2f18ee3fd845bdb2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785037.011951:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000047d5e0ca/0x2f18ee3fd845bdb2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785037.011962:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000047d5e0ca/0x2f18ee3fd845bdb2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785037.011969:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000047d5e0ca/0x2f18ee3fd845bdb2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785037.011974:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000047d5e0ca/0x2f18ee3fd845bdb2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789785037.011999:0:6528:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789785037.039911:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000448869e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+5:6510:x1876725548974336:12345-0@lo:253: Request processed in 75340us (78906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785037.039931:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789785037.039963:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ff604f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548974336:0@lo:253: 10000000:01000000:2.0:1789785037.039982:0:6510:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789785037.039986:0:6510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789785037.039988:0:6510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789785037.039989:0:6510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789785037.039990:0:6510:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1789785037.039991:0:6510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789785037.039993:0:6510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789785037.039994:0:6510:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789785037.039995:0:6510:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789785037.039997:0:6510:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789785037.039998:0:6510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789785037.040000:0:6510:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789785037.040038:0:6510:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006c770b72 from lustre-MDT0000 10000000:01000000:2.0:1789785037.040068:0:6510:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789785037.040070:0:6510:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789785037.040074:0:6510:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9daf983fcd28 10000000:01000000:2.0:1789785037.040078:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789785037.040086:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9daf983fcd28 from 1 10000000:01000000:2.0:1789785037.040088:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789785037.040139:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 00000000bf6fa44a/0x2f18ee3fd845bdb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.040150:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 00000000bf6fa44a/0x2f18ee3fd845bdb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.040167:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 00000000bf6fa44a/0x2f18ee3fd845bdb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785037.040185:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000169b5a72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548974464:0@lo:101: 00000100:00100000:2.0:1789785037.040219:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785037.040332:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548974464 00000100:00100000:0.0:1789785037.040359:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548974464 00000100:00100000:0.0:1789785037.040402:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789785037.040409:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000babced74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+5:6510:x1876725548974464:12345-0@lo:101: 00010000:00010000:0.0:1789785037.040420:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785037.040432:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000047d5e0ca/0x2f18ee3fd845bdc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845bdb9 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785037.040453:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000047d5e0ca/0x2f18ee3fd845bdc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845bdb9 expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785037.040463:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000047d5e0ca/0x2f18ee3fd845bdc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bdb9 expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785037.040470:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 000000007a597e70 going to sleep for 11 seconds 00010000:00010000:0.0:1789785037.040472:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000047d5e0ca, rc 0) 00000100:00100000:0.0:1789785037.040521:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000babced74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+6:6510:x1876725548974464:12345-0@lo:101: Request processed in 113us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785037.040527:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789785037.040641:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000169b5a72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548974464:0@lo:101: 00010000:00010000:2.0:1789785037.040666:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 00000000bf6fa44a/0x2f18ee3fd845bdb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bdc0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.040674:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 00000000bf6fa44a/0x2f18ee3fd845bdb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845bdc0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785037.040722:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000169b5a72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548974592:0@lo:501: 00000100:00100000:2.0:1789785037.040745:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785037.040763:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 000000007a597e70 going to sleep for 11 seconds 00000100:00100000:1.0:1789785037.041179:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548974592 00000100:00100000:1.0:1789785037.041185:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548974592 00000100:00100000:1.0:1789785037.041222:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789785037.041229:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002106ca70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+6:6510:x1876725548974592:12345-0@lo:501: 00000100:00100000:1.0:1789785037.041805:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002106ca70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+6:6510:x1876725548974592:12345-0@lo:501: Request processed in 576us (1058us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789785037.041814:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789785037.042466:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000169b5a72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548974592:0@lo:501: 10000000:01000000:2.0:1789785037.042504:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789785037.042522:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 00000000bf6fa44a/0x2f18ee3fd845bdb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bdc0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.042532:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: 00000000bf6fa44a/0x2f18ee3fd845bdb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bdc0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785037.042540:0:6510:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9daf89061800 10000000:01000000:2.0:1789785037.042545:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789785037.042564:0:6510:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9daf89061800 10000000:01000000:2.0:1789785037.042567:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789785037.042570:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9daf89061800 from 1 10000000:01000000:2.0:1789785037.042573:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789785037.042598:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 00000000e2acba10/0x2f18ee3fd845bdc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.042604:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 00000000e2acba10/0x2f18ee3fd845bdc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.042613:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 00000000e2acba10/0x2f18ee3fd845bdc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785037.042627:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000169b5a72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548974720:0@lo:101: 00000100:00100000:2.0:1789785037.042672:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785037.042704:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 000000007a597e70 going to sleep for 11 seconds 00000100:00100000:3.0:1789785037.042771:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548974720 00000100:00100000:3.0:1789785037.042777:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548974720 00000100:00100000:3.0:1789785037.042814:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789785037.042821:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd1239ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+6:6510:x1876725548974720:12345-0@lo:101: 00010000:00010000:3.0:1789785037.042831:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785037.042843:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002e0e1887/0x2f18ee3fd845bdce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845bdc7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785037.042861:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002e0e1887/0x2f18ee3fd845bdce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845bdc7 expref: 7 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785037.042869:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002e0e1887/0x2f18ee3fd845bdce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bdc7 expref: 7 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785037.042876:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002e0e1887, rc 0) 00000100:00100000:3.0:1789785037.042935:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd1239ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+7:6510:x1876725548974720:12345-0@lo:101: Request processed in 115us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785037.042941:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789785037.043505:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000169b5a72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548974720:0@lo:101: 00010000:00010000:2.0:1789785037.043518:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 00000000e2acba10/0x2f18ee3fd845bdc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bdce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.043526:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 00000000e2acba10/0x2f18ee3fd845bdc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845bdce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785037.043538:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789785037.043551:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 00000000e2acba10/0x2f18ee3fd845bdc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bdce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.043557:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: 00000000e2acba10/0x2f18ee3fd845bdc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bdce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785037.043574:0:6510:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789785037.043577:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789785037.043582:0:6510:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9daf89061800 10000000:01000000:2.0:1789785037.043584:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789785037.043587:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789785037.043589:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789785037.043605:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 00000000574c82bd/0x2f18ee3fd845bdd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.043611:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 00000000574c82bd/0x2f18ee3fd845bdd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.043618:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 00000000574c82bd/0x2f18ee3fd845bdd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785037.043629:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000169b5a72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548974848:0@lo:101: 00000100:00100000:2.0:1789785037.043666:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785037.043696:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 000000007a597e70 going to sleep for 11 seconds 00000100:00100000:1.0:1789785037.044276:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548974848 00000100:00100000:1.0:1789785037.044284:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548974848 00000100:00100000:1.0:1789785037.044330:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789785037.044804:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc0f37c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+7:6510:x1876725548974848:12345-0@lo:101: 00010000:00010000:1.0:1789785037.044819:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785037.044836:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000018f5a7cb/0x2f18ee3fd845bddc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845bdd5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785037.044858:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000018f5a7cb/0x2f18ee3fd845bddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845bdd5 expref: 8 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785037.044867:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000018f5a7cb/0x2f18ee3fd845bddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bdd5 expref: 8 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785037.044876:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000018f5a7cb, rc 0) 00000100:00100000:1.0:1789785037.045539:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc0f37c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+8:6510:x1876725548974848:12345-0@lo:101: Request processed in 1199us (1873us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785037.045562:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789785037.048884:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000169b5a72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548974848:0@lo:101: 00010000:00010000:2.0:1789785037.048912:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 00000000574c82bd/0x2f18ee3fd845bdd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bddc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.048923:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 00000000574c82bd/0x2f18ee3fd845bdd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845bddc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785037.049163:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000229df94c pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548974976:0@lo:501: 00000100:00100000:3.0:1789785037.049219:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785037.049279:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c8b9a91a going to sleep for 11 seconds 00000100:00100000:0.0:1789785037.049361:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548974976 00000100:00100000:0.0:1789785037.049368:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548974976 00000100:00100000:0.0:1789785037.049411:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789785037.049419:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee5596ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+8:6510:x1876725548974976:12345-0@lo:501: 00000100:00100000:0.0:1789785037.049598:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee5596ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+9:6510:x1876725548974976:12345-0@lo:501: Request processed in 178us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785037.049605:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789785037.049753:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000229df94c pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548974976:0@lo:501: 00000100:00100000:1.0:1789785037.049786:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000037f403b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548975104:0@lo:503: 00000100:00100000:1.0:1789785037.049832:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785037.049862:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 000000007d120c0c going to sleep for 11 seconds 00000100:00100000:2.0:1789785037.049915:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548975104 00000100:00100000:2.0:1789785037.049921:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548975104 00000100:00100000:2.0:1789785037.049964:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789785037.049978:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000038e5c0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+9:6510:x1876725548975104:12345-0@lo:503: 00000100:00100000:2.0:1789785037.050289:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000038e5c0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+9:6510:x1876725548975104:12345-0@lo:503: Request processed in 312us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785037.050305:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789785037.050459:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000037f403b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548975104:0@lo:503: 00000100:00100000:2.0:1789785037.051436:0:6555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000169b5a72 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:6555:1876725548975232:0@lo:502: 00000100:00100000:2.0:1789785037.051490:0:6555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785037.051525:0:6555:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd488aa2 going to sleep for 11 seconds 00000100:00100000:3.0:1789785037.052884:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548975232 00000100:00100000:3.0:1789785037.052894:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548975232 00000100:00100000:3.0:1789785037.052968:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789785037.052976:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035b3a35d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+9:6555:x1876725548975232:12345-0@lo:502: 00000100:00100000:3.0:1789785037.053127:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035b3a35d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+9:6555:x1876725548975232:12345-0@lo:502: Request processed in 152us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785037.053135:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789785037.053211:0:6555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000169b5a72 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:6555:1876725548975232:0@lo:502: 00000020:01000000:2.0:1789785037.053245:0:6555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789785037.053255:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785037.053258:0:6555:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789785037.053262:0:6555:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789785037.053265:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789785037.053285:0:6555:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000034c28fc7) 00000020:00000080:2.0:1789785037.053312:0:6555:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789785037.053317:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789785037.053466:0:6555:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789785037.053473:0:6555:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f18ee3fd845bdea 00000020:00000080:2.0:1789785037.053709:0:6555:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789785037.053715:0:6555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789785037.053718:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785037.053720:0:6555:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789785037.053722:0:6555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789785037.053726:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785037.053727:0:6555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789785037.053730:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789785037.053736:0:6555:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000009817d3d2) 00000020:00000080:2.0:1789785037.053745:0:6555:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789785037.053749:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789785037.053750:0:6555:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789785037.053759:0:6555:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789785037.053765:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789785037.053808:0:6555:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006c770b72 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789785037.053819:0:6555:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000e14ee09d) 00000020:00000080:2.0:1789785037.053827:0:6555:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789785037.053887:0:6555:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789785037.053892:0:6555:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f18ee3fd845bdff 00000020:00000080:2.0:1789785037.054058:0:6555:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789785037.054065:0:6555:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789785037.054069:0:6555:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2f18ee3fd845be06 00080000:01000000:2.0:1789785037.054073:0:6555:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789785037.054076:0:6555:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f18ee3fd845be0d 00080000:10000000:2.0:1789785037.054530:0:6555:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1789785037.054659:0:6555:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789785037.069816:0:6555:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789785037.202234:0:6555:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789785037.204907:0:6555:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1789785037.211549:0:6555:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789785037.212058:0:6555:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789785037.216993:0:6555:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000dd2eccc8) 00000020:00000080:3.0:1789785037.217024:0:6555:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789785037.217108:0:6555:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789785037.217116:0:6555:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f18ee3fd845be1b 00000020:00000080:0.0:1789785037.219231:0:6555:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1789785037.220258:0:6555:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1789785037.237287:0:6555:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1789785037.248609:0:6555:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1789785037.252992:0:6555:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1789785037.256887:0:6555:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1789785037.261044:0:6555:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1789785037.263477:0:6555:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2f18ee3fd845be22 00000020:00000080:1.0:1789785037.264053:0:6555:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789785037.264064:0:6555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785037.264069:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785037.264071:0:6555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789785037.264074:0:6555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789785037.264077:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785037.264078:0:6555:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789785037.264081:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789785037.264083:0:6555:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789785037.264085:0:6555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785037.264087:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785037.264088:0:6555:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789785037.264090:0:6555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789785037.264095:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785037.264096:0:6555:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789785037.264099:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789785037.264232:0:6555:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1789785037.264285:0:6555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000037f403b6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:6555:1876725548975360:0@lo:502: 00000100:00100000:1.0:1789785037.264438:0:6555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785037.264522:0:6555:0:(client.c:2715:ptlrpc_set_wait()) set 0000000093dd851f going to sleep for 11 seconds 00000100:00100000:2.0:1789785037.264612:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548975360 00000100:00100000:2.0:1789785037.264619:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548975360 00000100:00100000:2.0:1789785037.264700:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789785037.264708:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f7a8a8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+9:6555:x1876725548975360:12345-0@lo:502: 00000100:00100000:2.0:1789785037.265034:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f7a8a8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+9:6555:x1876725548975360:12345-0@lo:502: Request processed in 326us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785037.265042:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789785037.265262:0:6555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000037f403b6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:6555:1876725548975360:0@lo:502: 00000020:01000000:1.0:1789785037.265289:0:6555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785037.265304:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785037.265305:0:6555:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1789785037.265309:0:6555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1789785037.265483:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1789785037.265516:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789785037.265534:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 00000000574c82bd/0x2f18ee3fd845bdd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bddc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785037.265545:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: 00000000574c82bd/0x2f18ee3fd845bdd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bddc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785037.265553:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9daf89061800 from 1 10000000:01000000:3.0:1789785037.265556:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789785037.265582:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 00000000c2ae53b6/0x2f18ee3fd845be29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785037.265589:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 00000000c2ae53b6/0x2f18ee3fd845be29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785037.265597:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 00000000c2ae53b6/0x2f18ee3fd845be29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785037.265612:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001d2f895b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548975488:0@lo:101: 00000100:00100000:3.0:1789785037.265652:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785037.265681:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b1b22e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789785037.265783:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548975488 00000100:00100000:1.0:1789785037.265788:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548975488 00000100:00100000:1.0:1789785037.265823:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789785037.265829:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3621935 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+9:6510:x1876725548975488:12345-0@lo:101: 00010000:00010000:1.0:1789785037.265838:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785037.265850:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005ddfa892/0x2f18ee3fd845be30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845be29 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785037.265871:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005ddfa892/0x2f18ee3fd845be30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845be29 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785037.265878:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005ddfa892/0x2f18ee3fd845be30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845be29 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785037.265885:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005ddfa892, rc 0) 00000100:00100000:1.0:1789785037.266215:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3621935 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+10:6510:x1876725548975488:12345-0@lo:101: Request processed in 386us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785037.266222:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789785037.266315:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001d2f895b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548975488:0@lo:101: 00010000:00010000:3.0:1789785037.266328:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 00000000c2ae53b6/0x2f18ee3fd845be29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845be30 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785037.266403:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 00000000c2ae53b6/0x2f18ee3fd845be29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845be30 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785037.267190:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001d2f895b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548975616:0@lo:256: 00000100:00100000:3.0:1789785037.267235:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785037.267271:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b1b22e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789785037.267335:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548975616 00000100:00100000:2.0:1789785037.267409:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548975616 00000100:00100000:2.0:1789785037.267450:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789785037.267457:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7c9b5db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+10:6510:x1876725548975616:12345-0@lo:256: 20000000:01000000:2.0:1789785037.267473:0:6528:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789785037.267486:0:6528:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789785037.267855:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7c9b5db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+10:6510:x1876725548975616:12345-0@lo:256: Request processed in 399us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785037.267863:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789785037.268116:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001d2f895b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548975616:0@lo:256: 10000000:01000000:0.0:1789785037.273112:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789785037.273143:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 00000000c2ae53b6/0x2f18ee3fd845be29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845be30 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785037.273157:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: 00000000c2ae53b6/0x2f18ee3fd845be29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845be30 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785037.273966:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9daf89061800 from 1 10000000:01000000:1.0:1789785037.273972:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789785037.274014:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 0000000061bc5aa8/0x2f18ee3fd845be37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785037.274024:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 0000000061bc5aa8/0x2f18ee3fd845be37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785037.274048:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 0000000061bc5aa8/0x2f18ee3fd845be37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785037.274070:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000037f403b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548975744:0@lo:101: 00000100:00100000:1.0:1789785037.274133:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785037.274187:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 000000004a5500f8 going to sleep for 11 seconds 00000100:00100000:3.0:1789785037.274287:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548975744 00000100:00100000:3.0:1789785037.274303:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548975744 00000100:00100000:3.0:1789785037.274366:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789785037.274374:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098ba0a8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+10:6510:x1876725548975744:12345-0@lo:101: 00010000:00010000:3.0:1789785037.274386:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785037.274398:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ae54f0c6/0x2f18ee3fd845be3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845be37 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785037.274418:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ae54f0c6/0x2f18ee3fd845be3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845be37 expref: 11 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785037.274427:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ae54f0c6/0x2f18ee3fd845be3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845be37 expref: 11 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785037.274449:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ae54f0c6, rc 0) 00000100:00100000:3.0:1789785037.274490:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098ba0a8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+11:6510:x1876725548975744:12345-0@lo:101: Request processed in 117us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785037.274496:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789785037.274650:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000037f403b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548975744:0@lo:101: 00010000:00010000:2.0:1789785037.274664:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 0000000061bc5aa8/0x2f18ee3fd845be37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845be3e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.274671:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 0000000061bc5aa8/0x2f18ee3fd845be37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845be3e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785037.274727:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000169b5a72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548975872:0@lo:501: 00000100:00100000:2.0:1789785037.274766:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785037.274795:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ae7ede5 going to sleep for 11 seconds 00000100:00100000:3.0:1789785037.274845:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548975872 00000100:00100000:3.0:1789785037.274849:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548975872 00000100:00100000:3.0:1789785037.274879:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789785037.274886:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9e01071 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+11:6510:x1876725548975872:12345-0@lo:501: 00000100:00100000:3.0:1789785037.275047:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9e01071 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+11:6510:x1876725548975872:12345-0@lo:501: Request processed in 161us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785037.275053:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789785037.275186:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000169b5a72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548975872:0@lo:501: 00000100:00100000:0.0:1789785037.275228:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003806e1fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548976000:0@lo:503: 00000100:00100000:0.0:1789785037.275268:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785037.275304:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548976000 00000100:00100000:0.0:1789785037.275304:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 000000006b12a140 going to sleep for 11 seconds 00000100:00100000:1.0:1789785037.275310:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548976000 00000100:00100000:1.0:1789785037.275332:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789785037.275357:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f8cb7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+11:6510:x1876725548976000:12345-0@lo:503: 00000040:00080000:1.0:1789785037.275389:0:6526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789785037.275467:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f8cb7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+11:6510:x1876725548976000:12345-0@lo:503: Request processed in 129us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785037.275474:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789785037.275701:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003806e1fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548976000:0@lo:503: 00000040:00080000:3.0:1789785037.283122:0:6559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789785037.283307:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789785037.283330:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789785037.283376:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 0000000061bc5aa8/0x2f18ee3fd845be37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845be3e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.283389:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: 0000000061bc5aa8/0x2f18ee3fd845be37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845be3e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785037.283434:0:6510:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789785037.283437:0:6510:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9daf89061800 10000000:01000000:2.0:1789785037.283440:0:6510:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9daf89061800 10000000:01000000:2.0:1789785037.283443:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789785037.283448:0:6510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9daf89061800 from 1 10000000:01000000:2.0:1789785037.283450:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789785037.283482:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 0000000064f5d218/0x2f18ee3fd845be45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.283490:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 0000000064f5d218/0x2f18ee3fd845be45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.283516:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 0000000064f5d218/0x2f18ee3fd845be45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785037.283537:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5ad3076 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548976128:0@lo:101: 00000100:00100000:2.0:1789785037.283597:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785037.283639:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c3dd9eaf going to sleep for 11 seconds 00000100:00100000:3.0:1789785037.283908:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548976128 00000100:00100000:3.0:1789785037.283915:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548976128 00000100:00100000:3.0:1789785037.284054:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789785037.284063:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000307e0746 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+11:6510:x1876725548976128:12345-0@lo:101: 00010000:00010000:3.0:1789785037.284075:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785037.284086:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fc16526c/0x2f18ee3fd845be4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845be45 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785037.284105:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fc16526c/0x2f18ee3fd845be4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845be45 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785037.284115:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fc16526c/0x2f18ee3fd845be4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845be45 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785037.284122:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fc16526c, rc 0) 00000100:00100000:3.0:1789785037.284174:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000307e0746 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+12:6510:x1876725548976128:12345-0@lo:101: Request processed in 112us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785037.284181:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789785037.284244:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5ad3076 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548976128:0@lo:101: 00010000:00010000:1.0:1789785037.284257:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 0000000064f5d218/0x2f18ee3fd845be45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845be4c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785037.284266:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 0000000064f5d218/0x2f18ee3fd845be45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845be4c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785037.284328:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a3b86482 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548976256:0@lo:501: 00000100:00100000:1.0:1789785037.284375:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785037.285565:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 000000004a5500f8 going to sleep for 11 seconds 00000100:00100000:2.0:1789785037.286412:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548976256 00000100:00100000:2.0:1789785037.286421:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548976256 00000100:00100000:2.0:1789785037.286462:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789785037.286470:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6f2cfcc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+12:6510:x1876725548976256:12345-0@lo:501: 00000100:00100000:2.0:1789785037.286654:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6f2cfcc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+12:6510:x1876725548976256:12345-0@lo:501: Request processed in 185us (2278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785037.286662:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789785037.287050:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a3b86482 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548976256:0@lo:501: 00000100:00100000:1.0:1789785037.287097:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a3b86482 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548976384:0@lo:503: 00000100:00100000:1.0:1789785037.287154:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785037.287186:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 000000004a5500f8 going to sleep for 11 seconds 00000100:00100000:2.0:1789785037.287239:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548976384 00000100:00100000:2.0:1789785037.287243:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548976384 00000100:00100000:2.0:1789785037.287311:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789785037.287318:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000acb2dd43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+12:6510:x1876725548976384:12345-0@lo:503: 00000100:00100000:2.0:1789785037.287428:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000acb2dd43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+12:6510:x1876725548976384:12345-0@lo:503: Request processed in 110us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785037.287434:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789785037.287522:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a3b86482 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548976384:0@lo:503: 00000100:00100000:0.0:1789785037.292790:0:6560:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003806e1fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:6560:1876725548976512:0@lo:502: 00000100:00100000:1.0:1789785037.298508:0:6560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785037.298772:0:6560:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f7046c08 going to sleep for 11 seconds 00000100:00100000:3.0:1789785037.300566:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548976512 00000100:00100000:3.0:1789785037.300580:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548976512 00000100:00100000:3.0:1789785037.300650:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789785037.300659:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a5d2fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+12:6560:x1876725548976512:12345-0@lo:502: 00000100:00100000:3.0:1789785037.300828:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a5d2fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+12:6560:x1876725548976512:12345-0@lo:502: Request processed in 170us (2326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785037.300836:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789785037.300957:0:6560:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003806e1fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:6560:1876725548976512:0@lo:502: 00000020:01000004:1.0:1789785037.301032:0:6560:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789785037.301046:0:6560:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000002a62585d) 00000020:00000080:1.0:1789785037.301064:0:6560:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1789785037.301147:0:6560:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006c770b72 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789785037.301150:0:6560:0:(tgt_mount.c:187:server_put_mount()) put mount 000000006c770b72 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789785037.301153:0:6560:0:(obd_mount.c:710:lustre_put_lsi()) put 000000006c770b72 4 00010000:00080000:1.0:1789785037.301186:0:6560:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005442a4e8@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.146@tcp at head 00010000:00010000:1.0:1789785037.310229:0:6560:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1789785037.310857:0:6560:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789785037.310896:0:6560:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789785037.310907:0:6560:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2f18ee3fd845be5a 00000100:00080000:1.0:1789785037.310916:0:6560:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789785037.310920:0:6560:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005442a4e8 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:1.0:1789785037.310949:0:6560:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a3b86482 x1876725548976640/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789785037.310981:0:6560:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789785037.311072:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a3b86482 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1876725548976640:0@lo:38: 00000100:00100000:3.0:1789785037.311146:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785037.318740:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548976640 00000100:00100000:1.0:1789785037.318753:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548976640 00000100:00100000:1.0:1789785037.318794:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789785037.318800:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3dd28e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1876725548976640:12345-0@lo:38: 00000100:00100000:1.0:1789785037.319305:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3dd28e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1876725548976640:12345-0@lo:38: Request processed in 502us (8158us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789785037.319320:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789785037.319395:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789785037.319404:0:3658:0:(import.c:65:import_set_state_nolock()) 000000005442a4e8 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789785037.319408:0:3658:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789785037.319412:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a3b86482 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1876725548976640:0@lo:38: 00000100:00100000:1.0:1789785037.320071:0:6560:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cfc5baf2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:6560:1876725548976768:0@lo:502: 00000100:00100000:1.0:1789785037.320129:0:6560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785037.320187:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548976768 00000100:00100000:3.0:1789785037.320193:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548976768 00000100:00100000:3.0:1789785037.320251:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789785037.320259:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000710ec0c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+12:6560:x1876725548976768:12345-0@lo:502: 00000100:00100000:3.0:1789785037.320413:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000710ec0c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+12:6560:x1876725548976768:12345-0@lo:502: Request processed in 154us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785037.320420:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789785037.320478:0:6560:0:(client.c:2715:ptlrpc_set_wait()) set 0000000099b887ac going to sleep for 11 seconds 00000100:00100000:1.0:1789785037.320496:0:6560:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cfc5baf2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:6560:1876725548976768:0@lo:502: 00000040:00080000:1.0:1789785037.320527:0:6560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1789785037.320650:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789785037.320678:0:6510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789785037.320693:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 0000000064f5d218/0x2f18ee3fd845be45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845be4c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785037.320703:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: 0000000064f5d218/0x2f18ee3fd845be45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845be4c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789785037.320757:0:6510:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789785037.320760:0:6510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789785037.320761:0:6510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789785037.320763:0:6510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789785037.320764:0:6510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789785037.320765:0:6510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789785037.320767:0:6510:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789785037.320768:0:6510:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789785037.320770:0:6510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789785037.320772:0:6510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789785037.320773:0:6510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789785037.320775:0:6510:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789785037.320778:0:6510:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789785037.320781:0:6510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789785037.320782:0:6510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789785037.320784:0:6510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789785037.320785:0:6510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789785037.320787:0:6510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789785037.320788:0:6510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789785037.320789:0:6510:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789785037.320790:0:6510:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789785037.320791:0:6510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789785037.320792:0:6510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789785037.320793:0:6510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789785037.320794:0:6510:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789785037.320812:0:6510:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789785037.320822:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f03577cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548976896:0@lo:253: 00000100:00100000:0.0:1789785037.320851:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785037.320879:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 00000000192f533e going to sleep for 11 seconds 00000100:00100000:2.0:1789785037.321565:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548976896 00000100:00100000:2.0:1789785037.321572:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548976896 00000100:00100000:2.0:1789785037.321612:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789785037.321618:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074cab860 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+12:6510:x1876725548976896:12345-0@lo:253: 20000000:01000000:2.0:1789785037.321641:0:6527:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789785037.321653:0:6527:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789785037.328548:0:6527:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789785037.328568:0:6527:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789785037.328967:0:6549:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789785037.328972:0:6549:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789785037.328990:0:6549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bfa2dea1/0x2f18ee3fd845be61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785037.329014:0:6549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005ddfa892/0x2f18ee3fd845be30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845be29 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785037.329022:0:6549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000bfa2dea1/0x2f18ee3fd845be61 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785037.329058:0:6549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005ddfa892/0x2f18ee3fd845be30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845be29 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785037.329073:0:6549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005ddfa892/0x2f18ee3fd845be30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845be29 expref: 12 pid: 6526 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785037.329086:0:6549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cfc5baf2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1876725548977024:0@lo:104: 00000100:00100000:1.0:1789785037.329145:0:6549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785037.329984:0:6549:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd488aa2 going to sleep for 11 seconds 00000100:00100000:0.0:1789785037.330552:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548977024 00000100:00100000:0.0:1789785037.330561:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548977024 00000100:00100000:0.0:1789785037.330650:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789785037.330660:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000760c7e7c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+3:6549:x1876725548977024:12345-0@lo:104: 00010000:00010000:0.0:1789785037.330679:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: 00000000c2ae53b6/0x2f18ee3fd845be29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845be30 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785037.330689:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074cab860 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+12:6510:x1876725548976896:12345-0@lo:253: Request processed in 9069us (9835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785037.330703:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1789785037.330775:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789785037.330781:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000760c7e7c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+3:6549:x1876725548977024:12345-0@lo:104: Request processed in 124us (1637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785037.330788:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789785037.330851:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789785037.330857:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: 00000000c2ae53b6/0x2f18ee3fd845be29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845be30 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.330865:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c2ae53b6 already unused, calling callback (000000006d49e52c) 10000000:00010000:2.0:1789785037.330868:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: 00000000c2ae53b6/0x2f18ee3fd845be29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845be30 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.330875:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: 00000000c2ae53b6/0x2f18ee3fd845be29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845be30 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789785037.330881:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: 00000000c2ae53b6/0x2f18ee3fd845be29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845be30 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785037.330886:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789785037.330917:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: 00000000c2ae53b6/0x2f18ee3fd845be29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845be30 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.330923:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789785037.330940:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: 00000000c2ae53b6/0x2f18ee3fd845be29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845be30 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.330946:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: 00000000c2ae53b6/0x2f18ee3fd845be29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845be30 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.330963:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785037.330969:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785037.330971:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785037.331319:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f23affe8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725548977152:0@lo:103: 00000100:00100000:1.0:1789785037.332060:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785037.332431:0:6549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cfc5baf2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1876725548977024:0@lo:104: 00010000:00010000:0.0:1789785037.332457:0:6549:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000bfa2dea1/0x2f18ee3fd845be61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785037.333106:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f03577cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:6510:1876725548976896:0@lo:253: 10000000:01000000:3.0:1789785037.333120:0:6510:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789785037.333123:0:6510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789785037.333135:0:6510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789785037.333136:0:6510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789785037.333137:0:6510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789785037.333138:0:6510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789785037.333139:0:6510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789785037.333141:0:6510:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789785037.333142:0:6510:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789785037.333143:0:6510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789785037.333145:0:6510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789785037.333146:0:6510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789785037.333147:0:6510:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789785037.333158:0:6510:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789785037.333596:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548977152 00000100:00100000:2.0:1789785037.333603:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548977152 00010000:00010000:2.0:1789785037.333629:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005ddfa892/0x2f18ee3fd845be30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845be29 expref: 12 pid: 6526 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785037.333670:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789785037.333677:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e822af07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e00759f-51ad-47f9-8892-382c83919083+12:3660:x1876725548977152:12345-0@lo:103: 00010000:00010000:2.0:1789785037.333688:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785037.333693:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005ddfa892/0x2f18ee3fd845be30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845be29 expref: 12 pid: 6526 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.333702:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005ddfa892/0x2f18ee3fd845be30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845be29 expref: 12 pid: 6526 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.333716:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005ddfa892/0x2f18ee3fd845be30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845be29 expref: 12 pid: 6526 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.333729:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000bfa2dea1/0x2f18ee3fd845be61 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.333736:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bfa2dea1/0x2f18ee3fd845be61 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789785037.333749:0:6518:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004777175s 00010000:00010000:2.0:1789785037.333752:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bfa2dea1/0x2f18ee3fd845be61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.333757:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bfa2dea1/0x2f18ee3fd845be61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.333772:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bfa2dea1/0x2f18ee3fd845be61 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.333778:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bfa2dea1/0x2f18ee3fd845be61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.333784:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bfa2dea1 already unused, calling callback (00000000113dcc6a) 00010000:00010000:2.0:1789785037.333787:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bfa2dea1/0x2f18ee3fd845be61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.333794:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bfa2dea1/0x2f18ee3fd845be61 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.333814:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bfa2dea1/0x2f18ee3fd845be61 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785037.333823:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785037.333881:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e822af07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e00759f-51ad-47f9-8892-382c83919083+11:3660:x1876725548977152:12345-0@lo:103: Request processed in 205us (1823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785037.333888:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789785037.333924:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f23affe8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725548977152:0@lo:103: 00010000:00010000:0.0:1789785037.334026:0:6549:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000bfa2dea1/0x2f18ee3fd845be61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785037.334034:0:6549:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bfa2dea1/0x2f18ee3fd845be61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785037.334039:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bfa2dea1/0x2f18ee3fd845be61 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1789785037.346483:0:6510:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1789785037.346690:0:6510:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789785037.346939:0:6510:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1789785037.347171:0:6510:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789785037.347575:0:6510:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1789785037.347746:0:6510:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1789785037.348540:0:6510:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1789785037.348708:0:6510:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1789785037.348888:0:6510:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1789785037.349146:0:6510:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1789785037.349528:0:6510:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1789785037.349919:0:6510:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1789785037.353072:0:6510:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1789785037.364881:0:6510:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789785037.364958:0:6565:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789785037.364963:0:6565:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789785037.365287:0:6566:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789785037.366680:0:6510:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789785037.366785:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789785037.367170:0:6510:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789785037.367177:0:6510:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789785037.367242:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789785037.368210:0:6510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789785037.368758:0:6510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789785037.368788:0:6510:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789785037.368942:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789785037.369125:0:6510:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1789785037.369743:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789785037.369889:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789785037.370027:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789785037.370148:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789785037.370258:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789785037.370428:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789785037.370579:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789785037.370717:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789785037.370847:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789785037.370958:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789785037.371095:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789785037.371204:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789785037.371329:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789785037.371516:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789785037.371676:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789785037.371812:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789785037.373770:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789785037.374017:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789785037.374195:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789785037.374395:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789785037.374544:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789785037.374709:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789785037.374858:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789785037.374996:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789785037.375143:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00000040:00080000:1.0:1789785037.375274:0:6566:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:3.0:1789785037.375316:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789785037.375477:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789785037.375643:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789785037.377275:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789785037.377543:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789785037.377682:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789785037.377816:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789785037.378067:0:6510:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1789785037.380172:0:6566:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789785037.380261:0:6566:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789785037.380265:0:6566:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:3.0:1789785037.383397:0:6510:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789785037.383435:0:6510:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa9f301ca7988 00100000:10000000:3.0:1789785037.383442:0:6510:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789785037.384553:0:6510:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789785037.384749:0:6510:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.146@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789785037.384769:0:6510:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789785037.384783:0:6510:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1789785037.392848:0:6510:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789785037.393076:0:6510:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1789785037.834924:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785038.852431:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785039.874910:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785040.907180:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785041.923659:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789785041.953138:0:6811:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1789785042.758504:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789785042.758513:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789785042.758517:0:37:0:(import.c:65:import_set_state_nolock()) 000000005442a4e8 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789785042.758528:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005442a4e8 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:3.0:1789785042.758547:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006fa2d564 x1876725548977408/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789785042.758662:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789785042.758675:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de63fdab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725548977280:0@lo:400: 00000100:00100000:3.0:1789785042.758735:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785042.758798:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006fa2d564 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1876725548977408:0@lo:38: 00000100:00100000:3.0:1789785042.758832:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785042.758869:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548977280 00000100:00100000:3.0:1789785042.758876:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548977280 00000100:00100000:3.0:1789785042.758911:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789785042.758918:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000642d0291 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+11:3662:x1876725548977280:12345-0@lo:400: 00000100:00100000:3.0:1789785042.758962:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000642d0291 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+11:3662:x1876725548977280:12345-0@lo:400: Request processed in 44us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785042.758969:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789785042.759010:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de63fdab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725548977280:0@lo:400: 00000100:00100000:1.0:1789785042.759309:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548977408 00000100:00100000:1.0:1789785042.759314:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548977408 00000100:00100000:1.0:1789785042.759351:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789785042.759356:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ac79108 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1876725548977408:12345-0@lo:38: 00010000:00080000:1.0:1789785042.759376:0:6535:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 151 last 0 00000020:00000080:1.0:1789785042.759410:0:6535:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2f18ee3fd845be68 00000004:00100000:1.0:1789785042.759451:0:6535:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789785042.759580:0:6535:0:(import.c:65:import_set_state_nolock()) 000000007cfe52e7 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789785042.759623:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ac79108 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1876725548977408:12345-0@lo:38: Request processed in 266us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785042.759629:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789785042.759665:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006fa2d564 x1876725548977408/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789785052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789785042.759677:0:3658:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789785042.759683:0:3658:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789785042.759687:0:3658:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789785042.759689:0:3658:0:(import.c:65:import_set_state_nolock()) 000000005442a4e8 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789785042.759693:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006fa2d564 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1876725548977408:0@lo:38: 00000020:00000004:0.0:1789785042.846399:0:6863:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789785042.846579:0:6863:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789785042.946799:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789785043.269078:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789785043.269086:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9daf89061800 from 3 10000000:01000000:2.0:1789785043.269090:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789785043.269133:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 0000000075f8b095/0x2f18ee3fd845be6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785043.269146:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 0000000075f8b095/0x2f18ee3fd845be6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785043.269156:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 0000000075f8b095/0x2f18ee3fd845be6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785043.269177:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f23affe8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548977536:0@lo:101: 00000100:00100000:2.0:1789785043.269240:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785043.269356:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set 000000000e16c2bd going to sleep for 11 seconds 00000100:00100000:3.0:1789785043.272474:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548977536 00000100:00100000:3.0:1789785043.272485:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548977536 00000100:00100000:2.0:1789785043.274924:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789785043.274934:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052ce06c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+11:6531:x1876725548977536:12345-0@lo:101: 00010000:00010000:2.0:1789785043.274951:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785043.275100:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b4d185dc/0x2f18ee3fd845be76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845be6f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785043.275129:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b4d185dc/0x2f18ee3fd845be76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845be6f expref: 12 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785043.275140:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b4d185dc/0x2f18ee3fd845be76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845be6f expref: 12 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785043.275148:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b4d185dc, rc 0) 00000100:00100000:2.0:1789785043.275227:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052ce06c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+12:6531:x1876725548977536:12345-0@lo:101: Request processed in 294us (5987us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785043.275234:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789785043.275367:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f23affe8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548977536:0@lo:101: 00010000:00010000:0.0:1789785043.275382:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 0000000075f8b095/0x2f18ee3fd845be6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845be76 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785043.275401:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 0000000075f8b095/0x2f18ee3fd845be6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845be76 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785043.275458:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000077cfa30d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548977664:0@lo:256: 00000100:00100000:0.0:1789785043.275498:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785043.275539:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e017b946 going to sleep for 11 seconds 00000100:00100000:2.0:1789785043.275995:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548977664 00000100:00100000:2.0:1789785043.276002:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548977664 00000100:00100000:2.0:1789785043.276045:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789785043.276051:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029f45316 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+12:6531:x1876725548977664:12345-0@lo:256: 20000000:01000000:2.0:1789785043.276067:0:6528:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789785043.276080:0:6528:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789785043.276083:0:6528:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1789785043.276305:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029f45316 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+12:6531:x1876725548977664:12345-0@lo:256: Request processed in 253us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785043.276312:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789785043.276420:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000077cfa30d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548977664:0@lo:256: 10000000:01000000:3.0:1789785043.276471:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789785043.276477:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 0000000075f8b095/0x2f18ee3fd845be6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845be76 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785043.276486:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: 0000000075f8b095/0x2f18ee3fd845be6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845be76 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785043.973158:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785044.997034:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789785045.883249:0:6964:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789785045.883476:0:6964:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789785046.019730:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785047.042670:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785047.874898:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000bc555b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725548977920:0@lo:400: 00000100:00100000:3.0:1789785047.875135:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785047.875380:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548977920 00000100:00100000:3.0:1789785047.875389:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548977920 00000100:00100000:3.0:1789785047.875436:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789785047.875445:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004e1b348 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725548977920:12345-0@lo:400: 00000100:00100000:3.0:1789785047.875522:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004e1b348 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725548977920:12345-0@lo:400: Request processed in 78us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785047.875531:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789785047.875571:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000bc555b8 x1876725548977920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785047.875586:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000bc555b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725548977920:0@lo:400: 00000100:00100000:1.0:1789785047.876381:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789785047.876408:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de63fdab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725548977792:0@lo:400: 00000100:00100000:1.0:1789785047.876485:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785047.877103:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548977792 00000100:00100000:3.0:1789785047.877114:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548977792 00000100:00100000:3.0:1789785047.877164:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789785047.877173:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039912075 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+12:3661:x1876725548977792:12345-0@lo:400: 00000100:00100000:3.0:1789785047.877253:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039912075 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+12:3661:x1876725548977792:12345-0@lo:400: Request processed in 82us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785047.877326:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789785047.877412:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de63fdab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725548977792:0@lo:400: 00010000:00010000:2.0:1789785048.067280:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785049.098334:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785050.115481:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785051.148253:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785052.163667:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785053.001753:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000682980dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725548978048:0@lo:400: 00000100:00100000:2.0:1789785053.001847:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785053.002023:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f831e7f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725548978176:0@lo:400: 00000100:00100000:2.0:1789785053.002058:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785053.002096:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548978048 00000100:00100000:2.0:1789785053.002103:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548978048 00000100:00100000:2.0:1789785053.002146:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789785053.002154:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000309f13f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+12:3660:x1876725548978048:12345-0@lo:400: 00000100:00100000:2.0:1789785053.002380:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000309f13f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+12:3660:x1876725548978048:12345-0@lo:400: Request processed in 227us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785053.002388:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789785053.002824:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548978176 00000100:00100000:1.0:1789785053.002831:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548978176 00000100:00100000:1.0:1789785053.002874:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789785053.002881:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fd3c2f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725548978176:12345-0@lo:400: 00000100:00100000:2.0:1789785053.003026:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000682980dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725548978048:0@lo:400: 00000100:00100000:1.0:1789785053.003553:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fd3c2f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725548978176:12345-0@lo:400: Request processed in 672us (1493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785053.003561:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789785053.003774:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f831e7f1 x1876725548978176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785053.003787:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f831e7f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725548978176:0@lo:400: 00010000:00010000:3.0:1789785053.187317:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785054.211501:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785055.237663:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789785056.183840:0:7463:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789785056.183844:0:7463:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789785056.183854:0:7463:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789785056.184046:0:7463:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000303a2c8e 00000020:01000004:2.0:1789785056.184061:0:7463:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1789785056.184072:0:7463:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789785056.184085:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000001679352b) 00000020:00000080:2.0:1789785056.184099:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789785056.254904:0:7463:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:0.0:1789785056.254981:0:7463:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00010000:00010000:2.0:1789785056.262042:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:01000000:0.0:1789785056.272237:0:7463:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789785056.272464:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789785056.273232:0:7463:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789785056.273245:0:7463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f18ee3fd845be84 00000020:01000004:0.0:1789785056.273251:0:7463:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789785056.273271:0:7463:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.146@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789785056.273274:0:7463:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.146@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789785056.273280:0:7463:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789785056.273304:0:7463:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789785056.273308:0:7463:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.146@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789785056.301553:0:7463:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.146@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789785056.301651:0:7463:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.146@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1789785056.301655:0:7463:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789785056.301656:0:7463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789785056.301657:0:7463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789785056.301659:0:7463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789785056.301660:0:7463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789785056.301661:0:7463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789785056.301667:0:7463:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789785056.301668:0:7463:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789785056.301669:0:7463:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789785056.301670:0:7463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789785056.301671:0:7463:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789785056.301675:0:7463:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1789785056.301677:0:7463:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789785056.301678:0:7463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789785056.301679:0:7463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789785056.301679:0:7463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789785056.301680:0:7463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789785056.301681:0:7463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789785056.301681:0:7463:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789785056.301682:0:7463:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789785056.301683:0:7463:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789785056.301683:0:7463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789785056.301684:0:7463:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789785056.301709:0:7463:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789785056.301725:0:7463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d94928dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548978304:0@lo:253: 00000100:00100000:0.0:1789785056.301796:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785056.301912:0:7463:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e4d052b8 going to sleep for 11 seconds 00000100:00100000:3.0:1789785056.302010:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548978304 00000100:00100000:3.0:1789785056.302017:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548978304 00000100:00100000:3.0:1789785056.302231:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789785056.302242:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d17f1ba6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+12:7463:x1876725548978304:12345-0@lo:253: 20000000:01000000:3.0:1789785056.302271:0:6527:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789785056.302276:0:6527:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1789785056.302280:0:6527:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1789785056.302283:0:6527:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1789785056.302316:0:6527:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1789785056.302542:0:6527:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789785056.302850:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1789785056.302883:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789785056.302902:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1789785056.302916:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1789785056.302930:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1789785056.302979:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1789785056.302987:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1789785056.302998:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1789785056.303003:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1789785056.303014:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1789785056.303018:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1789785056.303030:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1789785056.303044:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1789785056.303165:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1789785056.303176:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.146@tcp (null) (null) (null) 00000040:00080000:3.0:1789785056.303190:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1789785056.303195:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789785056.303206:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1789785056.303213:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.146@tcp (null) (null) 00000040:00080000:3.0:1789785056.303225:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1789785056.303230:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789785056.303240:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1789785056.303253:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1789785056.303263:0:6527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1789785056.303534:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1789785056.303551:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1789785056.303630:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1789785056.303650:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1789785056.303667:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1789785056.303674:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1789785056.303688:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1789785056.303719:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1789785056.303725:0:6527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1789785056.303750:0:6527:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1789785056.303756:0:6527:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1789785056.307039:0:7469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1789785056.307308:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789785056.307334:0:6527:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.146@tcp for mdt 20000000:01000000:0.0:1789785056.307385:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.146@tcp (null) (null) (null) 00000040:00080000:0.0:1789785056.307404:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789785056.307411:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789785056.307425:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789785056.307430:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.146@tcp (null) (null) 00000040:00080000:0.0:1789785056.307445:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789785056.307453:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1789785056.307499:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1789785056.307516:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1789785056.307594:0:6527:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1789785056.307604:0:6527:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1789785056.308548:0:7470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1789785056.308830:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1789785056.308864:0:6527:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.146@tcp for mdt 20000000:01000000:0.0:1789785056.308866:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.146@tcp (null) (null) (null) 00000040:00080000:0.0:1789785056.308952:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1789785056.308960:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789785056.308972:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1789785056.308976:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.146@tcp (null) (null) 00000040:00080000:0.0:1789785056.308987:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1789785056.308993:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1789785056.309004:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1789785056.309018:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1789785056.309037:0:6527:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789785056.309040:0:6527:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789785056.309043:0:6527:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789785056.309098:0:6527:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789785056.309100:0:6527:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789785056.309545:0:7471:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1789785056.309628:0:7471:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1789785056.309662:0:7471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1789785056.309809:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1789785056.309833:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1789785056.309851:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1789785056.309861:0:6527:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789785056.309863:0:6527:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789785056.310215:0:7472:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1789785056.310233:0:7472:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1789785056.310246:0:7472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1789785056.310431:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1789785056.310452:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1789785056.310724:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1789785056.310739:0:6527:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789785056.310740:0:6527:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789785056.311132:0:7473:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1789785056.311162:0:7473:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1789785056.311179:0:7473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1789785056.311629:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1789785056.311654:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1789785056.311671:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1789785056.311685:0:6527:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789785056.311687:0:6527:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789785056.311692:0:6527:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789785056.311699:0:6527:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789785056.311989:0:7474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1789785056.312179:0:6527:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789785056.325410:0:6527:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789785056.325451:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d11f2999/0x2f18ee3fd845be8b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.325722:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000047d5e0ca/0x2f18ee3fd845bdc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bdb9 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.325731:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000018f5a7cb/0x2f18ee3fd845bddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bdd5 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.325751:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fc16526c/0x2f18ee3fd845be4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845be45 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.325757:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d11f2999/0x2f18ee3fd845be8b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.325796:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fc16526c/0x2f18ee3fd845be4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845be45 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.325809:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fc16526c/0x2f18ee3fd845be4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845be45 expref: 12 pid: 6526 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785056.325823:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de63fdab pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6527:1876725548978432:0@lo:104: 00000100:00100000:3.0:1789785056.325953:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785056.326125:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548978432 00000100:00100000:0.0:1789785056.326134:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548978432 00000100:00100000:0.0:1789785056.326199:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789785056.326209:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000bc555b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+3:6527:x1876725548978432:12345-0@lo:104: 00010000:00010000:0.0:1789785056.326221:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: 0000000064f5d218/0x2f18ee3fd845be45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845be4c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785056.326278:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789785056.326284:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000bc555b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+3:6527:x1876725548978432:12345-0@lo:104: Request processed in 76us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785056.326290:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789785056.326326:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000018f5a7cb/0x2f18ee3fd845bddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845bdd5 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.326371:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000018f5a7cb/0x2f18ee3fd845bddc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845bdd5 expref: 12 pid: 6528 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785056.326381:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000072266edd pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6527:1876725548978560:0@lo:104: 00000100:00100000:3.0:1789785056.326405:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785056.326430:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548978560 00000100:00100000:3.0:1789785056.326434:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548978560 00000100:00100000:3.0:1789785056.326453:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789785056.326458:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a025c73 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+3:6527:x1876725548978560:12345-0@lo:104: 00010000:00010000:3.0:1789785056.326464:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: 00000000574c82bd/0x2f18ee3fd845bdd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845bddc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.326623:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789785056.326629:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: 0000000064f5d218/0x2f18ee3fd845be45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845be4c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.326636:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000064f5d218 already unused, calling callback (000000006d49e52c) 10000000:00010000:2.0:1789785056.326640:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: 0000000064f5d218/0x2f18ee3fd845be45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845be4c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.326647:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: 0000000064f5d218/0x2f18ee3fd845be45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845be4c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789785056.326654:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: 0000000064f5d218/0x2f18ee3fd845be45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845be4c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785056.326659:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789785056.326688:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: 0000000064f5d218/0x2f18ee3fd845be45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845be4c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.326695:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789785056.326712:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: 0000000064f5d218/0x2f18ee3fd845be45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845be4c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.326718:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: 0000000064f5d218/0x2f18ee3fd845be45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845be4c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.326742:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785056.326744:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785056.326745:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785056.326762:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000682980dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725548978688:0@lo:103: 00000100:00100000:2.0:1789785056.326792:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785056.326836:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548978688 00000100:00100000:2.0:1789785056.326840:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548978688 00010000:00010000:2.0:1789785056.326855:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fc16526c/0x2f18ee3fd845be4c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845be45 expref: 13 pid: 6526 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785056.327306:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789785056.327315:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8447b1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+13:3662:x1876725548978688:12345-0@lo:103: 00010000:00010000:2.0:1789785056.327327:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785056.327331:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fc16526c/0x2f18ee3fd845be4c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845be45 expref: 13 pid: 6526 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.327369:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fc16526c/0x2f18ee3fd845be4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845be45 expref: 13 pid: 6526 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.327384:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785056.327420:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8447b1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+13:3662:x1876725548978688:12345-0@lo:103: Request processed in 108us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785056.327426:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789785056.327534:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789785056.327539:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a025c73 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+3:6527:x1876725548978560:12345-0@lo:104: Request processed in 1082us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785056.327545:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789785056.327644:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000047d5e0ca/0x2f18ee3fd845bdc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845bdb9 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.327653:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000047d5e0ca/0x2f18ee3fd845bdc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845bdb9 expref: 12 pid: 6526 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785056.327662:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000087dd5284 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6527:1876725548978816:0@lo:104: 00000100:00100000:3.0:1789785056.327686:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785056.327703:0:6527:0:(client.c:2715:ptlrpc_set_wait()) set 000000009acdc8fb going to sleep for 11 seconds 00010000:00010000:3.0:1789785056.327721:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fc16526c/0x2f18ee3fd845be4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845be45 expref: 12 pid: 6526 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785056.327732:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de63fdab pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6527:1876725548978432:0@lo:104: 00000100:00100000:3.0:1789785056.327741:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000072266edd pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6527:1876725548978560:0@lo:104: 00000100:00100000:1.0:1789785056.327809:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548978816 00000100:00100000:1.0:1789785056.327814:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548978816 00000100:00100000:1.0:1789785056.327841:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789785056.327848:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000bab5511 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+3:6527:x1876725548978816:12345-0@lo:104: 00010000:00010000:1.0:1789785056.327856:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: 00000000bf6fa44a/0x2f18ee3fd845bdb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845bdc0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785056.327973:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000682980dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725548978688:0@lo:103: 00010000:00010000:1.0:1789785056.328042:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789785056.328047:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000bab5511 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+3:6527:x1876725548978816:12345-0@lo:104: Request processed in 201us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785056.328062:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789785056.328169:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789785056.328174:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: 00000000574c82bd/0x2f18ee3fd845bdd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845bddc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.328181:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000574c82bd already unused, calling callback (000000006d49e52c) 10000000:00010000:2.0:1789785056.328191:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: 00000000574c82bd/0x2f18ee3fd845bdd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845bddc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.328198:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: 00000000574c82bd/0x2f18ee3fd845bdd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845bddc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789785056.328203:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: 00000000574c82bd/0x2f18ee3fd845bdd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845bddc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785056.328208:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789785056.328238:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: 00000000574c82bd/0x2f18ee3fd845bdd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bddc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.328244:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789785056.328259:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: 00000000574c82bd/0x2f18ee3fd845bdd5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bddc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.328264:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: 00000000574c82bd/0x2f18ee3fd845bdd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bddc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.328274:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789785056.328276:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: 00000000bf6fa44a/0x2f18ee3fd845bdb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845bdc0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.328281:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bf6fa44a already unused, calling callback (000000006d49e52c) 10000000:00010000:2.0:1789785056.328283:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: 00000000bf6fa44a/0x2f18ee3fd845bdb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845bdc0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.328288:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: 00000000bf6fa44a/0x2f18ee3fd845bdb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845bdc0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789785056.328302:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: 00000000bf6fa44a/0x2f18ee3fd845bdb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845bdc0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785056.328307:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789785056.328320:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: 00000000bf6fa44a/0x2f18ee3fd845bdb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bdc0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.328325:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789785056.328329:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: 00000000bf6fa44a/0x2f18ee3fd845bdb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bdc0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.328334:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: 00000000bf6fa44a/0x2f18ee3fd845bdb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bdc0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.328372:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785056.328373:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785056.328375:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785056.328384:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000020b9b5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725548978944:0@lo:103: 00000100:00100000:2.0:1789785056.328411:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785056.328439:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789785056.328444:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bfe07989 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725548979072:0@lo:103: 00000100:00100000:2.0:1789785056.328463:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785056.328487:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548978944 00000100:00100000:2.0:1789785056.328491:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548978944 00010000:00010000:2.0:1789785056.328506:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000018f5a7cb/0x2f18ee3fd845bddc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845bdd5 expref: 12 pid: 6528 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785056.328522:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548979072 00000100:00100000:2.0:1789785056.328525:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548979072 00010000:00010000:2.0:1789785056.328542:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000047d5e0ca/0x2f18ee3fd845bdc0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845bdb9 expref: 13 pid: 6526 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785056.328556:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789785056.328672:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000087dd5284 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6527:1876725548978816:0@lo:104: 00010000:00010000:0.0:1789785056.328694:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d11f2999/0x2f18ee3fd845be8b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785056.328853:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062766994 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+13:3659:x1876725548978944:12345-0@lo:103: 00010000:00010000:2.0:1789785056.328862:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785056.328866:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000018f5a7cb/0x2f18ee3fd845bddc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845bdd5 expref: 13 pid: 6528 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.328944:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000018f5a7cb/0x2f18ee3fd845bddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845bdd5 expref: 13 pid: 6528 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.328957:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000018f5a7cb/0x2f18ee3fd845bddc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845bdd5 expref: 13 pid: 6528 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.328968:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785056.329046:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062766994 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+12:3659:x1876725548978944:12345-0@lo:103: Request processed in 196us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785056.329063:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789785056.329077:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789785056.329083:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd809c5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+11:3659:x1876725548979072:12345-0@lo:103: 00010000:00010000:2.0:1789785056.329090:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785056.329094:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000047d5e0ca/0x2f18ee3fd845bdc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845bdb9 expref: 11 pid: 6526 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.329101:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000047d5e0ca/0x2f18ee3fd845bdc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845bdb9 expref: 11 pid: 6526 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.329110:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000047d5e0ca/0x2f18ee3fd845bdc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845bdb9 expref: 11 pid: 6526 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.329130:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d11f2999/0x2f18ee3fd845be8b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.329136:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d11f2999/0x2f18ee3fd845be8b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.329160:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d11f2999/0x2f18ee3fd845be8b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.329166:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d11f2999/0x2f18ee3fd845be8b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.329172:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d11f2999/0x2f18ee3fd845be8b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.329177:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d11f2999/0x2f18ee3fd845be8b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.329183:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d11f2999 already unused, calling callback (00000000113dcc6a) 00010000:00010000:2.0:1789785056.329186:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d11f2999/0x2f18ee3fd845be8b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.329192:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d11f2999/0x2f18ee3fd845be8b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.329211:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d11f2999/0x2f18ee3fd845be8b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.329220:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785056.329244:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd809c5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+10:3659:x1876725548979072:12345-0@lo:103: Request processed in 162us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785056.329258:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789785056.329276:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785056.329462:0:6527:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d11f2999/0x2f18ee3fd845be8b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.329469:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d11f2999/0x2f18ee3fd845be8b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.329474:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d11f2999/0x2f18ee3fd845be8b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789785056.329488:0:6527:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1789785056.331587:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d17f1ba6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+9:7463:x1876725548978304:12345-0@lo:253: Request processed in 29342us (29785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785056.331600:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789785056.331737:0:7463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d94928dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548978304:0@lo:253: 10000000:01000000:1.0:1789785056.331751:0:7463:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789785056.331754:0:7463:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789785056.331755:0:7463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789785056.331756:0:7463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789785056.331757:0:7463:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:1.0:1789785056.331759:0:7463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789785056.331770:0:7463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789785056.331771:0:7463:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789785056.331772:0:7463:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789785056.331774:0:7463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789785056.331775:0:7463:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789785056.331795:0:7463:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000303a2c8e from lustre-MDT0001 10000000:01000000:1.0:1789785056.331823:0:7463:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1789785056.331826:0:7463:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789785056.331832:0:7463:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9daf983fcd28 local copy 10000000:01000000:1.0:1789785056.331835:0:7463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789785056.331877:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 000000008706ac52/0x2f18ee3fd845be92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.331886:0:7463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.146@tcp lock: 000000008706ac52/0x2f18ee3fd845be92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.331893:0:7463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 000000008706ac52/0x2f18ee3fd845be92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785056.331909:0:7463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005d9fbf43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548979200:0@lo:101: 00000100:00100000:1.0:1789785056.331941:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785056.332010:0:7463:0:(client.c:2715:ptlrpc_set_wait()) set 0000000054bd7080 going to sleep for 11 seconds 00000100:00100000:0.0:1789785056.332258:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000020b9b5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725548978944:0@lo:103: 00000100:00100000:0.0:1789785056.332274:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bfe07989 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725548979072:0@lo:103: 00000100:00100000:2.0:1789785056.332503:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548979200 00000100:00100000:2.0:1789785056.332510:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548979200 00000100:00100000:2.0:1789785056.332552:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789785056.332654:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0764d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+9:7463:x1876725548979200:12345-0@lo:101: 00010000:00010000:2.0:1789785056.332668:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785056.332680:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dd2bdc8d/0x2f18ee3fd845be99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845be92 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.332700:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dd2bdc8d/0x2f18ee3fd845be99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845be92 expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.332709:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dd2bdc8d/0x2f18ee3fd845be99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845be92 expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.332716:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dd2bdc8d, rc 0) 00000100:00100000:2.0:1789785056.332794:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0764d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+10:7463:x1876725548979200:12345-0@lo:101: Request processed in 235us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785056.332800:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789785056.333011:0:7463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005d9fbf43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548979200:0@lo:101: 00010000:00010000:1.0:1789785056.333024:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 000000008706ac52/0x2f18ee3fd845be92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2f18ee3fd845be99 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.333033:0:7463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 000000008706ac52/0x2f18ee3fd845be92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2f18ee3fd845be99 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785056.333131:0:7463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005d9fbf43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548979328:0@lo:501: 00000100:00100000:1.0:1789785056.333167:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785056.333208:0:7463:0:(client.c:2715:ptlrpc_set_wait()) set 0000000054bd7080 going to sleep for 11 seconds 00000100:00100000:3.0:1789785056.333252:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548979328 00000100:00100000:3.0:1789785056.333257:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548979328 00000100:00100000:3.0:1789785056.333288:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789785056.333294:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000f05c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+10:7463:x1876725548979328:12345-0@lo:501: 00000100:00100000:3.0:1789785056.333386:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000f05c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+10:7463:x1876725548979328:12345-0@lo:501: Request processed in 92us (218us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789785056.333392:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789785056.333552:0:7463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005d9fbf43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548979328:0@lo:501: 10000000:01000000:1.0:1789785056.333574:0:7463:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.146@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789785056.333590:0:7463:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.146@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789785056.333594:0:7463:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 000000008706ac52/0x2f18ee3fd845be92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2f18ee3fd845be99 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.333601:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 000000008706ac52/0x2f18ee3fd845be92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2f18ee3fd845be99 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.333607:0:7463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: 000000008706ac52/0x2f18ee3fd845be92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2f18ee3fd845be99 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.333629:0:7463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789785056.333655:0:7463:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dafc189c800 10000000:01000000:1.0:1789785056.333660:0:7463:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789785056.333665:0:7463:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9daf983fcd28 10000000:01000000:1.0:1789785056.333667:0:7463:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789785056.333670:0:7463:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9daf983fcd28 from 1 10000000:01000000:1.0:1789785056.333672:0:7463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789785056.333687:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 00000000a554dd84/0x2f18ee3fd845bea0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.333693:0:7463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 00000000a554dd84/0x2f18ee3fd845bea0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.333699:0:7463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 00000000a554dd84/0x2f18ee3fd845bea0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785056.333709:0:7463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005d9fbf43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548979456:0@lo:101: 00000100:00100000:1.0:1789785056.333741:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785056.333764:0:7463:0:(client.c:2715:ptlrpc_set_wait()) set 00000000671cb160 going to sleep for 11 seconds 00010000:00010000:2.0:1789785056.333804:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789785056.333810:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: 000000008706ac52/0x2f18ee3fd845be92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2f18ee3fd845be99 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.333817:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008706ac52 already unused, calling callback (000000006d49e52c) 10000000:00010000:2.0:1789785056.333819:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: 000000008706ac52/0x2f18ee3fd845be92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2f18ee3fd845be99 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.333826:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: 000000008706ac52/0x2f18ee3fd845be92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x2f18ee3fd845be99 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789785056.333838:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: 000000008706ac52/0x2f18ee3fd845be92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x2f18ee3fd845be99 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785056.333843:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789785056.333860:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: 000000008706ac52/0x2f18ee3fd845be92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2f18ee3fd845be99 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.333865:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789785056.333897:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: 000000008706ac52/0x2f18ee3fd845be92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2f18ee3fd845be99 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.333903:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: 000000008706ac52/0x2f18ee3fd845be92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2f18ee3fd845be99 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.333915:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785056.333917:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785056.333918:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785056.334004:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548979456 00000100:00100000:3.0:1789785056.334009:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548979456 00000100:00100000:3.0:1789785056.334037:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789785056.334043:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086984783 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+10:7463:x1876725548979456:12345-0@lo:101: 00010000:00010000:3.0:1789785056.334057:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785056.334067:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fc16526c/0x2f18ee3fd845bea7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845bea0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.334081:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fc16526c/0x2f18ee3fd845bea7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845bea0 expref: 11 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.334088:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fc16526c/0x2f18ee3fd845bea7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bea0 expref: 11 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.334094:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fc16526c, rc 0) 00000100:00100000:3.0:1789785056.334125:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086984783 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+11:7463:x1876725548979456:12345-0@lo:101: Request processed in 82us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785056.334130:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789785056.334174:0:7463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005d9fbf43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548979456:0@lo:101: 00010000:00010000:3.0:1789785056.334190:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 00000000a554dd84/0x2f18ee3fd845bea0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bea7 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.334197:0:7463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 00000000a554dd84/0x2f18ee3fd845bea0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845bea7 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785056.334212:0:7463:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789785056.334221:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 00000000a554dd84/0x2f18ee3fd845bea0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bea7 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.334227:0:7463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: 00000000a554dd84/0x2f18ee3fd845bea0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bea7 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785056.334234:0:7463:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9dafc189c800 10000000:01000000:3.0:1789785056.334237:0:7463:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789785056.334239:0:7463:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9dafc189c800 from 1 10000000:01000000:3.0:1789785056.334241:0:7463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789785056.334253:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 00000000e684bf54/0x2f18ee3fd845beae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.334259:0:7463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 00000000e684bf54/0x2f18ee3fd845beae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.334265:0:7463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 00000000e684bf54/0x2f18ee3fd845beae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785056.334275:0:7463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2cf6a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548979712:0@lo:101: 00000100:00100000:3.0:1789785056.334301:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785056.334312:0:7463:0:(client.c:2715:ptlrpc_set_wait()) set 000000001fc7daca going to sleep for 11 seconds 00000100:00100000:1.0:1789785056.334518:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008385e7f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725548979584:0@lo:103: 00000100:00100000:1.0:1789785056.334547:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785056.334675:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548979712 00000100:00100000:2.0:1789785056.334680:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548979712 00000100:00100000:2.0:1789785056.334714:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789785056.334719:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e06e389f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+11:7463:x1876725548979712:12345-0@lo:101: 00010000:00010000:2.0:1789785056.334728:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785056.334736:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000da157456/0x2f18ee3fd845beb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845beae expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.334749:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000da157456/0x2f18ee3fd845beb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845beae expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.334756:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000da157456/0x2f18ee3fd845beb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845beae expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.334770:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000da157456, rc 0) 00000100:00100000:2.0:1789785056.334799:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e06e389f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+12:7463:x1876725548979712:12345-0@lo:101: Request processed in 80us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785056.334805:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789785056.334878:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548979584 00000100:00100000:3.0:1789785056.334888:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548979584 00000100:00100000:3.0:1789785056.334925:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789785056.334931:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000370dd5f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+12:3661:x1876725548979584:12345-0@lo:103: 00010000:00010000:3.0:1789785056.334940:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785056.334951:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dd2bdc8d/0x2f18ee3fd845be99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f18ee3fd845be92 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.334964:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785056.334994:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000370dd5f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+11:3661:x1876725548979584:12345-0@lo:103: Request processed in 63us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785056.335000:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789785056.335030:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008385e7f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725548979584:0@lo:103: 00000100:00100000:3.0:1789785056.335223:0:7463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2cf6a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548979712:0@lo:101: 00010000:00010000:3.0:1789785056.335236:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 00000000e684bf54/0x2f18ee3fd845beae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845beb5 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.335244:0:7463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 00000000e684bf54/0x2f18ee3fd845beae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845beb5 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785056.335254:0:7463:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789785056.335270:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 00000000e684bf54/0x2f18ee3fd845beae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845beb5 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.335277:0:7463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: 00000000e684bf54/0x2f18ee3fd845beae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845beb5 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785056.335283:0:7463:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789785056.335288:0:7463:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789785056.335298:0:7463:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9dafc189c800 10000000:01000000:3.0:1789785056.335300:0:7463:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789785056.335304:0:7463:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1789785056.335306:0:7463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789785056.335325:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 00000000822d4d15/0x2f18ee3fd845bebc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.335331:0:7463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 00000000822d4d15/0x2f18ee3fd845bebc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.335365:0:7463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 00000000822d4d15/0x2f18ee3fd845bebc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785056.335380:0:7463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2cf6a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548979840:0@lo:101: 00000100:00100000:3.0:1789785056.335410:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785056.335423:0:7463:0:(client.c:2715:ptlrpc_set_wait()) set 000000001fc7daca going to sleep for 11 seconds 00000100:00100000:2.0:1789785056.335485:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548979840 00000100:00100000:2.0:1789785056.335489:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548979840 00000100:00100000:2.0:1789785056.335521:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789785056.335527:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a02d3e1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+11:7463:x1876725548979840:12345-0@lo:101: 00010000:00010000:2.0:1789785056.335535:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785056.335543:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000031c8ce79/0x2f18ee3fd845bec3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845bebc expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.335564:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000031c8ce79/0x2f18ee3fd845bec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845bebc expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.335572:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000031c8ce79/0x2f18ee3fd845bec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bebc expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.335579:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000031c8ce79, rc 0) 00000100:00100000:2.0:1789785056.335607:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a02d3e1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+12:7463:x1876725548979840:12345-0@lo:101: Request processed in 81us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785056.335611:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789785056.335885:0:7463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2cf6a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548979840:0@lo:101: 00010000:00010000:3.0:1789785056.335895:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 00000000822d4d15/0x2f18ee3fd845bebc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bec3 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.335902:0:7463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 00000000822d4d15/0x2f18ee3fd845bebc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845bec3 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785056.335982:0:7463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2cf6a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548979968:0@lo:501: 00000100:00100000:3.0:1789785056.336006:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785056.336029:0:7463:0:(client.c:2715:ptlrpc_set_wait()) set 000000001fc7daca going to sleep for 11 seconds 00000100:00100000:3.0:1789785056.336045:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548979968 00000100:00100000:3.0:1789785056.336049:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548979968 00000100:00100000:3.0:1789785056.336263:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789785056.336270:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b796d67c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+12:7463:x1876725548979968:12345-0@lo:501: 00000100:00100000:3.0:1789785056.336391:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b796d67c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+12:7463:x1876725548979968:12345-0@lo:501: Request processed in 121us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785056.336398:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789785056.336423:0:7463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2cf6a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548979968:0@lo:501: 00000100:00100000:3.0:1789785056.336447:0:7463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2cf6a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548980096:0@lo:503: 00000100:00100000:3.0:1789785056.336483:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785056.337738:0:7463:0:(client.c:2715:ptlrpc_set_wait()) set 000000001fc7daca going to sleep for 11 seconds 00000100:00100000:0.0:1789785056.337798:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548980096 00000100:00100000:0.0:1789785056.337805:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548980096 00000100:00100000:0.0:1789785056.337836:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789785056.337843:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f01f8853 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+12:7463:x1876725548980096:12345-0@lo:503: 00000100:00100000:0.0:1789785056.338172:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f01f8853 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+12:7463:x1876725548980096:12345-0@lo:503: Request processed in 329us (1688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785056.338180:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789785056.338528:0:7463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2cf6a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548980096:0@lo:503: 00000040:00080000:3.0:1789785056.338865:0:7463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789785056.339131:0:7463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2cf6a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548980224:0@lo:502: 00000100:00100000:3.0:1789785056.339190:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785056.339270:0:7463:0:(client.c:2715:ptlrpc_set_wait()) set 000000001fc7daca going to sleep for 11 seconds 00000100:00100000:0.0:1789785056.339307:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548980224 00000100:00100000:0.0:1789785056.339313:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548980224 00000100:00100000:0.0:1789785056.339457:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789785056.339466:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065fbaa7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+12:7463:x1876725548980224:12345-0@lo:502: 00000100:00100000:0.0:1789785056.339654:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065fbaa7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+12:7463:x1876725548980224:12345-0@lo:502: Request processed in 189us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785056.339671:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789785056.339755:0:7463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2cf6a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548980224:0@lo:502: 00000040:00080000:3.0:1789785056.340254:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789785056.340283:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1789785056.340298:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1789785056.340311:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1789785056.340322:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1789785056.340354:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1789785056.340374:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1789785056.340388:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1789785056.340416:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1789785056.340431:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1789785056.340441:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1789785056.340452:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1789785056.340463:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1789785056.340475:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1789785056.340499:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1789785056.340512:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1789785056.340524:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1789785056.340537:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1789785056.340550:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1789785056.340632:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1789785056.340650:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1789785056.340664:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1789785056.340678:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1789785056.340706:0:7463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2cf6a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548980352:0@lo:502: 00000100:00100000:3.0:1789785056.340759:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785056.342800:0:7463:0:(client.c:2715:ptlrpc_set_wait()) set 000000001fc7daca going to sleep for 11 seconds 00000100:00100000:0.0:1789785056.342915:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548980352 00000100:00100000:0.0:1789785056.342924:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548980352 00000100:00100000:1.0:1789785056.344033:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789785056.344060:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ab464cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+12:7463:x1876725548980352:12345-0@lo:502: 00000100:00100000:1.0:1789785056.344234:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ab464cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+12:7463:x1876725548980352:12345-0@lo:502: Request processed in 191us (3475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785056.344242:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789785056.344439:0:7463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2cf6a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548980352:0@lo:502: 00000040:00080000:3.0:1789785056.344517:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1789785056.344530:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1789785056.345246:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789785056.345256:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789785056.345258:0:7475:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789785056.345264:0:7475:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1789785056.345266:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789785056.345294:0:7475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000906314ef) 00000020:00000080:3.0:1789785056.345317:0:7475:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1789785056.345323:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789785056.345484:0:7475:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789785056.345492:0:7475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f18ee3fd845bed1 00000020:00000080:3.0:1789785056.345809:0:7475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789785056.345814:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789785056.345818:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789785056.345819:0:7475:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789785056.345822:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789785056.345826:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789785056.345834:0:7475:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1789785056.345839:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789785056.345846:0:7475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000013c061bc) 00000020:00000080:3.0:1789785056.345856:0:7475:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1789785056.345860:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789785056.345862:0:7475:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1789785056.345864:0:7475:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1789785056.345943:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789785056.346011:0:7475:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000303a2c8e from lustre-MDT0001, refs=2 00000020:00000080:3.0:1789785056.346024:0:7475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000003491e729) 00000020:00000080:3.0:1789785056.346036:0:7475:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1789785056.346181:0:7475:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789785056.346187:0:7475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f18ee3fd845bee6 00000020:00000080:3.0:1789785056.346284:0:7475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1789785056.346290:0:7475:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789785056.346295:0:7475:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x2f18ee3fd845beed 00080000:01000000:3.0:1789785056.346300:0:7475:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789785056.346303:0:7475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f18ee3fd845bef4 00080000:10000000:3.0:1789785056.347216:0:7475:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1789785056.347393:0:7475:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1789785056.497540:0:7475:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1789785056.497783:0:7475:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1789785056.515292:0:7475:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789785056.515669:0:7475:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789785056.537016:0:7475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1789785056.537038:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789785056.537052:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785056.537055:0:7475:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1789785056.537060:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789785056.537065:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785056.537072:0:7475:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1789785056.537076:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789785056.537081:0:7475:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.146@tcp to nid 0x20000c0a8cb92 (192.168.203.146@tcp) 00000020:00000080:2.0:1789785056.537112:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789785056.537532:0:7475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000008591cd68) 00000020:00000080:2.0:1789785056.537557:0:7475:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1789785056.537570:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789785056.537644:0:7475:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1789785056.537650:0:7475:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789785056.537665:0:7475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f18ee3fd845bf02 00010000:00080000:2.0:1789785056.537700:0:7475:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006844638f@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.146@tcp at head 00010000:00010000:2.0:1789785056.544391:0:7475:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1789785056.548652:0:7475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789785056.548667:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789785056.548891:0:7475:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789785056.548973:0:7475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f18ee3fd845bf09 00000100:00080000:0.0:1789785056.548984:0:7475:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789785056.548989:0:7475:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000006844638f using connection 192.168.203.146@tcp/0@lo 00000100:00100000:0.0:1789785056.549021:0:7475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000084dde4ff x1876725548980480/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789785056.549048:0:7475:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1789785056.549159:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785056.549164:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785056.549166:0:7475:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1789785056.549170:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789785056.549172:0:7475:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1789785056.549174:0:7475:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789785056.549176:0:7475:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789785056.549177:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789785056.549179:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785056.549181:0:7475:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789785056.549183:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789785056.549187:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785056.549188:0:7475:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1789785056.549191:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789785056.549210:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000084dde4ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725548980480:0@lo:38: 00000004:01000000:0.0:1789785056.549227:0:7475:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789785056.549243:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785056.549246:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785056.549247:0:7475:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1789785056.549249:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789785056.549251:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785056.549252:0:7475:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789785056.549254:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789785056.549270:0:7475:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789785056.549297:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785056.549300:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785056.549301:0:7475:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000100:00100000:1.0:1789785056.549303:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1789785056.549303:0:7475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:1.0:1789785056.549392:0:7463:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:1.0:1789785056.549417:0:7463:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789785056.549431:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 00000000822d4d15/0x2f18ee3fd845bebc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bec3 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.549441:0:7463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: 00000000822d4d15/0x2f18ee3fd845bebc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bec3 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785056.549449:0:7463:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dafc189c800 from 1 10000000:01000000:1.0:1789785056.549451:0:7463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789785056.549474:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 0000000073911879/0x2f18ee3fd845bf10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.549481:0:7463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 0000000073911879/0x2f18ee3fd845bf10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.549490:0:7463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 0000000073911879/0x2f18ee3fd845bf10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785056.549509:0:7463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000087871e85 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548980608:0@lo:101: 00000100:00100000:3.0:1789785056.549516:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548980480 00000100:00100000:3.0:1789785056.549522:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548980480 00000100:00100000:1.0:1789785056.549537:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785056.549549:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789785056.549554:0:7463:0:(client.c:2715:ptlrpc_set_wait()) set 00000000671cb160 going to sleep for 11 seconds 00000100:00100000:3.0:1789785056.549555:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a716182e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3658:x1876725548980480:12345-0@lo:38: 00010000:00080000:3.0:1789785056.549575:0:6538:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000100:00100000:1.0:1789785056.549581:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548980608 00000100:00100000:1.0:1789785056.549584:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548980608 00000020:00000080:3.0:1789785056.549604:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f18ee3fd845bf17 00000100:00100000:1.0:1789785056.549610:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789785056.549615:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a315a760 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+12:7463:x1876725548980608:12345-0@lo:101: 00000004:00100000:3.0:1789785056.549616:0:6538:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00010000:1.0:1789785056.549625:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000001:00000004:3.0:1789785056.549626:0:6538:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1789785056.549635:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000079060d72/0x2f18ee3fd845bf1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845bf10 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.549653:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000079060d72/0x2f18ee3fd845bf1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845bf10 expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.549662:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000079060d72/0x2f18ee3fd845bf1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bf10 expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.549669:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000079060d72, rc 0) 00000100:00100000:1.0:1789785056.549715:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a315a760 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+13:7463:x1876725548980608:12345-0@lo:101: Request processed in 100us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785056.549722:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789785056.550000:0:7463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000087871e85 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548980608:0@lo:101: 00010000:00010000:3.0:1789785056.550014:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 0000000073911879/0x2f18ee3fd845bf10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bf1e expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.550131:0:7463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 0000000073911879/0x2f18ee3fd845bf10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845bf1e expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785056.550863:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000083a0cf17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1876725548980736:0@lo:400: 00000100:00100000:1.0:1789785056.551011:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785056.551200:0:7463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005404eaf6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548980864:0@lo:256: 00000100:00100000:0.0:1789785056.551236:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785056.551262:0:7463:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b20c0d8 going to sleep for 11 seconds 00000100:00100000:1.0:1789785056.551333:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548980864 00000100:00100000:1.0:1789785056.551356:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548980864 00000100:00100000:1.0:1789785056.551390:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789785056.551396:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048cbec38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+13:7463:x1876725548980864:12345-0@lo:256: 20000000:01000000:1.0:1789785056.552019:0:6527:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789785056.552036:0:6527:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789785056.552039:0:6527:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789785056.552160:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048cbec38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+13:7463:x1876725548980864:12345-0@lo:256: Request processed in 764us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785056.552168:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789785056.552375:0:7463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005404eaf6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548980864:0@lo:256: 10000000:01000000:3.0:1789785056.552927:0:7463:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789785056.552941:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 0000000073911879/0x2f18ee3fd845bf10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bf1e expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.552951:0:7463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: 0000000073911879/0x2f18ee3fd845bf10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bf1e expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785056.552959:0:7463:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dafc189c800 from 1 10000000:01000000:3.0:1789785056.552962:0:7463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789785056.552988:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 00000000d11f2999/0x2f18ee3fd845bf25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.552995:0:7463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 00000000d11f2999/0x2f18ee3fd845bf25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.553003:0:7463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 00000000d11f2999/0x2f18ee3fd845bf25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785056.553201:0:7463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2cf6a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548980992:0@lo:101: 00000100:00100000:3.0:1789785056.553242:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785056.553276:0:7463:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d2128cc3 going to sleep for 11 seconds 00000100:00100000:1.0:1789785056.553325:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548980992 00000100:00100000:1.0:1789785056.553330:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548980992 00000100:00100000:1.0:1789785056.553388:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789785056.553396:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d0500ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+13:7463:x1876725548980992:12345-0@lo:101: 00010000:00010000:1.0:1789785056.553652:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785056.553665:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006f19620e/0x2f18ee3fd845bf2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845bf25 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.553685:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006f19620e/0x2f18ee3fd845bf2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845bf25 expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.553695:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006f19620e/0x2f18ee3fd845bf2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bf25 expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.553702:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006f19620e, rc 0) 00000100:00100000:1.0:1789785056.553749:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d0500ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+14:7463:x1876725548980992:12345-0@lo:101: Request processed in 354us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785056.553755:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789785056.554029:0:7463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2cf6a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548980992:0@lo:101: 00010000:00010000:3.0:1789785056.554042:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 00000000d11f2999/0x2f18ee3fd845bf25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bf2c expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.554050:0:7463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 00000000d11f2999/0x2f18ee3fd845bf25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845bf2c expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785056.554158:0:7463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2cf6a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548981120:0@lo:501: 00000100:00100000:3.0:1789785056.554185:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785056.554207:0:7463:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d2128cc3 going to sleep for 11 seconds 00000100:00100000:1.0:1789785056.554227:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548981120 00000100:00100000:1.0:1789785056.554231:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548981120 00000100:00100000:1.0:1789785056.554264:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789785056.554270:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+14:7463:x1876725548981120:12345-0@lo:501: 00000100:00100000:1.0:1789785056.554537:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+14:7463:x1876725548981120:12345-0@lo:501: Request processed in 267us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785056.554551:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789785056.554642:0:7463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2cf6a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548981120:0@lo:501: 00000100:00100000:3.0:1789785056.554665:0:7463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2cf6a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548981248:0@lo:503: 00000100:00100000:3.0:1789785056.554699:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785056.554716:0:7463:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d2128cc3 going to sleep for 11 seconds 00000100:00100000:2.0:1789785056.554792:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548980736 00000100:00100000:2.0:1789785056.554797:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548980736 00000100:00100000:2.0:1789785056.554839:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789785056.554845:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a8b871f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1876725548980736:12345-0@lo:400: 00000100:00100000:2.0:1789785056.554886:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a8b871f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1876725548980736:12345-0@lo:400: Request processed in 41us (3875us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785056.554892:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789785056.554923:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000083a0cf17 x1876725548980736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785056.554934:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000083a0cf17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1876725548980736:0@lo:400: 00000100:00100000:0.0:1789785056.555113:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548981248 00000100:00100000:0.0:1789785056.555170:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548981248 00000100:00100000:0.0:1789785056.555203:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789785056.555209:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023a87a8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+14:7463:x1876725548981248:12345-0@lo:503: 00000040:00080000:0.0:1789785056.555240:0:6528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789785056.555284:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023a87a8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+14:7463:x1876725548981248:12345-0@lo:503: Request processed in 76us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785056.555290:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789785056.555448:0:7463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2cf6a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548981248:0@lo:503: 00000040:00080000:3.0:1789785056.555668:0:7463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789785056.555720:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1789785056.555801:0:7463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1789785056.556060:0:6538:0:(import.c:65:import_set_state_nolock()) 0000000061316feb : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789785056.556209:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a716182e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3658:x1876725548980480:12345-0@lo:38: Request processed in 6652us (6906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785056.556221:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:3.0:1789785056.556762:0:7480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1789785056.556893:0:7463:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1789785056.556917:0:7463:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00000100:00100000:2.0:1789785056.556933:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00010000:00010000:0.0:1789785056.556941:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 00000000d11f2999/0x2f18ee3fd845bf25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bf2c expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789785056.556943:0:3658:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789785056.556950:0:3658:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00010000:00010000:0.0:1789785056.556951:0:7463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: 00000000d11f2999/0x2f18ee3fd845bf25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bf2c expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789785056.556955:0:3658:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789785056.556963:0:3658:0:(import.c:65:import_set_state_nolock()) 000000006844638f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789785056.556977:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000084dde4ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725548980480:0@lo:38: 10000000:01000000:0.0:1789785056.556999:0:7463:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789785056.557001:0:7463:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dafc189c800 10000000:01000000:0.0:1789785056.557004:0:7463:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dafc189c800 10000000:01000000:0.0:1789785056.557007:0:7463:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789785056.557012:0:7463:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dafc189c800 from 1 10000000:01000000:0.0:1789785056.557015:0:7463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789785056.557046:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 0000000047d5e0ca/0x2f18ee3fd845bf33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785056.557054:0:7463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 0000000047d5e0ca/0x2f18ee3fd845bf33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785056.557062:0:7463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 0000000047d5e0ca/0x2f18ee3fd845bf33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785056.557079:0:7463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b654e426 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548981376:0@lo:101: 00000100:00100000:0.0:1789785056.557115:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785056.557243:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2cf6a65 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725548981504:0@lo:41: 00000100:00100000:2.0:1789785056.557272:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785056.557357:0:7463:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a0de6d2f going to sleep for 11 seconds 00000100:00100000:3.0:1789785056.557368:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548981504 00000100:00100000:0.0:1789785056.557371:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548981376 00000100:00100000:3.0:1789785056.557373:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548981504 00000100:00100000:0.0:1789785056.557374:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548981376 00000100:00100000:3.0:1789785056.557403:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789785056.557411:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083a0cf17 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3659:x1876725548981504:12345-0@lo:41: 00000004:00000024:3.0:1789785056.557435:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1789785056.557471:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083a0cf17 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3659:x1876725548981504:12345-0@lo:41: Request processed in 61us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785056.557473:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789785056.557481:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbbfb797 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+14:7463:x1876725548981376:12345-0@lo:101: 00000100:00100000:3.0:1789785056.557486:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789785056.557488:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785056.557499:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000006525410/0x2f18ee3fd845bf3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845bf33 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785056.557517:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000006525410/0x2f18ee3fd845bf3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845bf33 expref: 15 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785056.557526:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000006525410/0x2f18ee3fd845bf3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bf33 expref: 15 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785056.557534:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000006525410, rc 0) 00000100:00100000:2.0:1789785056.557553:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2cf6a65 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725548981504:0@lo:41: 00000100:00100000:0.0:1789785056.557564:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbbfb797 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+15:7463:x1876725548981376:12345-0@lo:101: Request processed in 85us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785056.557569:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789785056.557606:0:7463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b654e426 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548981376:0@lo:101: 00010000:00010000:3.0:1789785056.557617:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 0000000047d5e0ca/0x2f18ee3fd845bf33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bf3a expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.557625:0:7463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 0000000047d5e0ca/0x2f18ee3fd845bf33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845bf3a expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785056.557687:0:7463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d4e5ab55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548981632:0@lo:501: 00000100:00100000:3.0:1789785056.557710:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785056.557903:0:7463:0:(client.c:2715:ptlrpc_set_wait()) set 0000000009beae43 going to sleep for 11 seconds 00000100:00100000:0.0:1789785056.566035:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548981632 00000100:00100000:0.0:1789785056.566051:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548981632 00000100:00100000:1.0:1789785056.567666:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789785056.567677:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068904610 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+15:7463:x1876725548981632:12345-0@lo:501: 00000100:00100000:1.0:1789785056.567862:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068904610 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+15:7463:x1876725548981632:12345-0@lo:501: Request processed in 187us (10151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785056.567880:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789785056.567915:0:7463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d4e5ab55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548981632:0@lo:501: 00000100:00100000:3.0:1789785056.567962:0:7463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d4e5ab55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548981760:0@lo:503: 00000100:00100000:3.0:1789785056.568012:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785056.574464:0:7463:0:(client.c:2715:ptlrpc_set_wait()) set 0000000009beae43 going to sleep for 11 seconds 00000100:00100000:2.0:1789785056.579366:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548981760 00000100:00100000:2.0:1789785056.579381:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548981760 00000100:00100000:2.0:1789785056.583018:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789785056.583035:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b94624ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:7463:x1876725548981760:12345-0@lo:503: 00000100:00100000:2.0:1789785056.583220:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b94624ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:7463:x1876725548981760:12345-0@lo:503: Request processed in 191us (15207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785056.583228:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789785056.583297:0:7463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d4e5ab55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548981760:0@lo:503: 00000040:00080000:2.0:1789785056.583630:0:7463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789785056.583722:0:7463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005965ee18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548981888:0@lo:502: 00000100:00100000:2.0:1789785056.583764:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785056.583795:0:7463:0:(client.c:2715:ptlrpc_set_wait()) set 000000003a69f69a going to sleep for 11 seconds 00000100:00100000:2.0:1789785056.583810:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548981888 00000100:00100000:2.0:1789785056.583815:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548981888 00000100:00100000:2.0:1789785056.583838:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789785056.583843:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c98f2143 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:7463:x1876725548981888:12345-0@lo:502: 00000100:00100000:2.0:1789785056.584038:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c98f2143 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:7463:x1876725548981888:12345-0@lo:502: Request processed in 194us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785056.584045:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789785056.584083:0:7463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005965ee18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548981888:0@lo:502: 00000040:00080000:2.0:1789785056.584277:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789785056.584302:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789785056.584317:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789785056.584331:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789785056.584375:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789785056.584390:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789785056.584723:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789785056.584742:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789785056.584753:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789785056.584765:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789785056.584794:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789785056.584808:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789785056.584820:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789785056.584832:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789785056.584845:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789785056.584856:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789785056.585031:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789785056.585050:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789785056.585061:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789785056.585070:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789785056.585081:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789785056.585091:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789785056.585102:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789785056.585113:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789785056.585124:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1789785056.585137:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1789785056.585173:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1789785056.585190:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1789785056.585220:0:7463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005965ee18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548982016:0@lo:502: 00000100:00100000:2.0:1789785056.585270:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785056.585311:0:7463:0:(client.c:2715:ptlrpc_set_wait()) set 000000003a69f69a going to sleep for 11 seconds 00000100:00100000:3.0:1789785056.586436:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548982016 00000100:00100000:3.0:1789785056.586447:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548982016 00000100:00100000:2.0:1789785056.587079:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789785056.587090:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066f65393 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+15:7463:x1876725548982016:12345-0@lo:502: 00000100:00100000:2.0:1789785056.587262:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066f65393 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+15:7463:x1876725548982016:12345-0@lo:502: Request processed in 174us (1991us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785056.587269:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789785056.587360:0:7463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005965ee18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548982016:0@lo:502: 00000040:00080000:3.0:1789785056.587443:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1789785056.587455:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789785056.592405:0:7481:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789785056.592439:0:7481:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000002bcbcf2b) 00000020:00000080:0.0:1789785056.592462:0:7481:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1789785056.592550:0:7481:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000303a2c8e from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789785056.592555:0:7481:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000303a2c8e from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789785056.592557:0:7481:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000303a2c8e 3 00010000:00080000:0.0:1789785056.592588:0:7481:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c54ae025@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.146@tcp at head 00010000:00010000:1.0:1789785056.599926:0:7481:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1789785056.600972:0:7481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1789785056.601028:0:7481:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789785056.601043:0:7481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x2f18ee3fd845bf48 00000100:00080000:1.0:1789785056.601052:0:7481:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789785056.601058:0:7481:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000c54ae025 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:1.0:1789785056.601094:0:7481:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a7c5eaf5 x1876725548982144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789785056.601125:0:7481:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789785056.601977:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a7c5eaf5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1876725548982144:0@lo:38: 00000100:00100000:2.0:1789785056.602047:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1789785056.602278:0:7481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1789785056.602325:0:7463:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1789785056.602387:0:7463:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789785056.602399:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 0000000047d5e0ca/0x2f18ee3fd845bf33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bf3a expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785056.602421:0:7463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: 0000000047d5e0ca/0x2f18ee3fd845bf33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bf3a expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789785056.602466:0:7463:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789785056.602468:0:7463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789785056.602470:0:7463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789785056.602471:0:7463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789785056.602472:0:7463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789785056.602474:0:7463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789785056.602475:0:7463:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789785056.602476:0:7463:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789785056.602478:0:7463:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789785056.602479:0:7463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789785056.602480:0:7463:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789785056.602483:0:7463:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1789785056.602485:0:7463:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789785056.602487:0:7463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789785056.602488:0:7463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789785056.602489:0:7463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789785056.602489:0:7463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789785056.602490:0:7463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789785056.602491:0:7463:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789785056.602492:0:7463:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789785056.602493:0:7463:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789785056.602494:0:7463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789785056.602495:0:7463:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789785056.602513:0:7463:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789785056.602524:0:7463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d4eb7e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548982272:0@lo:253: 00000100:00100000:3.0:1789785056.602558:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785056.602579:0:7463:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d2128cc3 going to sleep for 11 seconds 00000100:00100000:0.0:1789785056.603109:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548982272 00000100:00100000:0.0:1789785056.603118:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548982272 00000100:00100000:0.0:1789785056.603172:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789785056.603180:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002784d3fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:7463:x1876725548982272:12345-0@lo:253: 20000000:01000000:0.0:1789785056.603207:0:6526:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789785056.603220:0:6526:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 40000000:00080000:2.0:1789785056.603532:0:7482:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:1.0:1789785056.604065:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548982144 00000100:00100000:1.0:1789785056.604071:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548982144 00000100:00100000:1.0:1789785056.604099:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789785056.604105:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9a04970 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1876725548982144:12345-0@lo:38: 00010000:00080000:1.0:1789785056.604125:0:6534:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:1.0:1789785056.604170:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x2f18ee3fd845bf4f 00000004:00100000:1.0:1789785056.604186:0:6534:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789785056.604222:0:6534:0:(import.c:65:import_set_state_nolock()) 00000000781bb0b9 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789785056.604302:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9a04970 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1876725548982144:12345-0@lo:38: Request processed in 196us (2256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785056.604310:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789785056.605538:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a7c5eaf5 x1876725548982144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789785066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785056.605552:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789785056.605562:0:3658:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789785056.605570:0:3658:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789785056.605575:0:3658:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789785056.605578:0:3658:0:(import.c:65:import_set_state_nolock()) 00000000c54ae025 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789785056.605583:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a7c5eaf5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1876725548982144:0@lo:38: 00000001:00100000:0.0:1789785056.609062:0:6512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1789785056.616731:0:6526:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789785056.616846:0:6526:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789785056.619434:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002784d3fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:7463:x1876725548982272:12345-0@lo:253: Request processed in 16248us (16868us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785056.619449:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 20000000:01000000:0.0:1789785056.620012:0:6549:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789785056.620017:0:6549:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789785056.620222:0:6549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008706ac52/0x2f18ee3fd845bf56 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.620238:0:6549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b4d185dc/0x2f18ee3fd845be76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845be6f expref: 14 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.620245:0:6549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000079060d72/0x2f18ee3fd845bf1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bf10 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.620252:0:6549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008706ac52/0x2f18ee3fd845bf56 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.620401:0:6549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000079060d72/0x2f18ee3fd845bf1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845bf10 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.620414:0:6549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000079060d72/0x2f18ee3fd845bf1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf10 expref: 14 pid: 6526 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785056.620427:0:6549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001797b102 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1876725548982400:0@lo:104: 00000100:00100000:1.0:1789785056.620471:0:6549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789785056.620549:0:6549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b4d185dc/0x2f18ee3fd845be76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845be6f expref: 14 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785056.620560:0:7463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d4eb7e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:7463:1876725548982272:0@lo:253: 00010000:00010000:1.0:1789785056.620570:0:6549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b4d185dc/0x2f18ee3fd845be76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845be6f expref: 14 pid: 6527 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785056.620572:0:7463:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789785056.620575:0:7463:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789785056.620577:0:7463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789785056.620578:0:7463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000100:00100000:1.0:1789785056.620578:0:6549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009f0ecf15 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1876725548982528:0@lo:104: 00000020:01000004:3.0:1789785056.620579:0:7463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789785056.620581:0:7463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789785056.620582:0:7463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789785056.620588:0:7463:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789785056.620589:0:7463:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789785056.620591:0:7463:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789785056.620592:0:7463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789785056.620593:0:7463:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1789785056.620600:0:6549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:02000000:3.0:1789785056.620609:0:7463:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789785056.620665:0:6549:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b384bc3c going to sleep for 11 seconds 00000100:00100000:0.0:1789785056.621079:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548982400 00000100:00100000:0.0:1789785056.621087:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548982400 00000100:00100000:2.0:1789785056.621099:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548982528 00000100:00100000:2.0:1789785056.621102:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548982528 00000100:00100000:2.0:1789785056.621122:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789785056.621129:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000745efe99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+4:6549:x1876725548982400:12345-0@lo:104: 00010000:00010000:2.0:1789785056.621142:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: 0000000073911879/0x2f18ee3fd845bf10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845bf1e expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.621208:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789785056.621213:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000745efe99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+4:6549:x1876725548982400:12345-0@lo:104: Request processed in 85us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785056.621220:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789785056.621226:0:6549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001797b102 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1876725548982400:0@lo:104: 00000100:00100000:2.0:1789785056.621235:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789785056.621241:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025d6d354 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+3:6549:x1876725548982528:12345-0@lo:104: 00010000:00010000:2.0:1789785056.621247:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: 0000000075f8b095/0x2f18ee3fd845be6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845be76 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.621286:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789785056.621290:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025d6d354 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+3:6549:x1876725548982528:12345-0@lo:104: Request processed in 51us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785056.621311:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789785056.621327:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789785056.621332:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: 0000000073911879/0x2f18ee3fd845bf10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845bf1e expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.621353:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000073911879 already unused, calling callback (000000006d49e52c) 10000000:00010000:2.0:1789785056.621356:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: 0000000073911879/0x2f18ee3fd845bf10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845bf1e expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785056.621359:0:6549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009f0ecf15 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1876725548982528:0@lo:104: 00010000:00010000:2.0:1789785056.621364:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: 0000000073911879/0x2f18ee3fd845bf10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845bf1e expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789785056.621369:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: 0000000073911879/0x2f18ee3fd845bf10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845bf1e expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785056.621374:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789785056.621375:0:6549:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008706ac52/0x2f18ee3fd845bf56 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.621399:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: 0000000073911879/0x2f18ee3fd845bf10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bf1e expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.621416:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789785056.621437:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: 0000000073911879/0x2f18ee3fd845bf10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bf1e expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.621444:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: 0000000073911879/0x2f18ee3fd845bf10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bf1e expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.621453:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789785056.621455:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: 0000000075f8b095/0x2f18ee3fd845be6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845be76 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785056.621455:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cdafc426 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725548982656:0@lo:103: 00010000:00010000:2.0:1789785056.621470:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000075f8b095 already unused, calling callback (000000006d49e52c) 10000000:00010000:2.0:1789785056.621472:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: 0000000075f8b095/0x2f18ee3fd845be6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845be76 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.621478:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: 0000000075f8b095/0x2f18ee3fd845be6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845be76 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785056.621481:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1789785056.621483:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: 0000000075f8b095/0x2f18ee3fd845be6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845be76 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785056.621488:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789785056.621500:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: 0000000075f8b095/0x2f18ee3fd845be6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845be76 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.621505:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789785056.621517:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: 0000000075f8b095/0x2f18ee3fd845be6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845be76 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785056.621518:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014751f26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725548982784:0@lo:103: 00010000:00010000:2.0:1789785056.621523:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: 0000000075f8b095/0x2f18ee3fd845be6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845be76 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785056.621535:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785056.621536:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785056.621538:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785056.621540:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789785056.621543:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785056.621556:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548982656 00000100:00100000:2.0:1789785056.621559:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548982656 00010000:00010000:2.0:1789785056.621574:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000079060d72/0x2f18ee3fd845bf1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf10 expref: 15 pid: 6526 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785056.621612:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548982784 00000100:00100000:2.0:1789785056.621616:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548982784 00010000:00010000:2.0:1789785056.621627:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b4d185dc/0x2f18ee3fd845be76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845be6f expref: 16 pid: 6527 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785056.621634:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789785056.621640:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f0ecf15 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e00759f-51ad-47f9-8892-382c83919083+16:3660:x1876725548982656:12345-0@lo:103: 00000100:00100000:2.0:1789785056.621644:0:6519:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789785056.621649:0:6519:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1789785056.621650:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785056.621655:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000079060d72/0x2f18ee3fd845bf1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf10 expref: 16 pid: 6526 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.621664:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000079060d72/0x2f18ee3fd845bf1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf10 expref: 16 pid: 6526 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.621676:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000079060d72/0x2f18ee3fd845bf1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845bf10 expref: 16 pid: 6526 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.621698:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785056.621736:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f0ecf15 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e00759f-51ad-47f9-8892-382c83919083+15:3660:x1876725548982656:12345-0@lo:103: Request processed in 96us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785056.621742:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789785056.621765:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789785056.621771:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b5476f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e00759f-51ad-47f9-8892-382c83919083+14:3661:x1876725548982784:12345-0@lo:103: 00010000:00010000:1.0:1789785056.621778:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785056.621781:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b4d185dc/0x2f18ee3fd845be76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845be6f expref: 14 pid: 6527 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.621788:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b4d185dc/0x2f18ee3fd845be76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845be6f expref: 14 pid: 6527 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.621796:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b4d185dc/0x2f18ee3fd845be76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845be6f expref: 14 pid: 6527 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.621806:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008706ac52/0x2f18ee3fd845bf56 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.621813:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008706ac52/0x2f18ee3fd845bf56 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789785056.621824:0:6518:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004777175s 00010000:00010000:1.0:1789785056.621828:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008706ac52/0x2f18ee3fd845bf56 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.621844:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008706ac52/0x2f18ee3fd845bf56 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.621859:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008706ac52/0x2f18ee3fd845bf56 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.621863:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008706ac52/0x2f18ee3fd845bf56 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.621988:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008706ac52 already unused, calling callback (00000000113dcc6a) 00010000:00010000:1.0:1789785056.621991:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008706ac52/0x2f18ee3fd845bf56 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.621997:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008706ac52/0x2f18ee3fd845bf56 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.622009:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008706ac52/0x2f18ee3fd845bf56 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.622018:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785056.622041:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b5476f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e00759f-51ad-47f9-8892-382c83919083+13:3661:x1876725548982784:12345-0@lo:103: Request processed in 271us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785056.622047:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789785056.622094:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014751f26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725548982784:0@lo:103: 00010000:00010000:1.0:1789785056.622109:0:6549:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008706ac52/0x2f18ee3fd845bf56 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.622115:0:6549:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008706ac52/0x2f18ee3fd845bf56 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785056.622135:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008706ac52/0x2f18ee3fd845bf56 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785056.622760:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cdafc426 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725548982656:0@lo:103: 00080000:10000000:2.0:1789785056.634454:0:7463:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1789785056.634652:0:7463:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789785056.635393:0:7463:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1789785056.635592:0:7463:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789785056.636392:0:7463:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1789785056.636579:0:7463:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1789785056.648215:0:7463:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1789785056.656621:0:7463:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1789785056.658110:0:7463:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1789785056.658935:0:7463:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1789785056.659158:0:7463:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1789785056.659370:0:7463:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:1.0:1789785056.663766:0:7463:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:1.0:1789785056.666702:0:7488:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:1.0:1789785056.666765:0:7488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e822af07 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7488:1876725548982912:0@lo:700: 00000100:00100000:1.0:1789785056.666849:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785056.666895:0:7488:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b9219a0d going to sleep for 11 seconds 00000040:01000000:2.0:1789785056.666995:0:7463:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1789785056.667213:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548982912 00000100:00100000:0.0:1789785056.667221:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548982912 00000100:00100000:0.0:1789785056.667275:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789785056.667283:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000370dd5f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7488:x1876725548982912:12345-0@lo:700: 00000100:00100000:0.0:1789785056.667808:0:7489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d9ea88a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7489:1876725548983040:0@lo:1000: 00000100:00100000:0.0:1789785056.667873:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785056.667909:0:7489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d03ce31c going to sleep for 11 seconds 00000100:00100000:1.0:1789785056.668004:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548983040 00000100:00100000:1.0:1789785056.668010:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548983040 00000100:00100000:1.0:1789785056.668050:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789785056.668057:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000094d3dea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7489:x1876725548983040:12345-0@lo:1000: 00000100:00100000:1.0:1789785056.668130:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000094d3dea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7489:x1876725548983040:12345-0@lo:1000: Request processed in 74us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785056.668137:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:01000000:2.0:1789785056.668661:0:7463:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1789785056.668774:0:7463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789785056.670180:0:7489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d9ea88a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7489:1876725548983040:0@lo:1000: 00000040:01000000:0.0:1789785056.670222:0:7489:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1789785056.670272:0:7489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d9ea88a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7489:1876725548983168:0@lo:700: 00000100:00100000:0.0:1789785056.670321:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785056.670389:0:7489:0:(client.c:2715:ptlrpc_set_wait()) set 000000007ff341f8 going to sleep for 11 seconds 00000004:00000080:2.0:1789785056.674011:0:7463:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:2.0:1789785056.674062:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548983168 00000100:00100000:2.0:1789785056.674073:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548983168 00000100:00100000:2.0:1789785056.674170:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789785056.674180:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c1e24ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7489:x1876725548983168:12345-0@lo:700: 00000100:00100000:2.0:1789785056.674292:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c1e24ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7489:x1876725548983168:12345-0@lo:700: Request processed in 115us (3970us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785056.674301:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:2.0:1789785056.674352:0:7463:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1789785056.674618:0:7463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789785056.675627:0:7463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000020:00080000:3.0:1789785056.676498:0:7487:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1789785056.676504:0:7487:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:3.0:1789785056.677181:0:7489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d9ea88a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7489:1876725548983168:0@lo:700: 00000100:00100000:3.0:1789785056.677284:0:7489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d4eb7e8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7489:1876725548983296:0@lo:900: 00000100:00100000:3.0:1789785056.677365:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785056.677416:0:7489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e8b9f061 going to sleep for 11 seconds 00000100:00100000:1.0:1789785056.677706:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548983296 00000100:00100000:1.0:1789785056.677713:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548983296 00000100:00100000:1.0:1789785056.677757:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789785056.677764:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a39cd16f pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7489:x1876725548983296:12345-0@lo:900: 00000100:00100000:1.0:1789785056.677824:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a39cd16f pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7489:x1876725548983296:12345-0@lo:900: Request processed in 61us (460us total) trans 0 rc 0/0 00010000:00080000:3.0:1789785056.677933:0:7489:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003d4eb7e8 x1876725548983296/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789785072 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785056.677944:0:7489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d4eb7e8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7489:1876725548983296:0@lo:900: 00000100:00100000:3.0:1789785056.678036:0:7489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d4eb7e8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7489:1876725548983424:0@lo:1000: 00000100:00100000:3.0:1789785056.678075:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785056.678099:0:7489:0:(client.c:2715:ptlrpc_set_wait()) set 0000000047e42c22 going to sleep for 11 seconds 00000100:00100000:1.0:1789785056.678517:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789785056.678558:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548983424 00000100:00100000:1.0:1789785056.678563:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548983424 00000100:00100000:1.0:1789785056.678598:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789785056.678605:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eede151c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7489:x1876725548983424:12345-0@lo:1000: 00000100:00100000:1.0:1789785056.678682:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eede151c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7489:x1876725548983424:12345-0@lo:1000: Request processed in 77us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785056.678688:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789785056.678952:0:7489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d4eb7e8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7489:1876725548983424:0@lo:1000: 00000004:00080000:3.0:1789785056.679005:0:7489:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000e8b9f061 with version 0 00000020:00100000:3.0:1789785056.679022:0:7489:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789785056.679027:0:7489:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000003d4eb7e8 x1876725548983680/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789785056.679041:0:7489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d4eb7e8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7489:1876725548983680:0@lo:1000: 00000100:00100000:3.0:1789785056.679069:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785056.679093:0:7489:0:(client.c:2715:ptlrpc_set_wait()) set 000000002021ca9e going to sleep for 11 seconds 00000040:00080000:2.0:1789785056.679230:0:7463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789785056.679496:0:7463:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1789785056.679709:0:7463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789785056.680126:0:7463:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:1.0:1789785056.680426:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548983680 00000100:00100000:1.0:1789785056.680434:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548983680 00000100:00100000:1.0:1789785056.680482:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789785056.680490:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4e5ab55 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7489:x1876725548983680:12345-0@lo:1000: 00100000:10000000:2.0:1789785056.681668:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1789785056.681790:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1789785056.681946:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1789785056.682079:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1789785056.682237:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1789785056.682465:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1789785056.682613:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1789785056.682745:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1789785056.682889:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1789785056.683011:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1789785056.683140:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 40000000:02000000:0.0:1789785056.686462:0:6540:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:2.0:1789785056.687097:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1789785056.688046:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1789785056.688248:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1789785056.689112:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00000001:00080000:1.0:1789785056.689507:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:3.0:1789785056.689657:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4e5ab55 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7489:x1876725548983680:12345-0@lo:1000: Request processed in 9165us (10584us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789785056.689677:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1789785056.689766:0:7489:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1789785056.689771:0:7489:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789785056.689787:0:7489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d4eb7e8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7489:1876725548983680:0@lo:1000: 00000100:00100000:1.0:1789785056.689878:0:7489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009f0ecf15 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7489:1876725548983808:0@lo:1000: 00000100:00100000:1.0:1789785056.689914:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785056.689952:0:7489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000381aa83c going to sleep for 11 seconds 00000100:00100000:3.0:1789785056.690066:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548983808 00000100:00100000:3.0:1789785056.690072:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548983808 00000100:00100000:3.0:1789785056.690107:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789785056.690115:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001797b102 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7489:x1876725548983808:12345-0@lo:1000: 00000100:00100000:3.0:1789785056.690182:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001797b102 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7489:x1876725548983808:12345-0@lo:1000: Request processed in 68us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785056.690188:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789785056.690307:0:7489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009f0ecf15 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7489:1876725548983808:0@lo:1000: 00000040:00080000:1.0:1789785056.690323:0:7489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1789785056.690375:0:7489:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000003a7bc92b with version 1 00000004:00080000:3.0:1789785056.692364:0:7478:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000c2b7070b version 1 rpc_version 1 00000020:00100000:3.0:1789785056.692407:0:7478:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789785056.692417:0:7478:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000e2cf6a65 x1876725548984064/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789785056.692440:0:7478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2cf6a65 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7478:1876725548984064:0@lo:1000: 00000100:00100000:3.0:1789785056.692504:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785056.692539:0:7478:0:(client.c:2715:ptlrpc_set_wait()) set 000000005729d55c going to sleep for 11 seconds 00000100:00100000:3.0:1789785056.692563:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548984064 00000100:00100000:3.0:1789785056.692569:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548984064 00000100:00100000:3.0:1789785056.692610:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789785056.692617:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087dd5284 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7478:x1876725548984064:12345-0@lo:1000: 00000040:00080000:1.0:1789785056.693733:0:7489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789785056.693812:0:7489:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:2.0:1789785056.693989:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1789785056.694553:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1789785056.694659:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789785056.695668:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789785056.696034:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789785056.696199:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789785056.697137:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1789785056.699045:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1789785056.699503:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1789785056.699648:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1789785056.699782:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789785056.701016:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789785056.701177:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1789785056.701973:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789785056.702097:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00000100:00100000:0.0:1789785056.702874:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000370dd5f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7488:x1876725548982912:12345-0@lo:700: Request processed in 35588us (36021us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785056.702886:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789785056.702941:0:7488:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e822af07 x1876725548982912/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789785072 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785056.702958:0:7488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e822af07 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7488:1876725548982912:0@lo:700: 40000000:02000000:1.0:1789785056.702971:0:7488:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:2.0:1789785056.705238:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789785056.707082:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789785056.710037:0:7463:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1789785056.716401:0:7463:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789785056.716440:0:7463:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa9f301c87988 00100000:10000000:3.0:1789785056.716449:0:7463:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1789785056.718203:0:7463:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789785056.718242:0:7463:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.146@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789785056.718273:0:7463:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789785056.718288:0:7463:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1789785056.719032:0:7463:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789785056.719228:0:7463:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:0.0:1789785056.746087:0:7488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1789785056.758589:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000040:00080000:0.0:1789785056.759068:0:7488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789785056.759139:0:7488:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789785056.759143:0:7488:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000100:00100000:3.0:1789785056.766022:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087dd5284 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7478:x1876725548984064:12345-0@lo:1000: Request processed in 73397us (73511us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789785056.766036:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1789785056.766103:0:7478:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1789785056.766107:0:7478:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789785056.766123:0:7478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2cf6a65 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7478:1876725548984064:0@lo:1000: 00010000:00010000:2.0:1789785057.282718:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785058.306938:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785059.331577:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785060.354934:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785061.378546:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789785061.437801:0:7734:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789785061.710083:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e822af07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725548984192:0@lo:400: 00000100:00100000:1.0:1789785061.710164:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785061.710213:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789785061.710219:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004634402f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725548984576:0@lo:400: 00000100:00100000:1.0:1789785061.710246:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785061.710280:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009f0ecf15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725548984320:0@lo:400: 00000100:00100000:1.0:1789785061.710303:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785061.710318:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789785061.710323:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000800ec3a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725548984448:0@lo:400: 00000100:00100000:1.0:1789785061.710368:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785061.710395:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548984192 00000100:00100000:1.0:1789785061.710401:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548984192 00000100:00100000:1.0:1789785061.710440:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789785061.710447:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccfb24ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+13:3662:x1876725548984192:12345-0@lo:400: 00000100:00100000:1.0:1789785061.710491:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccfb24ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+13:3662:x1876725548984192:12345-0@lo:400: Request processed in 45us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785061.710561:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789785061.710593:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548984576 00000100:00100000:1.0:1789785061.710596:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548984576 00000100:00100000:1.0:1789785061.710617:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548984320 00000100:00100000:1.0:1789785061.710620:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548984320 00000100:00100000:1.0:1789785061.710632:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789785061.710637:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7c5eaf5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725548984576:12345-0@lo:400: 00000100:00100000:1.0:1789785061.710677:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7c5eaf5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725548984576:12345-0@lo:400: Request processed in 39us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785061.710683:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789785061.710696:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789785061.710701:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087871e85 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725548984320:12345-0@lo:400: 00000100:00100000:1.0:1789785061.710727:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087871e85 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725548984320:12345-0@lo:400: Request processed in 26us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785061.710733:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789785061.710751:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548984448 00000100:00100000:1.0:1789785061.710755:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548984448 00000100:00100000:1.0:1789785061.710776:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789785061.710782:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d9fbf43 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725548984448:12345-0@lo:400: 00000100:00100000:1.0:1789785061.710814:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d9fbf43 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725548984448:12345-0@lo:400: Request processed in 32us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785061.710820:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789785061.711157:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000004634402f x1876725548984576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785061.711170:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004634402f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725548984576:0@lo:400: 00000100:00100000:1.0:1789785061.711180:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e822af07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725548984192:0@lo:400: 00000100:00100000:1.0:1789785061.711210:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000800ec3a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725548984448:0@lo:400: 00010000:00080000:1.0:1789785061.711218:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000009f0ecf15 x1876725548984320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785061.711226:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009f0ecf15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725548984320:0@lo:400: 00000100:00100000:3.0:1789785061.711308:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009f0ecf15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725548984704:0@lo:41: 00000100:00100000:3.0:1789785061.711356:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785061.711681:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548984704 00000100:00100000:1.0:1789785061.711694:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548984704 00000100:00100000:1.0:1789785061.711739:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789785061.711745:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2cf6a65 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725548984704:12345-0@lo:41: 00000004:00000024:1.0:1789785061.711771:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1789785061.718330:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2cf6a65 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725548984704:12345-0@lo:41: Request processed in 6577us (6985us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785061.718362:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789785061.724912:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009f0ecf15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725548984704:0@lo:41: 00000020:00000004:0.0:1789785062.369009:0:7786:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789785062.369254:0:7786:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789785062.402581:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785063.426543:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785064.451945:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789785065.252547:0:7887:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789785065.252728:0:7887:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1789785065.283494:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789785065.283505:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dafc189c800 from 4 10000000:01000000:2.0:1789785065.283511:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789785065.283570:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 000000006c129ea8/0x2f18ee3fd845bf5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785065.283586:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 000000006c129ea8/0x2f18ee3fd845bf5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785065.283599:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 000000006c129ea8/0x2f18ee3fd845bf5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785065.283629:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cdafc426 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548984832:0@lo:101: 00000100:00100000:2.0:1789785065.283715:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785065.284364:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e847147b going to sleep for 11 seconds 00000100:00100000:1.0:1789785065.286902:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548984832 00000100:00100000:1.0:1789785065.286931:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548984832 00000100:00100000:1.0:1789785065.290154:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789785065.290186:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003de4dba1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+13:6531:x1876725548984832:12345-0@lo:101: 00010000:00010000:1.0:1789785065.290213:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785065.290240:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000217b4880/0x2f18ee3fd845bf64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845bf5d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785065.290281:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000217b4880/0x2f18ee3fd845bf64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845bf5d expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785065.290294:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000217b4880/0x2f18ee3fd845bf64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bf5d expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785065.290304:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000217b4880, rc 0) 00000100:00100000:1.0:1789785065.290518:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003de4dba1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+14:6531:x1876725548984832:12345-0@lo:101: Request processed in 348us (6803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785065.290525:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789785065.290699:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cdafc426 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548984832:0@lo:101: 00010000:00010000:0.0:1789785065.290723:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 000000006c129ea8/0x2f18ee3fd845bf5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bf64 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785065.290733:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 000000006c129ea8/0x2f18ee3fd845bf5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845bf64 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785065.290824:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000016482f7c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548984960:0@lo:256: 00000100:00100000:0.0:1789785065.290869:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785065.298236:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set 0000000064c59f92 going to sleep for 11 seconds 00000100:00100000:2.0:1789785065.302715:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548984960 00000100:00100000:2.0:1789785065.302739:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548984960 00000100:00100000:2.0:1789785065.302822:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789785065.302833:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000277ea708 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+14:6531:x1876725548984960:12345-0@lo:256: 20000000:01000000:2.0:1789785065.302868:0:6527:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789785065.302895:0:6527:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789785065.302899:0:6527:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1789785065.303079:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000277ea708 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+14:6531:x1876725548984960:12345-0@lo:256: Request processed in 248us (12209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785065.303099:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789785065.303298:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000016482f7c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548984960:0@lo:256: 10000000:01000000:3.0:1789785065.303396:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789785065.303409:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 000000006c129ea8/0x2f18ee3fd845bf5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bf64 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785065.303421:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: 000000006c129ea8/0x2f18ee3fd845bf5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bf64 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785065.303433:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789785065.303436:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9daf89061800 from 21 10000000:01000000:3.0:1789785065.303440:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789785065.303481:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 000000008205946a/0x2f18ee3fd845bf6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785065.303489:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 000000008205946a/0x2f18ee3fd845bf6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785065.303499:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 000000008205946a/0x2f18ee3fd845bf6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785065.303534:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000072266edd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548985088:0@lo:101: 00000100:00100000:3.0:1789785065.303588:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785065.304379:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set 000000005a9c9972 going to sleep for 11 seconds 00000100:00100000:1.0:1789785065.309496:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548985088 00000100:00100000:1.0:1789785065.309519:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548985088 00000100:00100000:1.0:1789785065.309608:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789785065.309617:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f64ba49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+14:6531:x1876725548985088:12345-0@lo:101: 00010000:00010000:1.0:1789785065.309640:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785065.309661:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000018f5a7cb/0x2f18ee3fd845bf72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845bf6b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785065.309695:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000018f5a7cb/0x2f18ee3fd845bf72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845bf6b expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785065.309707:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000018f5a7cb/0x2f18ee3fd845bf72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bf6b expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785065.309717:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000018f5a7cb, rc 0) 00000100:00100000:1.0:1789785065.309815:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f64ba49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:6531:x1876725548985088:12345-0@lo:101: Request processed in 199us (6228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785065.309822:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789785065.310002:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000072266edd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548985088:0@lo:101: 00010000:00010000:1.0:1789785065.310023:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 000000008205946a/0x2f18ee3fd845bf6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bf72 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785065.310033:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 000000008205946a/0x2f18ee3fd845bf6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845bf72 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785065.310152:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000800ec3a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548985216:0@lo:501: 00000100:00100000:1.0:1789785065.310191:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785065.310225:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set 0000000016e34af6 going to sleep for 11 seconds 00000100:00100000:1.0:1789785065.310238:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548985216 00000100:00100000:1.0:1789785065.310241:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548985216 00000100:00100000:1.0:1789785065.310265:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789785065.310279:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076ed48d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:6531:x1876725548985216:12345-0@lo:501: 00000100:00100000:1.0:1789785065.311287:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076ed48d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:6531:x1876725548985216:12345-0@lo:501: Request processed in 1002us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785065.311299:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789785065.311630:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000800ec3a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548985216:0@lo:501: 00000100:00100000:1.0:1789785065.311692:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000800ec3a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548985344:0@lo:503: 00000100:00100000:1.0:1789785065.311742:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785065.311777:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set 0000000016e34af6 going to sleep for 11 seconds 00000100:00100000:2.0:1789785065.312238:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548985344 00000100:00100000:2.0:1789785065.312248:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548985344 00000100:00100000:2.0:1789785065.312308:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789785065.312317:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000af389d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:6531:x1876725548985344:12345-0@lo:503: 00000100:00100000:2.0:1789785065.312475:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000af389d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:6531:x1876725548985344:12345-0@lo:503: Request processed in 160us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785065.312483:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789785065.313642:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000800ec3a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548985344:0@lo:503: 00000100:00100000:1.0:1789785065.317715:0:7890:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000800ec3a pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:7890:1876725548985472:0@lo:502: 00000100:00100000:1.0:1789785065.317845:0:7890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785065.317896:0:7890:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087c99356 going to sleep for 11 seconds 00000100:00100000:2.0:1789785065.318055:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548985472 00000100:00100000:2.0:1789785065.318065:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548985472 00000100:00100000:2.0:1789785065.322688:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789785065.322709:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000114ba2ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:7890:x1876725548985472:12345-0@lo:502: 00000100:00100000:2.0:1789785065.323225:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000114ba2ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:7890:x1876725548985472:12345-0@lo:502: Request processed in 523us (5379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785065.323235:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789785065.323403:0:7890:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000800ec3a pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:7890:1876725548985472:0@lo:502: 00000100:00100000:3.0:1789785065.323491:0:7890:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de63fdab pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:7890:1876725548985600:0@lo:502: 00000100:00100000:3.0:1789785065.323541:0:7890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785065.323577:0:7890:0:(client.c:2715:ptlrpc_set_wait()) set 0000000055bd99c4 going to sleep for 11 seconds 00000100:00100000:2.0:1789785065.323632:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548985600 00000100:00100000:2.0:1789785065.323640:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548985600 00000100:00100000:2.0:1789785065.323681:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789785065.323687:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000201b427d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+15:7890:x1876725548985600:12345-0@lo:502: 00000100:00100000:2.0:1789785065.323773:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000201b427d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+15:7890:x1876725548985600:12345-0@lo:502: Request processed in 86us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785065.323779:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789785065.323955:0:7890:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de63fdab pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:7890:1876725548985600:0@lo:502: 00000040:00080000:3.0:1789785065.323980:0:7890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1789785065.324241:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1789785065.324267:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789785065.324277:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 000000008205946a/0x2f18ee3fd845bf6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bf72 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785065.324290:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: 000000008205946a/0x2f18ee3fd845bf6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bf72 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785065.324302:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789785065.324305:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9daf89061800 from 4 10000000:01000000:2.0:1789785065.324308:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789785065.324365:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 00000000b2bae5c6/0x2f18ee3fd845bf79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785065.324372:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 00000000b2bae5c6/0x2f18ee3fd845bf79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785065.324380:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 00000000b2bae5c6/0x2f18ee3fd845bf79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785065.324396:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c52141d8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548985728:0@lo:101: 00000100:00100000:2.0:1789785065.324429:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785065.324448:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set 00000000186b9ac6 going to sleep for 11 seconds 00000100:00100000:0.0:1789785065.325268:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548985728 00000100:00100000:0.0:1789785065.325277:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548985728 00000100:00100000:0.0:1789785065.325323:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789785065.325332:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f6ef942 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+15:6531:x1876725548985728:12345-0@lo:101: 00010000:00010000:0.0:1789785065.325362:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785065.325379:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bccb3359/0x2f18ee3fd845bf80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845bf79 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785065.326981:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bccb3359/0x2f18ee3fd845bf80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845bf79 expref: 16 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785065.326997:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bccb3359/0x2f18ee3fd845bf80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bf79 expref: 16 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785065.327007:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bccb3359, rc 0) 00000100:00100000:0.0:1789785065.327203:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f6ef942 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+16:6531:x1876725548985728:12345-0@lo:101: Request processed in 1871us (2771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785065.327213:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789785065.328212:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c52141d8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548985728:0@lo:101: 00010000:00010000:2.0:1789785065.328246:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 00000000b2bae5c6/0x2f18ee3fd845bf79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bf80 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785065.328284:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 00000000b2bae5c6/0x2f18ee3fd845bf79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845bf80 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785065.328389:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c52141d8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548985856:0@lo:256: 00000100:00100000:2.0:1789785065.328460:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785065.328518:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set 00000000186b9ac6 going to sleep for 11 seconds 00000100:00100000:0.0:1789785065.328563:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548985856 00000100:00100000:0.0:1789785065.328574:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548985856 00000100:00100000:0.0:1789785065.328633:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789785065.328643:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c02c481 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+16:6531:x1876725548985856:12345-0@lo:256: 20000000:01000000:0.0:1789785065.328669:0:6526:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789785065.328690:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789785065.328698:0:6526:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789785065.328814:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c02c481 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+16:6531:x1876725548985856:12345-0@lo:256: Request processed in 173us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785065.328823:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789785065.328971:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c52141d8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548985856:0@lo:256: 10000000:01000000:2.0:1789785065.329036:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789785065.329044:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 00000000b2bae5c6/0x2f18ee3fd845bf79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bf80 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785065.329053:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: 00000000b2bae5c6/0x2f18ee3fd845bf79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bf80 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785065.329063:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789785065.329065:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1789785065.329068:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789785065.329104:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 00000000a6154e20/0x2f18ee3fd845bf87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785065.329111:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 00000000a6154e20/0x2f18ee3fd845bf87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785065.329120:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 00000000a6154e20/0x2f18ee3fd845bf87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785065.329135:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c52141d8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548985984:0@lo:101: 00000100:00100000:2.0:1789785065.329171:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785065.329193:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fc5abb63 going to sleep for 11 seconds 00000100:00100000:0.0:1789785065.329556:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548985984 00000100:00100000:0.0:1789785065.329561:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548985984 00000100:00100000:0.0:1789785065.329590:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789785065.329596:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036d9d797 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+16:6531:x1876725548985984:12345-0@lo:101: 00010000:00010000:0.0:1789785065.329607:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785065.329621:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000009b7cb16/0x2f18ee3fd845bf8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845bf87 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785065.329643:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000009b7cb16/0x2f18ee3fd845bf8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845bf87 expref: 17 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785065.329654:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000009b7cb16/0x2f18ee3fd845bf8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bf87 expref: 17 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785065.329663:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000009b7cb16, rc 0) 00000100:00100000:0.0:1789785065.329709:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036d9d797 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725548985984:12345-0@lo:101: Request processed in 113us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785065.329715:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789785065.329785:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c52141d8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548985984:0@lo:101: 00010000:00010000:1.0:1789785065.329871:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 00000000a6154e20/0x2f18ee3fd845bf87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bf8e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785065.329882:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 00000000a6154e20/0x2f18ee3fd845bf87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845bf8e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785065.329952:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e822af07 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548986112:0@lo:501: 00000100:00100000:1.0:1789785065.329984:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785065.330015:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb5e8338 going to sleep for 11 seconds 00000100:00100000:0.0:1789785065.330721:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548986112 00000100:00100000:0.0:1789785065.330729:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548986112 00000100:00100000:0.0:1789785065.330770:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789785065.330778:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7f07ffe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725548986112:12345-0@lo:501: 00000100:00100000:0.0:1789785065.331356:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7f07ffe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725548986112:12345-0@lo:501: Request processed in 577us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785065.331365:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789785065.331669:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e822af07 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548986112:0@lo:501: 00000100:00100000:0.0:1789785065.331734:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a90e7d82 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548986240:0@lo:503: 00000100:00100000:0.0:1789785065.331789:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785065.332949:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set 000000001875dfd3 going to sleep for 11 seconds 00000100:00100000:2.0:1789785065.334556:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548986240 00000100:00100000:2.0:1789785065.334575:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548986240 00000100:00100000:2.0:1789785065.334658:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789785065.334669:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c60f0d34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725548986240:12345-0@lo:503: 00000100:00100000:2.0:1789785065.334919:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c60f0d34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725548986240:12345-0@lo:503: Request processed in 252us (3129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785065.334928:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789785065.335608:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a90e7d82 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548986240:0@lo:503: 00000100:00100000:1.0:1789785065.341332:0:7891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004634402f pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:7891:1876725548986368:0@lo:502: 00000100:00100000:1.0:1789785065.342318:0:7891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785065.342452:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548986368 00000100:00100000:2.0:1789785065.342463:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548986368 00000100:00100000:2.0:1789785065.342539:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789785065.342548:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3d6d6f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+17:7891:x1876725548986368:12345-0@lo:502: 00000100:00100000:1.0:1789785065.344480:0:7891:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087c99356 going to sleep for 11 seconds 00000100:00100000:2.0:1789785065.345168:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3d6d6f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+17:7891:x1876725548986368:12345-0@lo:502: Request processed in 2614us (2849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785065.345183:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789785065.345785:0:7891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004634402f pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:7891:1876725548986368:0@lo:502: 00000020:01000000:1.0:1789785065.347021:0:7891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789785065.347042:0:7891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785065.347046:0:7891:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1789785065.347054:0:7891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789785065.347059:0:7891:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.146@tcp to nid 0x20000c0a8cb92 (192.168.203.146@tcp) 00000020:00000080:1.0:1789785065.347107:0:7891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789785065.347127:0:7891:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000d2b63aac) 00000020:00000080:1.0:1789785065.347158:0:7891:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1789785065.347167:0:7891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789785065.347309:0:7891:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1789785065.347438:0:7891:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789785065.347448:0:7891:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f18ee3fd845bf9c 00010000:00080000:1.0:1789785065.351017:0:7891:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ad6f0621@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.146@tcp at head 00010000:00010000:1.0:1789785065.353981:0:7891:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:0.0:1789785065.359030:0:7891:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789785065.359054:0:7891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789785065.359135:0:7891:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789785065.359170:0:7891:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f18ee3fd845bfa3 00000100:00080000:0.0:1789785065.359185:0:7891:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789785065.359191:0:7891:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000ad6f0621 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:0.0:1789785065.359251:0:7891:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008a8b3c6c x1876725548986496/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789785065.359285:0:7891:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:0.0:1789785065.359400:0:7891:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1789785065.360861:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000140b7b82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725548986880:0@lo:400: 00000100:00100000:0.0:1789785065.360954:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785065.360981:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000af25bf9a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725548986624:0@lo:400: 00000100:00100000:1.0:1789785065.361033:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785065.361063:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789785065.361069:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057381227 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725548986752:0@lo:400: 00000100:00100000:0.0:1789785065.361073:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548986880 00000100:00100000:0.0:1789785065.361094:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548986880 00000100:00100000:1.0:1789785065.361113:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785065.361152:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548986624 00000100:00100000:0.0:1789785065.361156:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548986624 00000100:00100000:0.0:1789785065.361176:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789785065.361185:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0666c24 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725548986880:12345-0@lo:400: 00000100:00100000:1.0:1789785065.361248:0:6533:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789785065.361250:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0666c24 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725548986880:12345-0@lo:400: Request processed in 64us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785065.361263:0:6533:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789785065.361263:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789785065.361283:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548986752 00000100:00100000:0.0:1789785065.361288:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789785065.361290:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548986752 00000100:00100000:0.0:1789785065.361296:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004634402f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725548986624:12345-0@lo:400: 00000100:00100000:1.0:1789785065.361327:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789785065.361366:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cfc5baf2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725548986752:12345-0@lo:400: 00000100:00100000:0.0:1789785065.361375:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004634402f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725548986624:12345-0@lo:400: Request processed in 80us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785065.361383:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789785065.361412:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cfc5baf2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725548986752:12345-0@lo:400: Request processed in 77us (299us total) trans 0 rc 0/0 00010000:00080000:0.0:1789785065.361429:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000140b7b82 x1876725548986880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785065.361430:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789785065.361447:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000140b7b82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725548986880:0@lo:400: 00000100:00100000:1.0:1789785065.361479:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057381227 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725548986752:0@lo:400: 00010000:00080000:1.0:1789785065.361490:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000af25bf9a x1876725548986624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785065.361500:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000af25bf9a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725548986624:0@lo:400: 00000100:00100000:2.0:1789785065.361673:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a8b3c6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725548986496:0@lo:38: 00000100:00100000:2.0:1789785065.361712:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785065.362160:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548986496 00000100:00100000:1.0:1789785065.362165:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548986496 00000100:00100000:1.0:1789785065.362197:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789785065.362202:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c52141d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3658:x1876725548986496:12345-0@lo:38: 00010000:00080000:1.0:1789785065.362231:0:6538:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:1.0:1789785065.362276:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f18ee3fd845bfaa 00000004:00100000:1.0:1789785065.362297:0:6538:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789785065.362303:0:6538:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1789785065.362917:0:7895:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000140b7b82 x1876725548987008/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785065.362929:0:7895:0:(client.c:2715:ptlrpc_set_wait()) set 000000003d2aedc9 going to sleep for 0 seconds 00000020:01000000:1.0:1789785065.363183:0:7891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785065.363192:0:7891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785065.363194:0:7891:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789785065.363199:0:7891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789785065.363203:0:7891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785065.363205:0:7891:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789785065.363208:0:7891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789785065.363209:0:7891:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789785065.363236:0:7891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a3b86482 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:7891:1876725548987136:0@lo:502: 00000100:00100000:1.0:1789785065.363315:0:7891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785065.363387:0:7891:0:(client.c:2715:ptlrpc_set_wait()) set 00000000563b7404 going to sleep for 11 seconds 00000100:00100000:2.0:1789785065.363456:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548987136 00000100:00100000:2.0:1789785065.363462:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548987136 00000100:00100000:2.0:1789785065.363507:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789785065.363515:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c176bd89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+17:7891:x1876725548987136:12345-0@lo:502: 00000100:00100000:2.0:1789785065.363642:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c176bd89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+17:7891:x1876725548987136:12345-0@lo:502: Request processed in 128us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785065.363650:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789785065.363803:0:7891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a3b86482 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:7891:1876725548987136:0@lo:502: 00000020:01000000:0.0:1789785065.363948:0:7891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785065.363955:0:7891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785065.363956:0:7891:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789785065.363960:0:7891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1789785065.371226:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1789785065.371279:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789785065.371299:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 00000000a6154e20/0x2f18ee3fd845bf87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bf8e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785065.371315:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: 00000000a6154e20/0x2f18ee3fd845bf87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bf8e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789785065.374303:0:6538:0:(import.c:65:import_set_state_nolock()) 00000000e389edcf : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789785065.374472:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c52141d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3658:x1876725548986496:12345-0@lo:38: Request processed in 12267us (12757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785065.374496:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789785065.374606:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789785065.374619:0:3658:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789785065.374630:0:3658:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789785065.374639:0:3658:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789785065.374642:0:3658:0:(import.c:65:import_set_state_nolock()) 00000000ad6f0621 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1789785065.374668:0:3658:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000003d2aedc9): req@00000000140b7b82 x1876725548987008/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785065.374693:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a8b3c6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725548986496:0@lo:38: 00000100:00100000:0.0:1789785065.376232:0:7895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785065.376310:0:7895:0:(client.c:2715:ptlrpc_set_wait()) set 000000003d2aedc9 going to sleep for 11 seconds 00000100:00100000:2.0:1789785065.376699:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548987008 00000100:00100000:2.0:1789785065.376709:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548987008 00000100:00100000:2.0:1789785065.376774:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789785065.376785:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046e9d4a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7895:x1876725548987008:12345-0@lo:1000: 00000100:00100000:2.0:1789785065.376908:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046e9d4a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7895:x1876725548987008:12345-0@lo:1000: Request processed in 125us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785065.376916:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789785065.377139:0:7895:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000140b7b82 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7895:1876725548987008:0@lo:1000: 00000040:01000000:0.0:1789785065.377188:0:7895:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789785065.377236:0:7895:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000140b7b82 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7895:1876725548987264:0@lo:1000: 00000100:00100000:0.0:1789785065.377273:0:7895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785065.377304:0:7895:0:(client.c:2715:ptlrpc_set_wait()) set 00000000381aa83c going to sleep for 11 seconds 00000100:00100000:0.0:1789785065.377370:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548987264 00000100:00100000:0.0:1789785065.377375:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548987264 00000100:00100000:0.0:1789785065.377398:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789785065.377404:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a8b3c6c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7895:x1876725548987264:12345-0@lo:1000: 00000100:00100000:0.0:1789785065.377511:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a8b3c6c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7895:x1876725548987264:12345-0@lo:1000: Request processed in 107us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785065.377526:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789785065.377554:0:7895:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000140b7b82 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7895:1876725548987264:0@lo:1000: 00000100:00100000:0.0:1789785065.377595:0:7895:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000140b7b82 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7895:1876725548987392:0@lo:700: 00000100:00100000:0.0:1789785065.377621:0:7895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785065.377636:0:7895:0:(client.c:2715:ptlrpc_set_wait()) set 000000003d2aedc9 going to sleep for 11 seconds 00000100:00100000:1.0:1789785065.377806:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789785065.377816:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000037f403b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725548987520:0@lo:41: 00000100:00100000:1.0:1789785065.377863:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785065.377889:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548987520 00000100:00100000:1.0:1789785065.377893:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548987520 00000100:00100000:1.0:1789785065.377911:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789785065.377916:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ff604f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3661:x1876725548987520:12345-0@lo:41: 00000004:00000024:1.0:1789785065.377953:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789785065.377990:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ff604f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3661:x1876725548987520:12345-0@lo:41: Request processed in 74us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785065.377997:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789785065.378041:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000037f403b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725548987520:0@lo:41: 00000100:00100000:2.0:1789785065.378249:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548987392 00000100:00100000:2.0:1789785065.378254:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548987392 00000100:00100000:2.0:1789785065.378280:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789785065.378286:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af25bf9a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7895:x1876725548987392:12345-0@lo:700: 00000100:00100000:2.0:1789785065.378332:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af25bf9a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7895:x1876725548987392:12345-0@lo:700: Request processed in 46us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785065.378372:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789785065.378467:0:7895:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000140b7b82 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7895:1876725548987392:0@lo:700: 10000000:01000000:3.0:1789785065.378567:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789785065.378573:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9daf983fcd28 from 1 10000000:01000000:3.0:1789785065.378578:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:0.0:1789785065.378590:0:7895:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000140b7b82 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7895:1876725548987648:0@lo:1000: 00010000:00010000:3.0:1789785065.378617:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 00000000c2ae53b6/0x2f18ee3fd845bfb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785065.378629:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 00000000c2ae53b6/0x2f18ee3fd845bfb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785065.378629:0:7895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789785065.378642:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 00000000c2ae53b6/0x2f18ee3fd845bfb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785065.378646:0:7895:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ec805a3c going to sleep for 11 seconds 00000100:00100000:3.0:1789785065.378658:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de63fdab pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548987776:0@lo:101: 00000100:00100000:3.0:1789785065.378704:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785065.378740:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548987776 00000100:00100000:3.0:1789785065.378744:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548987776 00000100:00100000:3.0:1789785065.378779:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789785065.378786:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000715e48d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725548987776:12345-0@lo:101: 00010000:00010000:3.0:1789785065.378804:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785065.378819:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000317b68d6/0x2f18ee3fd845bfb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845bfb1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785065.378857:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000317b68d6/0x2f18ee3fd845bfb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845bfb1 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785065.378868:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000317b68d6/0x2f18ee3fd845bfb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bfb1 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785065.378878:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000317b68d6, rc 0) 00000100:00100000:2.0:1789785065.378908:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548987648 00000100:00100000:2.0:1789785065.378913:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548987648 00000100:00100000:2.0:1789785065.378939:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789785065.378945:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057381227 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7895:x1876725548987648:12345-0@lo:1000: 00000100:00100000:2.0:1789785065.379002:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057381227 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7895:x1876725548987648:12345-0@lo:1000: Request processed in 57us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785065.379008:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789785065.379027:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000715e48d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+18:6531:x1876725548987776:12345-0@lo:101: Request processed in 123us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785065.379036:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789785065.379079:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set 0000000055bd99c4 going to sleep for 11 seconds 00000100:00100000:3.0:1789785065.379105:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de63fdab pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548987776:0@lo:101: 00010000:00010000:3.0:1789785065.379118:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 00000000c2ae53b6/0x2f18ee3fd845bfb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bfb8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785065.379128:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 00000000c2ae53b6/0x2f18ee3fd845bfb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845bfb8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785065.379285:0:7895:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000140b7b82 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7895:1876725548987648:0@lo:1000: 00000004:00080000:0.0:1789785065.379415:0:7895:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000003d2aedc9 with version 0 00000020:00100000:0.0:1789785065.379434:0:7895:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789785065.379440:0:7895:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000140b7b82 x1876725548988032/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789785065.379454:0:7895:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000140b7b82 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7895:1876725548988032:0@lo:1000: 00000100:00100000:0.0:1789785065.379483:0:7895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785065.379499:0:7895:0:(client.c:2715:ptlrpc_set_wait()) set 0000000019ae89ad going to sleep for 11 seconds 00000100:00100000:3.0:1789785065.379579:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de63fdab pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548988160:0@lo:501: 00000100:00100000:2.0:1789785065.379581:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548988032 00000100:00100000:2.0:1789785065.379588:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548988032 00000100:00100000:3.0:1789785065.379616:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785065.379622:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789785065.379631:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a90e7d82 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7895:x1876725548988032:12345-0@lo:1000: 00000100:00100000:3.0:1789785065.379647:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548988160 00000100:00100000:3.0:1789785065.379652:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548988160 00000100:00100000:3.0:1789785065.379679:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789785065.379686:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b563507 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+18:6531:x1876725548988160:12345-0@lo:501: 00000100:00100000:3.0:1789785065.379787:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b563507 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+18:6531:x1876725548988160:12345-0@lo:501: Request processed in 102us (173us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789785065.379794:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789785065.379881:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set 0000000055bd99c4 going to sleep for 11 seconds 00000100:00100000:3.0:1789785065.379896:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de63fdab pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548988160:0@lo:501: 10000000:01000000:3.0:1789785065.380003:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789785065.380010:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 00000000c2ae53b6/0x2f18ee3fd845bfb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bfb8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785065.380019:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: 00000000c2ae53b6/0x2f18ee3fd845bfb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bfb8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789785065.382613:0:7465:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1789785065.382633:0:7465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:00080000:2.0:1789785065.382937:0:7895:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1789785065.382943:0:7895:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789785065.382967:0:7895:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000140b7b82 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7895:1876725548988032:0@lo:1000: 00000100:00100000:2.0:1789785065.383114:0:7895:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cdafc426 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7895:1876725548988288:0@lo:1000: 00000100:00100000:2.0:1789785065.383263:0:7895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785065.383295:0:7895:0:(client.c:2715:ptlrpc_set_wait()) set 000000000868946b going to sleep for 11 seconds 00000100:00100000:2.0:1789785065.383323:0:6539:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1789785065.383331:0:6539:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1789785065.388407:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548988288 00000100:00100000:2.0:1789785065.388426:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548988288 00000100:00100000:0.0:1789785065.388598:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789785065.388612:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014751f26 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7895:x1876725548988288:12345-0@lo:1000: 00000100:00100000:0.0:1789785065.388796:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014751f26 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7895:x1876725548988288:12345-0@lo:1000: Request processed in 187us (5535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785065.388805:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789785065.388941:0:7895:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cdafc426 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7895:1876725548988288:0@lo:1000: 00000040:00080000:2.0:1789785065.388980:0:7895:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1789785065.389050:0:7895:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000abd85c6a with version 1 00000004:00080000:0.0:1789785065.389556:0:7893:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000f124b3ce version 1 rpc_version 1 00000020:00100000:0.0:1789785065.389593:0:7893:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789785065.389608:0:7893:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000016482f7c x1876725548988544/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789785065.389633:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000016482f7c pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7893:1876725548988544:0@lo:1000: 00000100:00100000:1.0:1789785065.389871:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a90e7d82 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7895:x1876725548988032:12345-0@lo:1000: Request processed in 10240us (10387us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789785065.389883:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000040:00080000:2.0:1789785065.395099:0:7895:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789785065.395216:0:7895:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789785065.395222:0:7895:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:1.0:1789785065.397426:0:7893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785065.397506:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set 0000000075793dc8 going to sleep for 11 seconds 00000100:00100000:3.0:1789785065.397737:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548988544 00000100:00100000:3.0:1789785065.397749:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548988544 00000100:00100000:3.0:1789785065.397829:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789785065.397841:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037f403b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7893:x1876725548988544:12345-0@lo:1000: 00000001:00080000:3.0:1789785065.404642:0:7465:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1789785065.404866:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037f403b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7893:x1876725548988544:12345-0@lo:1000: Request processed in 7021us (7445us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789785065.404884:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:1.0:1789785065.404973:0:7893:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1789785065.404981:0:7893:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789785065.405019:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000016482f7c pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7893:1876725548988544:0@lo:1000: 00010000:00010000:0.0:1789785065.474606:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789785066.380001:0:7942:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd4e5379d0 20000000:00000080:1.0:1789785066.380024:0:7942:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dafb5e30400 uarg=0000000000000000 20000000:01000000:1.0:1789785066.380085:0:7942:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789785066.380094:0:7942:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789785066.380100:0:7942:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789785066.380193:0:7942:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1789785066.380215:0:7942:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1789785066.387216:0:7942:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789785066.387571:0:7942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789785066.387613:0:7942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1789785066.387629:0:7942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1789785066.387650:0:7942:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789785066.387672:0:7942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005ddfa892/0x2f18ee3fd845bfbf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785066.387694:0:7942:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ae54f0c6/0x2f18ee3fd845be3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845be37 expref: 17 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785066.387702:0:7942:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006f19620e/0x2f18ee3fd845bf2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bf25 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785066.387708:0:7942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005ddfa892/0x2f18ee3fd845bfbf lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785066.387754:0:7942:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006f19620e/0x2f18ee3fd845bf2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845bf25 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785066.387768:0:7942:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006f19620e/0x2f18ee3fd845bf2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf25 expref: 17 pid: 6528 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785066.387783:0:7942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a3b86482 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7942:1876725548988672:0@lo:104: 00000100:00100000:1.0:1789785066.387866:0:7942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789785066.387957:0:7942:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ae54f0c6/0x2f18ee3fd845be3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845be37 expref: 17 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785066.387965:0:7942:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ae54f0c6/0x2f18ee3fd845be3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845be37 expref: 17 pid: 6527 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785066.387983:0:7942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e822af07 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7942:1876725548988800:0@lo:104: 00000100:00100000:1.0:1789785066.388013:0:7942:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a76e779d going to sleep for 11 seconds 00000100:00100000:2.0:1789785066.388034:0:6517:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789785066.388055:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785066.388093:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548988672 00000100:00100000:2.0:1789785066.388102:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548988672 00000100:00100000:2.0:1789785066.388159:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548988800 00000100:00100000:2.0:1789785066.388163:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548988800 00000100:00100000:2.0:1789785066.388180:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789785066.388188:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b639c09a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+4:7942:x1876725548988672:12345-0@lo:104: 00010000:00010000:2.0:1789785066.388202:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: 00000000d11f2999/0x2f18ee3fd845bf25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845bf2c expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.388272:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789785066.388277:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b639c09a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+4:7942:x1876725548988672:12345-0@lo:104: Request processed in 90us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785066.388917:0:7942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a3b86482 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7942:1876725548988672:0@lo:104: 00000100:00100000:2.0:1789785066.389605:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789785066.389671:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789785066.389686:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdafc426 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+3:7942:x1876725548988800:12345-0@lo:104: 00010000:00010000:2.0:1789785066.389702:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: 0000000061bc5aa8/0x2f18ee3fd845be37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845be3e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.389850:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789785066.389856:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdafc426 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+3:7942:x1876725548988800:12345-0@lo:104: Request processed in 178us (1801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785066.389875:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1789785066.389898:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789785066.389905:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: 00000000d11f2999/0x2f18ee3fd845bf25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845bf2c expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.389913:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d11f2999 already unused, calling callback (000000006d49e52c) 10000000:00010000:2.0:1789785066.389916:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: 00000000d11f2999/0x2f18ee3fd845bf25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845bf2c expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.389926:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: 00000000d11f2999/0x2f18ee3fd845bf25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845bf2c expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789785066.389932:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: 00000000d11f2999/0x2f18ee3fd845bf25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845bf2c expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785066.389938:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789785066.389984:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: 00000000d11f2999/0x2f18ee3fd845bf25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bf2c expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.389990:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789785066.390018:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: 00000000d11f2999/0x2f18ee3fd845bf25 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bf2c expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.390024:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: 00000000d11f2999/0x2f18ee3fd845bf25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bf2c expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.390035:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789785066.390037:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: 0000000061bc5aa8/0x2f18ee3fd845be37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845be3e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.390052:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000061bc5aa8 already unused, calling callback (000000006d49e52c) 10000000:00010000:2.0:1789785066.390054:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: 0000000061bc5aa8/0x2f18ee3fd845be37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845be3e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.390059:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: 0000000061bc5aa8/0x2f18ee3fd845be37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845be3e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789785066.390064:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: 0000000061bc5aa8/0x2f18ee3fd845be37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845be3e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785066.390068:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789785066.390097:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: 0000000061bc5aa8/0x2f18ee3fd845be37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845be3e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.390104:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789785066.390109:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: 0000000061bc5aa8/0x2f18ee3fd845be37 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845be3e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.390114:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: 0000000061bc5aa8/0x2f18ee3fd845be37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845be3e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.390128:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785066.390129:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785066.390131:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785066.390146:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a8447b1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725548988928:0@lo:103: 00000100:00100000:2.0:1789785066.390186:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785066.390226:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789785066.390232:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000062766994 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725548989056:0@lo:103: 00000100:00100000:2.0:1789785066.390266:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785066.390302:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548988928 00000100:00100000:2.0:1789785066.390309:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548988928 00010000:00010000:2.0:1789785066.390332:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006f19620e/0x2f18ee3fd845bf2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf25 expref: 18 pid: 6528 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785066.390385:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548989056 00000100:00100000:2.0:1789785066.390389:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548989056 00010000:00010000:2.0:1789785066.390401:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ae54f0c6/0x2f18ee3fd845be3e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845be37 expref: 19 pid: 6527 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785066.390420:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789785066.390426:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd809c5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+19:3659:x1876725548988928:12345-0@lo:103: 00010000:00010000:2.0:1789785066.390438:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785066.390444:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006f19620e/0x2f18ee3fd845bf2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf25 expref: 19 pid: 6528 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.390456:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006f19620e/0x2f18ee3fd845bf2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf25 expref: 19 pid: 6528 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.390688:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006f19620e/0x2f18ee3fd845bf2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845bf25 expref: 19 pid: 6528 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.390703:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785066.390780:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd809c5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+18:3659:x1876725548988928:12345-0@lo:103: Request processed in 355us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785066.390787:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789785066.390864:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789785066.390871:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005965ee18 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+17:3659:x1876725548989056:12345-0@lo:103: 00010000:00010000:2.0:1789785066.390879:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785066.390891:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ae54f0c6/0x2f18ee3fd845be3e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845be37 expref: 17 pid: 6527 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.390900:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ae54f0c6/0x2f18ee3fd845be3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845be37 expref: 17 pid: 6527 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.390913:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005ddfa892/0x2f18ee3fd845bfbf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.390922:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005ddfa892/0x2f18ee3fd845bfbf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.390938:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005ddfa892/0x2f18ee3fd845bfbf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.390946:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005ddfa892/0x2f18ee3fd845bfbf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.390952:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005ddfa892/0x2f18ee3fd845bfbf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.390959:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005ddfa892/0x2f18ee3fd845bfbf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.390965:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005ddfa892 already unused, calling callback (00000000113dcc6a) 00010000:00010000:2.0:1789785066.390969:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005ddfa892/0x2f18ee3fd845bfbf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.390976:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005ddfa892/0x2f18ee3fd845bfbf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.390983:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005ddfa892/0x2f18ee3fd845bfbf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.391005:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785066.391029:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005965ee18 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+17:3659:x1876725548989056:12345-0@lo:103: Request processed in 159us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785066.391035:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1789785066.391133:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785066.391254:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a8447b1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725548988928:0@lo:103: 00000100:00100000:3.0:1789785066.391280:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000062766994 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725548989056:0@lo:103: 00010000:00010000:1.0:1789785066.391373:0:7942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ae54f0c6/0x2f18ee3fd845be3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845be37 expref: 16 pid: 6527 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785066.391389:0:7942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e822af07 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7942:1876725548988800:0@lo:104: 00010000:00010000:1.0:1789785066.391410:0:7942:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005ddfa892/0x2f18ee3fd845bfbf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785066.391696:0:7942:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005ddfa892/0x2f18ee3fd845bfbf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785066.391704:0:7942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005ddfa892/0x2f18ee3fd845bfbf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785066.391711:0:7942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005ddfa892/0x2f18ee3fd845bfbf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785066.502508:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785066.820312:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d9ea88a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725548989184:0@lo:41: 00000100:00100000:1.0:1789785066.820459:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785066.820684:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548989184 00000100:00100000:2.0:1789785066.820695:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548989184 00000100:00100000:2.0:1789785066.820767:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789785066.820777:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e822af07 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725548989184:12345-0@lo:41: 00000004:00000024:2.0:1789785066.820820:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1789785066.825161:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e822af07 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725548989184:12345-0@lo:41: Request processed in 4371us (4688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785066.825184:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789785066.826711:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d9ea88a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725548989184:0@lo:41: 00010000:00010000:0.0:1789785067.525348:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785068.549436:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785069.575002:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785070.402595:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789785070.402630:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a3b86482 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725548989312:0@lo:41: 00000100:00100000:3.0:1789785070.402757:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785070.402893:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548989312 00000100:00100000:1.0:1789785070.402903:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548989312 00000100:00100000:1.0:1789785070.402982:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789785070.402993:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de63fdab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725548989312:12345-0@lo:41: 00000004:00000024:1.0:1789785070.403063:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789785070.403120:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de63fdab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725548989312:12345-0@lo:41: Request processed in 129us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785070.403127:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789785070.403232:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a3b86482 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725548989312:0@lo:41: 00000100:00100000:3.0:1789785070.403652:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000800ec3a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725548989440:0@lo:400: 00000100:00100000:3.0:1789785070.403710:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785070.403780:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548989440 00000100:00100000:0.0:1789785070.403786:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548989440 00000100:00100000:0.0:1789785070.403835:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789785070.403843:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d62db26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+16:3659:x1876725548989440:12345-0@lo:400: 00000100:00100000:0.0:1789785070.404061:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d62db26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+16:3659:x1876725548989440:12345-0@lo:400: Request processed in 218us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785070.404069:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789785070.404178:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000800ec3a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725548989440:0@lo:400: 00000100:00100000:3.0:1789785070.404193:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789785070.404198:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009f0ecf15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725548989568:0@lo:400: 00000100:00100000:3.0:1789785070.404228:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785070.404300:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548989568 00000100:00100000:0.0:1789785070.404304:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548989568 00000100:00100000:0.0:1789785070.404378:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789785070.404390:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006fa2d564 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725548989568:12345-0@lo:400: 00000100:00100000:0.0:1789785070.404432:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006fa2d564 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725548989568:12345-0@lo:400: Request processed in 44us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785070.404449:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789785070.404856:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000009f0ecf15 x1876725548989568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785070.404870:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009f0ecf15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725548989568:0@lo:400: 00000100:00100000:3.0:1789785070.405165:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009f0ecf15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725548989696:0@lo:400: 00000100:00100000:3.0:1789785070.405202:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785070.405289:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548989696 00000100:00100000:0.0:1789785070.405295:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548989696 00000100:00100000:0.0:1789785070.405331:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789785070.405389:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d2f895b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725548989696:12345-0@lo:400: 00000100:00100000:0.0:1789785070.405782:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d2f895b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725548989696:12345-0@lo:400: Request processed in 443us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785070.405791:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789785070.405813:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000800ec3a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725548989824:0@lo:400: 00000100:00100000:0.0:1789785070.405847:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785070.405941:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548989824 00000100:00100000:1.0:1789785070.405947:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548989824 00000100:00100000:1.0:1789785070.405987:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789785070.406003:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b654e426 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725548989824:12345-0@lo:400: 00000100:00100000:1.0:1789785070.406066:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b654e426 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725548989824:12345-0@lo:400: Request processed in 64us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785070.406073:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789785070.406212:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000800ec3a x1876725548989824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785070.406224:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000800ec3a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725548989824:0@lo:400: 00000100:00100000:3.0:1789785070.406281:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009f0ecf15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725548989696:0@lo:400: 00010000:00010000:2.0:1789785070.595625:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785071.624980:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785071.938477:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789785071.938502:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a3b86482 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725548989952:0@lo:41: 00000100:00100000:1.0:1789785071.938568:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785071.938633:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548989952 00000100:00100000:1.0:1789785071.938641:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548989952 00000100:00100000:1.0:1789785071.938684:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789785071.938692:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000760c7e7c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725548989952:12345-0@lo:41: 00000004:00000024:1.0:1789785071.938721:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1789785071.938760:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000760c7e7c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725548989952:12345-0@lo:41: Request processed in 69us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785071.938767:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789785071.938807:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a3b86482 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725548989952:0@lo:41: 00010000:00010000:2.0:1789785072.644104:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785073.667548:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789785073.987330:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789785073.987363:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dafc189c800 from 1 10000000:01000000:3.0:1789785073.987367:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789785073.987413:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 0000000007de3039/0x2f18ee3fd845bfc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785073.987425:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 0000000007de3039/0x2f18ee3fd845bfc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785073.987434:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 0000000007de3039/0x2f18ee3fd845bfc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785073.987457:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000229df94c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548990080:0@lo:101: 00000100:00100000:3.0:1789785073.987523:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785073.987579:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set 000000000bc68fc5 going to sleep for 11 seconds 00000100:00100000:0.0:1789785073.987644:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548990080 00000100:00100000:0.0:1789785073.987651:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548990080 00000100:00100000:0.0:1789785073.987706:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789785073.987715:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000448869e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+16:6531:x1876725548990080:12345-0@lo:101: 00010000:00010000:0.0:1789785073.987728:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785073.987740:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003a1a4d88/0x2f18ee3fd845bfcd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845bfc6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785073.987762:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003a1a4d88/0x2f18ee3fd845bfcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845bfc6 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785073.987772:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003a1a4d88/0x2f18ee3fd845bfcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bfc6 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785073.987794:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003a1a4d88, rc 0) 00000100:00100000:0.0:1789785073.987841:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000448869e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725548990080:12345-0@lo:101: Request processed in 127us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785073.987847:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789785073.988057:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000229df94c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548990080:0@lo:101: 00010000:00010000:1.0:1789785073.988071:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 0000000007de3039/0x2f18ee3fd845bfc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bfcd expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785073.988079:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 0000000007de3039/0x2f18ee3fd845bfc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845bfcd expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785073.988137:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a3b86482 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548990208:0@lo:501: 00000100:00100000:1.0:1789785073.988165:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785073.988185:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set 00000000faec63b6 going to sleep for 11 seconds 00000100:00100000:3.0:1789785073.988306:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548990208 00000100:00100000:3.0:1789785073.988317:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548990208 00000100:00100000:3.0:1789785073.988374:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789785073.988381:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000babced74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725548990208:12345-0@lo:501: 00000100:00100000:3.0:1789785073.988491:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000babced74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725548990208:12345-0@lo:501: Request processed in 111us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785073.988498:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789785073.988528:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a3b86482 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548990208:0@lo:501: 00000100:00100000:3.0:1789785073.988568:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a2f9e827 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548990336:0@lo:503: 00000100:00100000:3.0:1789785073.988604:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785073.988617:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set 000000001df7502d going to sleep for 11 seconds 00000100:00100000:3.0:1789785073.988628:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548990336 00000100:00100000:3.0:1789785073.988631:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548990336 00000100:00100000:3.0:1789785073.988648:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789785073.988653:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002106ca70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725548990336:12345-0@lo:503: 00000100:00100000:3.0:1789785073.988724:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002106ca70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725548990336:12345-0@lo:503: Request processed in 71us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785073.988731:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789785073.988766:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a2f9e827 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548990336:0@lo:503: 00000100:00100000:2.0:1789785073.996248:0:8345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008385e7f3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:8345:1876725548990464:0@lo:502: 00000100:00100000:2.0:1789785073.996326:0:8345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785073.996399:0:8345:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ce8d19c3 going to sleep for 11 seconds 00000100:00100000:3.0:1789785073.996524:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548990464 00000100:00100000:3.0:1789785073.996532:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548990464 00000100:00100000:3.0:1789785073.996587:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789785073.996595:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd1239ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+17:8345:x1876725548990464:12345-0@lo:502: 00000100:00100000:3.0:1789785073.996717:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd1239ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+17:8345:x1876725548990464:12345-0@lo:502: Request processed in 122us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785073.996724:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789785073.996955:0:8345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008385e7f3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:8345:1876725548990464:0@lo:502: 00000020:01000000:2.0:1789785073.996982:0:8345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789785073.997002:0:8345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785073.997005:0:8345:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789785073.997012:0:8345:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dafc189c800 00000020:00000080:2.0:1789785073.997015:0:8345:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789785073.997066:0:8345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:8345:1876725548990592:0@lo:502: 00000100:00100000:2.0:1789785073.997101:0:8345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785073.997139:0:8345:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb448240 going to sleep for 11 seconds 00000100:00100000:0.0:1789785073.997186:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548990592 00000100:00100000:0.0:1789785073.997190:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548990592 00000100:00100000:0.0:1789785073.997223:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789785073.997230:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+17:8345:x1876725548990592:12345-0@lo:502: 00000100:00100000:0.0:1789785073.997308:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+17:8345:x1876725548990592:12345-0@lo:502: Request processed in 78us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785073.997315:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789785073.997424:0:8345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:8345:1876725548990592:0@lo:502: 00000020:01000000:2.0:1789785073.997441:0:8345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789785073.997446:0:8345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785073.997448:0:8345:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789785073.997450:0:8345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789785073.997658:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789785073.997678:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789785073.997687:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb800/0x2f18ee3fd845bfc6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bfcd expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785073.997698:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb800/0x2f18ee3fd845bfc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bfcd expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785073.997708:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789785073.997711:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9daf89061800 from 1 10000000:01000000:0.0:1789785073.997714:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789785073.997736:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf80030e00/0x2f18ee3fd845bfd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785073.997744:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9daf80030e00/0x2f18ee3fd845bfd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785073.997766:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9daf80030e00/0x2f18ee3fd845bfd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785073.997778:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc18c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548990720:0@lo:101: 00000100:00100000:0.0:1789785073.997806:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785073.997836:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafa640bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789785073.998014:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548990720 00000100:00100000:2.0:1789785073.998029:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548990720 00000100:00100000:2.0:1789785073.998062:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789785073.998069:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725548990720:12345-0@lo:101: 00010000:00010000:2.0:1789785073.998078:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785073.998090:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1b08800/0x2f18ee3fd845bfdb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845bfd4 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785073.998109:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1b08800/0x2f18ee3fd845bfdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845bfd4 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785073.998119:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1b08800/0x2f18ee3fd845bfdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bfd4 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785073.998128:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b08800, rc 0) 00000100:00100000:2.0:1789785073.998163:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+18:6531:x1876725548990720:12345-0@lo:101: Request processed in 94us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785073.998168:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789785073.998199:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc18c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548990720:0@lo:101: 00010000:00010000:2.0:1789785073.998210:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9daf80030e00/0x2f18ee3fd845bfd4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bfdb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785073.998218:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9daf80030e00/0x2f18ee3fd845bfd4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845bfdb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785073.998268:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548990848:0@lo:501: 00000100:00100000:2.0:1789785073.998293:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785073.998306:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb4486c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789785073.998316:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548990848 00000100:00100000:2.0:1789785073.998319:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548990848 00000100:00100000:2.0:1789785073.998359:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789785073.998367:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+18:6531:x1876725548990848:12345-0@lo:501: 00000100:00100000:2.0:1789785073.998626:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+18:6531:x1876725548990848:12345-0@lo:501: Request processed in 259us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785073.998633:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789785074.003572:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548990848:0@lo:501: 00000100:00100000:1.0:1789785074.007174:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548990976:0@lo:503: 00000100:00100000:1.0:1789785074.007261:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785074.007297:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb35c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789785074.008828:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548990976 00000100:00100000:0.0:1789785074.008841:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548990976 00000100:00100000:0.0:1789785074.008908:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789785074.008920:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+18:6531:x1876725548990976:12345-0@lo:503: 00000100:00100000:0.0:1789785074.009148:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+18:6531:x1876725548990976:12345-0@lo:503: Request processed in 230us (1886us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785074.009156:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789785074.009412:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548990976:0@lo:503: 00000100:00100000:1.0:1789785074.010655:0:8347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:8347:1876725548991104:0@lo:502: 00000100:00100000:1.0:1789785074.010713:0:8347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785074.010747:0:8347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb35c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785074.011039:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548991104 00000100:00100000:3.0:1789785074.011053:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548991104 00000100:00100000:3.0:1789785074.011101:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789785074.011109:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+18:8347:x1876725548991104:12345-0@lo:502: 00000100:00100000:3.0:1789785074.011220:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+18:8347:x1876725548991104:12345-0@lo:502: Request processed in 111us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785074.011227:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789785074.011497:0:8347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:8347:1876725548991104:0@lo:502: 00000020:01000000:1.0:1789785074.011525:0:8347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789785074.011545:0:8347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785074.011548:0:8347:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789785074.011556:0:8347:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9daf89061800 00000020:00000080:1.0:1789785074.011559:0:8347:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789785074.011584:0:8347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:8347:1876725548991232:0@lo:502: 00000100:00100000:1.0:1789785074.011621:0:8347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785074.011663:0:8347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb35c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785074.012047:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548991232 00000100:00100000:3.0:1789785074.012052:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548991232 00000100:00100000:3.0:1789785074.012090:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789785074.012098:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+18:8347:x1876725548991232:12345-0@lo:502: 00000100:00100000:3.0:1789785074.012181:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+18:8347:x1876725548991232:12345-0@lo:502: Request processed in 83us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785074.012188:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789785074.012264:0:8347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:8347:1876725548991232:0@lo:502: 00000020:01000000:1.0:1789785074.012282:0:8347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785074.012287:0:8347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785074.012289:0:8347:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789785074.012291:0:8347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789785074.027507:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789785074.027564:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789785074.027583:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf80030e00/0x2f18ee3fd845bfd4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bfdb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785074.027595:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9daf80030e00/0x2f18ee3fd845bfd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bfdb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785074.693974:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785075.522537:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789785075.523177:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789785075.523198:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc18c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725548991744:0@lo:400: 00000100:00100000:2.0:1789785075.523276:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1789785075.524842:0:8442:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789785075.524845:0:8442:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789785075.524847:0:8442:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789785075.524948:0:8442:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9dafb5cd8800 00000020:01000004:1.0:1789785075.524961:0:8442:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789785075.524973:0:8442:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789785075.524985:0:8442:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9dafac8ccd28) 00000020:00000080:1.0:1789785075.524999:0:8442:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00000100:00100000:3.0:1789785075.526783:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725548991360:0@lo:41: 00000100:00100000:3.0:1789785075.526846:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785075.526913:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc18c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725548991488:0@lo:400: 00000100:00100000:3.0:1789785075.526943:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785075.526972:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789785075.526979:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc18c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725548991616:0@lo:400: 00000100:00100000:3.0:1789785075.527021:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785075.527158:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548991488 00000100:00100000:3.0:1789785075.527165:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548991488 00000100:00100000:3.0:1789785075.527206:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789785075.527214:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+18:3661:x1876725548991488:12345-0@lo:400: 00000100:00100000:1.0:1789785075.527300:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548991744 00000100:00100000:1.0:1789785075.527304:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548991744 00000100:00100000:1.0:1789785075.527329:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548991360 00000100:00100000:1.0:1789785075.527332:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548991360 00000100:00100000:1.0:1789785075.527363:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789785075.527370:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacaeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725548991744:12345-0@lo:400: 00000100:00100000:1.0:1789785075.527427:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacaeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725548991744:12345-0@lo:400: Request processed in 57us (4150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785075.527435:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789785075.527450:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789785075.527456:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725548991360:12345-0@lo:41: 00000004:00000024:1.0:1789785075.527479:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789785075.527511:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725548991360:12345-0@lo:41: Request processed in 54us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785075.527517:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789785075.527554:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc18c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725548991744:0@lo:400: 00000100:00100000:3.0:1789785075.527651:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+18:3661:x1876725548991488:12345-0@lo:400: Request processed in 438us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785075.527658:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789785075.527699:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725548991360:0@lo:41: 00000100:00100000:3.0:1789785075.527741:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548991616 00000100:00100000:3.0:1789785075.527744:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548991616 00000100:00100000:3.0:1789785075.527768:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789785075.527774:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725548991616:12345-0@lo:400: 00000100:00100000:3.0:1789785075.527802:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725548991616:12345-0@lo:400: Request processed in 28us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785075.527807:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789785075.528198:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dafc18c7b80 x1876725548991616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785075.528210:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc18c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725548991616:0@lo:400: 00000100:00100000:1.0:1789785075.528283:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc18c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725548991488:0@lo:400: 00000100:00100000:0.0:1789785075.529083:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc18c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1876725548991872:0@lo:400: 00000100:00100000:0.0:1789785075.529124:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785075.529161:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548991872 00000100:00100000:0.0:1789785075.529165:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548991872 00000100:00100000:0.0:1789785075.529191:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789785075.529197:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1876725548991872:12345-0@lo:400: 00000100:00100000:0.0:1789785075.529392:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1876725548991872:12345-0@lo:400: Request processed in 193us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785075.529399:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789785075.529426:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dafc18c5c00 x1876725548991872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785075.529450:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc18c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1876725548991872:0@lo:400: 00100000:10000000:0.0:1789785075.551947:0:8442:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1789785075.552002:0:8442:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1789785075.585988:0:8442:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789785075.586202:0:8442:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789785075.586213:0:8442:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789785075.586281:0:8442:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2f18ee3fd845bfe9 00000020:01000004:0.0:1789785075.586289:0:8442:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789785075.586311:0:8442:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.146@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789785075.586314:0:8442:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.146@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789785075.586320:0:8442:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789785075.586325:0:8442:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789785075.586430:0:8442:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9dafb5c3b370) 00000020:00000080:0.0:1789785075.586444:0:8442:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1789785075.587794:0:8442:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789785075.587958:0:8442:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789785075.587963:0:8442:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789785075.588680:0:8442:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789785075.588688:0:8442:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789785075.589005:0:8442:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789785075.589020:0:8442:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789785075.593291:0:8442:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789785075.593521:0:8442:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789785075.593526:0:8442:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789785075.594701:0:8442:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789785075.594710:0:8442:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789785075.623810:0:8442:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789785075.624118:0:8442:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789785075.624125:0:8442:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789785075.626487:0:8442:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789785075.626498:0:8442:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789785075.628316:0:8442:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789785075.628327:0:8442:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789785075.632152:0:8442:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789785075.632572:0:8442:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789785075.632579:0:8442:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789785075.633331:0:8442:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789785075.633534:0:8442:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789785075.673276:0:8442:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789785075.673501:0:8442:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789785075.673507:0:8442:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789785075.674671:0:8442:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789785075.674680:0:8442:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789785075.675196:0:8442:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789785075.675286:0:8442:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1789785075.675293:0:8442:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.146@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789785075.690969:0:8442:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.146@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789785075.691016:0:8442:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.146@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1789785075.691020:0:8442:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789785075.691025:0:8442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789785075.691027:0:8442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789785075.691028:0:8442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789785075.691029:0:8442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789785075.691030:0:8442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789785075.691031:0:8442:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789785075.691033:0:8442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789785075.691034:0:8442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789785075.691035:0:8442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789785075.691037:0:8442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789785075.691041:0:8442:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1789785075.691043:0:8442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789785075.691044:0:8442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789785075.691045:0:8442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789785075.691046:0:8442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789785075.691046:0:8442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789785075.691047:0:8442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789785075.691048:0:8442:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789785075.691049:0:8442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789785075.691049:0:8442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789785075.691050:0:8442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789785075.691051:0:8442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789785075.691075:0:8442:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789785075.691094:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc18c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548992000:0@lo:253: 00000100:00100000:0.0:1789785075.691951:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785075.692137:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafb5ded840 going to sleep for 11 seconds 00000100:00100000:3.0:1789785075.692193:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548992000 00000100:00100000:3.0:1789785075.692201:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548992000 00000100:00100000:3.0:1789785075.692359:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789785075.692370:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+18:8442:x1876725548992000:12345-0@lo:253: 20000000:01000000:3.0:1789785075.692411:0:6527:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789785075.692415:0:6527:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789785075.692420:0:6527:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789785075.692439:0:6527:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789785075.692646:0:6527:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789785075.692800:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789785075.692816:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789785075.692833:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789785075.692839:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789785075.692853:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789785075.692869:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789785075.692953:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789785075.692968:0:6527:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.146@tcp 20000000:01000000:3.0:1789785075.692969:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.146@tcp (null) (null) (null) 00000040:00080000:3.0:1789785075.692998:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789785075.693017:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789785075.693033:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789785075.693039:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.146@tcp (null) (null) 00000040:00080000:3.0:1789785075.693053:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789785075.693060:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789785075.693073:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789785075.693089:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789785075.693156:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1789785075.693167:0:6527:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.146@tcp 20000000:01000000:3.0:1789785075.693169:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.146@tcp (null) (null) (null) 00000040:00080000:3.0:1789785075.693181:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1789785075.693186:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789785075.693198:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1789785075.693203:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.146@tcp (null) (null) 00000040:00080000:3.0:1789785075.693225:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1789785075.693232:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789785075.693245:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1789785075.693260:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1789785075.693651:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1789785075.693674:0:6527:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.146@tcp 20000000:01000000:3.0:1789785075.693676:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.146@tcp (null) (null) (null) 00000040:00080000:3.0:1789785075.693692:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1789785075.693697:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789785075.693709:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1789785075.693714:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.146@tcp (null) (null) 00000040:00080000:3.0:1789785075.693727:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1789785075.693732:0:6527:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789785075.693746:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1789785075.693777:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1789785075.693793:0:6527:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789785075.693796:0:6527:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789785075.693799:0:6527:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789785075.693843:0:6527:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789785075.693846:0:6527:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789785075.694560:0:8462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1789785075.694586:0:8462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1789785075.694604:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1789785075.694844:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1789785075.694867:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1789785075.694883:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1789785075.694894:0:6527:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789785075.694896:0:6527:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789785075.695206:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1789785075.695451:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1789785075.695468:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1789785075.695495:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1789785075.695505:0:6527:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789785075.695507:0:6527:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789785075.695856:0:8464:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1789785075.695876:0:8464:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1789785075.695890:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1789785075.696031:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1789785075.696059:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1789785075.696073:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:0.0:1789785075.696083:0:6527:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789785075.696086:0:6527:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789785075.696411:0:8465:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1789785075.696428:0:8465:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1789785075.696441:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1789785075.696566:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1789785075.696584:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1789785075.696597:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:0.0:1789785075.696610:0:6527:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789785075.696628:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845bff7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.696645:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc1b09600/0x2f18ee3fd845bec3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bebc expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.696653:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9daf80030a00/0x2f18ee3fd845bf3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bf33 expref: 18 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.696661:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc2050000/0x2f18ee3fd845bf72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bf6b expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.696667:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9daf80030c00/0x2f18ee3fd845bf8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bf87 expref: 18 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.696674:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc21cb200/0x2f18ee3fd845bfb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bfb1 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.696681:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845bff7 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.696716:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc21cb200/0x2f18ee3fd845bfb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845bfb1 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.696801:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dafc21cb200/0x2f18ee3fd845bfb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845bfb1 expref: 18 pid: 6528 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785075.696825:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc18c5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6527:1876725548992128:0@lo:104: 00000100:00100000:0.0:1789785075.696885:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789785075.696977:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9daf80030c00/0x2f18ee3fd845bf8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845bf87 expref: 18 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.696986:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9daf80030c00/0x2f18ee3fd845bf8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf87 expref: 18 pid: 6527 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785075.696994:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc18c6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6527:1876725548992256:0@lo:104: 00000100:00100000:0.0:1789785075.697029:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789785075.697131:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc2050000/0x2f18ee3fd845bf72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845bf6b expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.697141:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dafc2050000/0x2f18ee3fd845bf72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf6b expref: 18 pid: 6526 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785075.697150:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc18c4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6527:1876725548992384:0@lo:104: 00000100:00100000:0.0:1789785075.697171:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785075.697268:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548992128 00000100:00100000:2.0:1789785075.697276:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548992128 00000100:00100000:2.0:1789785075.697319:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548992256 00000100:00100000:2.0:1789785075.697323:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548992256 00010000:00010000:0.0:1789785075.697429:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9daf80030a00/0x2f18ee3fd845bf3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845bf33 expref: 18 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.697438:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9daf80030a00/0x2f18ee3fd845bf3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf33 expref: 18 pid: 6527 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785075.697447:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc18c5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6527:1876725548992512:0@lo:104: 00000100:00100000:0.0:1789785075.697479:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789785075.697498:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc1b09600/0x2f18ee3fd845bec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845bebc expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.697513:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dafc1b09600/0x2f18ee3fd845bec3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845bebc expref: 18 pid: 6526 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785075.697522:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eab480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6527:1876725548992640:0@lo:104: 00000100:00100000:0.0:1789785075.697541:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785075.697550:0:6527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf83f30900 going to sleep for 11 seconds 00000100:00100000:1.0:1789785075.697596:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548992384 00000100:00100000:1.0:1789785075.697600:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548992384 00000100:00100000:2.0:1789785075.697663:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789785075.697674:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+5:6527:x1876725548992128:12345-0@lo:104: 00010000:00010000:2.0:1789785075.697687:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845bfb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845bfb8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.697745:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789785075.697756:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+5:6527:x1876725548992128:12345-0@lo:104: Request processed in 85us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785075.697884:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc18c5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6527:1876725548992128:0@lo:104: 00000100:00100000:1.0:1789785075.697920:0:6516:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1789785075.697927:0:6516:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1789785075.698067:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789785075.698084:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548992512 00000100:00100000:2.0:1789785075.698087:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548992512 00000100:00100000:2.0:1789785075.698098:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548992640 00000100:00100000:2.0:1789785075.698100:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548992640 00000100:00100000:2.0:1789785075.698110:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789785075.698116:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+6:6527:x1876725548992256:12345-0@lo:104: 00010000:00010000:2.0:1789785075.698124:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08200/0x2f18ee3fd845bf87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845bf8e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785075.698326:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789785075.698335:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e00759f-51ad-47f9-8892-382c83919083+6:6527:x1876725548992384:12345-0@lo:104: 00010000:00010000:3.0:1789785075.698360:0:8466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca600/0x2f18ee3fd845bf6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845bf72 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.698430:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789785075.698436:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+6:6527:x1876725548992256:12345-0@lo:104: Request processed in 321us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785075.698443:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789785075.698456:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789785075.698463:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+5:6527:x1876725548992512:12345-0@lo:104: 00010000:00010000:2.0:1789785075.698470:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9daf80030600/0x2f18ee3fd845bf33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845bf3a expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785075.698584:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789785075.698595:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e00759f-51ad-47f9-8892-382c83919083+5:6527:x1876725548992384:12345-0@lo:104: Request processed in 263us (1424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785075.698601:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789785075.698613:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789785075.698619:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e00759f-51ad-47f9-8892-382c83919083+4:6527:x1876725548992640:12345-0@lo:104: 00010000:00010000:3.0:1789785075.698626:0:8466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc21caa00/0x2f18ee3fd845bebc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845bec3 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785075.698651:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789785075.698655:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e00759f-51ad-47f9-8892-382c83919083+4:6527:x1876725548992640:12345-0@lo:104: Request processed in 37us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785075.698661:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1789785075.698697:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789785075.698702:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+3:6527:x1876725548992512:12345-0@lo:104: Request processed in 241us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785075.698708:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1789785075.698722:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789785075.698788:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845bfb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845bfb8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.698806:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc21ca200 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:2.0:1789785075.698810:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845bfb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845bfb8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.698818:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845bfb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845bfb8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789785075.698825:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845bfb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845bfb8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785075.698831:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789785075.698866:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845bfb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bfb8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.698873:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789785075.698915:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacaea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725548992768:0@lo:103: 00000100:00100000:1.0:1789785075.698946:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789785075.698994:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845bfb1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bfb8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.699002:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845bfb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bfb8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.699024:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789785075.699027:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08200/0x2f18ee3fd845bf87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845bf8e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.699033:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b08200 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:2.0:1789785075.699036:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08200/0x2f18ee3fd845bf87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845bf8e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.699053:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08200/0x2f18ee3fd845bf87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845bf8e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789785075.699059:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08200/0x2f18ee3fd845bf87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845bf8e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785075.699065:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789785075.699078:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08200/0x2f18ee3fd845bf87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bf8e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.699084:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789785075.699146:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc18c6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6527:1876725548992256:0@lo:104: 00000100:00100000:0.0:1789785075.699157:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc18c4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6527:1876725548992384:0@lo:104: 00000100:00100000:0.0:1789785075.699164:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc18c5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6527:1876725548992512:0@lo:104: 00000100:00100000:0.0:1789785075.699171:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eab480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6527:1876725548992640:0@lo:104: 00010000:00010000:0.0:1789785075.699195:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845bff7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785075.699289:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789785075.699296:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725548992896:0@lo:103: 00000100:00100000:1.0:1789785075.699322:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785075.699430:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548992768 00000100:00100000:3.0:1789785075.699436:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548992768 00010000:00010000:3.0:1789785075.699458:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc21cb200/0x2f18ee3fd845bfb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845bfb1 expref: 19 pid: 6528 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785075.699477:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548992896 00000100:00100000:3.0:1789785075.699480:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548992896 00010000:00010000:3.0:1789785075.699491:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9daf80030c00/0x2f18ee3fd845bf8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf87 expref: 20 pid: 6527 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785075.699518:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789785075.699526:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e00759f-51ad-47f9-8892-382c83919083+20:3661:x1876725548992768:12345-0@lo:103: 00010000:00010000:3.0:1789785075.699537:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785075.699542:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc21cb200/0x2f18ee3fd845bfb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845bfb1 expref: 20 pid: 6528 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785075.699552:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc21cb200/0x2f18ee3fd845bfb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845bfb1 expref: 20 pid: 6528 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785075.699571:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc21cb200/0x2f18ee3fd845bfb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845bfb1 expref: 20 pid: 6528 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785075.699582:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785075.699610:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e00759f-51ad-47f9-8892-382c83919083+19:3661:x1876725548992768:12345-0@lo:103: Request processed in 85us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785075.699616:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789785075.699630:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789785075.699635:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e00759f-51ad-47f9-8892-382c83919083+18:3661:x1876725548992896:12345-0@lo:103: 00010000:00010000:3.0:1789785075.699642:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785075.699646:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9daf80030c00/0x2f18ee3fd845bf8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf87 expref: 18 pid: 6527 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785075.699654:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9daf80030c00/0x2f18ee3fd845bf8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf87 expref: 18 pid: 6527 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785075.699664:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9daf80030c00/0x2f18ee3fd845bf8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845bf87 expref: 18 pid: 6527 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785075.699672:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785075.699690:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e00759f-51ad-47f9-8892-382c83919083+17:3661:x1876725548992896:12345-0@lo:103: Request processed in 55us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785075.699695:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789785075.699716:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725548992896:0@lo:103: 00000100:00100000:3.0:1789785075.699723:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacaea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725548992768:0@lo:103: 00010000:00010000:2.0:1789785075.699934:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08200/0x2f18ee3fd845bf87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bf8e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.699942:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08200/0x2f18ee3fd845bf87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bf8e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.699953:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789785075.699957:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca600/0x2f18ee3fd845bf6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845bf72 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.699963:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc21ca600 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:2.0:1789785075.699966:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca600/0x2f18ee3fd845bf6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845bf72 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.699972:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca600/0x2f18ee3fd845bf6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845bf72 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789785075.699978:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca600/0x2f18ee3fd845bf6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845bf72 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785075.699990:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789785075.700048:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca600/0x2f18ee3fd845bf6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bf72 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.700055:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789785075.700079:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca600/0x2f18ee3fd845bf6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bf72 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.700085:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca600/0x2f18ee3fd845bf6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bf72 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.700094:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789785075.700097:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc21caa00/0x2f18ee3fd845bebc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845bec3 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.700102:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc21caa00 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:2.0:1789785075.700105:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc21caa00/0x2f18ee3fd845bebc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845bec3 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.700112:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc21caa00/0x2f18ee3fd845bebc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845bec3 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789785075.700118:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc21caa00/0x2f18ee3fd845bebc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845bec3 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785075.700124:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789785075.700159:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacaeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725548993024:0@lo:103: 00000100:00100000:0.0:1789785075.700186:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785075.700333:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548993024 00000100:00100000:3.0:1789785075.700395:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548993024 00010000:00010000:3.0:1789785075.700419:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc2050000/0x2f18ee3fd845bf72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf6b expref: 17 pid: 6526 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785075.700475:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789785075.700482:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81eab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e00759f-51ad-47f9-8892-382c83919083+17:3659:x1876725548993024:12345-0@lo:103: 00010000:00010000:3.0:1789785075.700490:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785075.700494:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc2050000/0x2f18ee3fd845bf72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf6b expref: 17 pid: 6526 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785075.700504:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc2050000/0x2f18ee3fd845bf72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf6b expref: 17 pid: 6526 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785075.700515:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc2050000/0x2f18ee3fd845bf72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845bf6b expref: 17 pid: 6526 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785075.700525:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785075.700560:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81eab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e00759f-51ad-47f9-8892-382c83919083+16:3659:x1876725548993024:12345-0@lo:103: Request processed in 79us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785075.700567:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789785075.700622:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacaeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725548993024:0@lo:103: 00010000:00010000:2.0:1789785075.700688:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc21caa00/0x2f18ee3fd845bebc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bec3 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.700694:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789785075.700712:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc21caa00/0x2f18ee3fd845bebc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bec3 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.700719:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc21caa00/0x2f18ee3fd845bebc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bec3 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.700818:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789785075.700822:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9daf80030600/0x2f18ee3fd845bf33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845bf3a expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.700828:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf80030600 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:2.0:1789785075.700831:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9daf80030600/0x2f18ee3fd845bf33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845bf3a expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.700838:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9daf80030600/0x2f18ee3fd845bf33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845bf3a expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789785075.700845:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9daf80030600/0x2f18ee3fd845bf33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845bf3a expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785075.700850:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789785075.700872:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9daf80030600/0x2f18ee3fd845bf33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bf3a expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.700878:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789785075.700887:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9daf80030600/0x2f18ee3fd845bf33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bf3a expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.700894:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9daf80030600/0x2f18ee3fd845bf33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bf3a expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.700905:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785075.700911:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785075.700913:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785075.700920:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785075.701019:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789785075.701029:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725548993280:0@lo:103: 00000100:00100000:2.0:1789785075.701056:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785075.701129:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725548993152:0@lo:103: 00000100:00100000:2.0:1789785075.701154:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785075.701363:0:7484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548993280 00000100:00100000:0.0:1789785075.701369:0:7484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548993280 00010000:00010000:0.0:1789785075.701388:0:7484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9daf80030a00/0x2f18ee3fd845bf3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf33 expref: 16 pid: 6527 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785075.701410:0:7484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548993152 00000100:00100000:0.0:1789785075.701413:0:7484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548993152 00010000:00010000:0.0:1789785075.701424:0:7484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc1b09600/0x2f18ee3fd845bec3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845bebc expref: 17 pid: 6526 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785075.701453:0:7484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789785075.701458:0:7484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e00759f-51ad-47f9-8892-382c83919083+17:3662:x1876725548993280:12345-0@lo:103: 00010000:00010000:0.0:1789785075.701466:0:7484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785075.701470:0:7484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9daf80030a00/0x2f18ee3fd845bf3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf33 expref: 17 pid: 6527 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.701479:0:7484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9daf80030a00/0x2f18ee3fd845bf3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf33 expref: 17 pid: 6527 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.701489:0:7484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9daf80030a00/0x2f18ee3fd845bf3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845bf33 expref: 17 pid: 6527 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.701498:0:7484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785075.701523:0:7484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e00759f-51ad-47f9-8892-382c83919083+16:3662:x1876725548993280:12345-0@lo:103: Request processed in 65us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785075.701529:0:7484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789785075.701541:0:7484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789785075.701546:0:7484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e00759f-51ad-47f9-8892-382c83919083+15:3660:x1876725548993152:12345-0@lo:103: 00010000:00010000:0.0:1789785075.701563:0:7484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785075.701567:0:7484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc1b09600/0x2f18ee3fd845bec3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845bebc expref: 15 pid: 6526 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.701576:0:7484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc1b09600/0x2f18ee3fd845bec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845bebc expref: 15 pid: 6526 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.701585:0:7484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1b09600/0x2f18ee3fd845bec3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845bebc expref: 15 pid: 6526 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.701605:0:7484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845bff7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.701613:0:7484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845bff7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.701626:0:7484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845bff7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.701634:0:7484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845bff7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.701640:0:7484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845bff7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.701647:0:7484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845bff7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.701652:0:7484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf80030800 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:0.0:1789785075.701656:0:7484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845bff7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.701664:0:7484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845bff7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.701676:0:7484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845bff7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.701685:0:7484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785075.701710:0:7484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e00759f-51ad-47f9-8892-382c83919083+14:3660:x1876725548993152:12345-0@lo:103: Request processed in 164us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785075.701978:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725548993280:0@lo:103: 00000100:00100000:2.0:1789785075.702020:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725548993152:0@lo:103: 00000100:00100000:0.0:1789785075.702169:0:7484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789785075.702214:0:6527:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845bff7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.702232:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845bff7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.702239:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845bff7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789785075.702251:0:6527:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789785075.704072:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+13:8442:x1876725548992000:12345-0@lo:253: Request processed in 11698us (12116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785075.704083:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789785075.704171:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc18c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548992000:0@lo:253: 10000000:01000000:2.0:1789785075.704184:0:8442:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789785075.704187:0:8442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789785075.704189:0:8442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789785075.704190:0:8442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789785075.704192:0:8442:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789785075.704193:0:8442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789785075.704194:0:8442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789785075.704195:0:8442:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789785075.704197:0:8442:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789785075.704198:0:8442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789785075.704199:0:8442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789785075.704273:0:8442:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dafb5cd8800 from lustre-OST0000 10000000:01000000:2.0:1789785075.704303:0:8442:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789785075.704306:0:8442:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789785075.704315:0:8442:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9daf983fcd28 local copy 10000000:01000000:2.0:1789785075.704319:0:8442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789785075.704378:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845bffe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.704388:0:8442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845bffe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.704407:0:8442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845bffe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785075.704423:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548993408:0@lo:101: 00000100:00100000:2.0:1789785075.704457:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785075.704484:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafb5c33180 going to sleep for 11 seconds 00000100:00100000:3.0:1789785075.704541:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548993408 00000100:00100000:3.0:1789785075.704548:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548993408 00000100:00100000:3.0:1789785075.704587:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789785075.704595:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+13:8442:x1876725548993408:12345-0@lo:101: 00010000:00010000:3.0:1789785075.704608:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785075.704620:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc21cb400/0x2f18ee3fd845c005 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845bffe expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785075.704640:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc21cb400/0x2f18ee3fd845c005 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845bffe expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785075.704661:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc21cb400/0x2f18ee3fd845c005 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bffe expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785075.704669:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc21cb400, rc 0) 00000100:00100000:3.0:1789785075.704704:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+14:8442:x1876725548993408:12345-0@lo:101: Request processed in 109us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785075.704709:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789785075.704854:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548993408:0@lo:101: 00010000:00010000:2.0:1789785075.704865:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845bffe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2f18ee3fd845c005 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.704874:0:8442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845bffe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2f18ee3fd845c005 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785075.704961:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548993536:0@lo:501: 00000100:00100000:2.0:1789785075.704986:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785075.705018:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafb5c33180 going to sleep for 11 seconds 00000100:00100000:0.0:1789785075.705055:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548993536 00000100:00100000:0.0:1789785075.705059:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548993536 00000100:00100000:0.0:1789785075.705086:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789785075.705093:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+14:8442:x1876725548993536:12345-0@lo:501: 00000100:00100000:0.0:1789785075.705155:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+14:8442:x1876725548993536:12345-0@lo:501: Request processed in 62us (168us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789785075.705162:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789785075.705275:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548993536:0@lo:501: 10000000:01000000:2.0:1789785075.705288:0:8442:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.146@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789785075.705304:0:8442:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.146@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789785075.705309:0:8442:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845bffe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2f18ee3fd845c005 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.705317:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845bffe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2f18ee3fd845c005 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.705323:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845bffe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2f18ee3fd845c005 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.705372:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789785075.705393:0:8442:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dafb5cd8800 10000000:01000000:2.0:1789785075.705399:0:8442:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789785075.705403:0:8442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789785075.705406:0:8442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789785075.705410:0:8442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789785075.705412:0:8442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789785075.705426:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08400/0x2f18ee3fd845c00c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.705433:0:8442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08400/0x2f18ee3fd845c00c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.705441:0:8442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08400/0x2f18ee3fd845c00c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785075.705452:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548993664:0@lo:101: 00000100:00100000:2.0:1789785075.705475:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785075.705487:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafb5c333c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789785075.705539:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548993664 00000100:00100000:0.0:1789785075.705543:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548993664 00000100:00100000:0.0:1789785075.705571:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789785075.705577:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+14:8442:x1876725548993664:12345-0@lo:101: 00010000:00010000:0.0:1789785075.705584:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785075.705601:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dae81eac200/0x2f18ee3fd845c013 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c00c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.705623:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dae81eac200/0x2f18ee3fd845c013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c00c expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.705632:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dae81eac200/0x2f18ee3fd845c013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c00c expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.705639:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eac200, rc 0) 00000100:00100000:0.0:1789785075.705663:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:8442:x1876725548993664:12345-0@lo:101: Request processed in 86us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785075.705668:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:0.0:1789785075.705688:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789785075.705693:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845bffe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2f18ee3fd845c005 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.705700:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09400 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:0.0:1789785075.705703:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845bffe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2f18ee3fd845c005 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.705712:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845bffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x2f18ee3fd845c005 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789785075.705719:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845bffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x2f18ee3fd845c005 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785075.705736:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789785075.705751:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845bffe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2f18ee3fd845c005 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.705757:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789785075.705776:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845bffe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2f18ee3fd845c005 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.705782:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845bffe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2f18ee3fd845c005 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.705794:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785075.705796:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785075.705798:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785075.705884:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725548993792:0@lo:103: 00000100:00100000:2.0:1789785075.705910:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785075.705964:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548993664:0@lo:101: 00010000:00010000:2.0:1789785075.705974:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08400/0x2f18ee3fd845c00c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c013 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.705982:0:8442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08400/0x2f18ee3fd845c00c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c013 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785075.706055:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548993920:0@lo:501: 00000100:00100000:2.0:1789785075.706079:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785075.706089:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafb5c333c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785075.706149:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548993920 00000100:00100000:3.0:1789785075.706153:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548993920 00000100:00100000:3.0:1789785075.706185:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789785075.706193:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+15:8442:x1876725548993920:12345-0@lo:501: 00000100:00100000:3.0:1789785075.706361:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+15:8442:x1876725548993920:12345-0@lo:501: Request processed in 168us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785075.706367:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789785075.706440:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548993920:0@lo:501: 00000100:00100000:2.0:1789785075.706462:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548994048:0@lo:503: 00000100:00100000:2.0:1789785075.706498:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785075.706526:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafb5c333c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789785075.706578:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548993792 00000100:00100000:0.0:1789785075.706582:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548993792 00000100:00100000:0.0:1789785075.706621:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789785075.706628:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+15:3662:x1876725548993792:12345-0@lo:103: 00010000:00010000:0.0:1789785075.706637:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785075.706649:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc21cb400/0x2f18ee3fd845c005 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f18ee3fd845bffe expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.706661:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785075.706685:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+14:3662:x1876725548993792:12345-0@lo:103: Request processed in 58us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785075.706692:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789785075.706708:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548994048 00000100:00100000:0.0:1789785075.706711:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548994048 00000100:00100000:0.0:1789785075.706794:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789785075.706802:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+14:8442:x1876725548994048:12345-0@lo:503: 00000100:00100000:0.0:1789785075.706873:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+14:8442:x1876725548994048:12345-0@lo:503: Request processed in 72us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785075.706879:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789785075.706971:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725548993792:0@lo:103: 00000100:00100000:2.0:1789785075.707002:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548994048:0@lo:503: 00000040:00080000:2.0:1789785075.707322:0:8442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789785075.707867:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548994176:0@lo:502: 00000100:00100000:2.0:1789785075.707916:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785075.707949:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafb5c333c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789785075.708028:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548994176 00000100:00100000:0.0:1789785075.708038:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548994176 00000100:00100000:0.0:1789785075.708074:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789785075.708082:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+14:8442:x1876725548994176:12345-0@lo:502: 00000100:00100000:0.0:1789785075.708172:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+14:8442:x1876725548994176:12345-0@lo:502: Request processed in 91us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785075.708180:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789785075.708472:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548994176:0@lo:502: 00000040:00080000:2.0:1789785075.708686:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789785075.708713:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1789785075.708855:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1789785075.708875:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1789785075.708890:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1789785075.708905:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1789785075.708928:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548994304:0@lo:502: 00000100:00100000:2.0:1789785075.708969:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785075.709036:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafb5c333c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789785075.709069:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548994304 00000100:00100000:0.0:1789785075.709075:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548994304 00000100:00100000:0.0:1789785075.709137:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789785075.709144:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+14:8442:x1876725548994304:12345-0@lo:502: 00000100:00100000:0.0:1789785075.709295:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+14:8442:x1876725548994304:12345-0@lo:502: Request processed in 150us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785075.709302:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789785075.709623:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548994304:0@lo:502: 00000040:00080000:3.0:1789785075.709671:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789785075.709681:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1789785075.710113:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789785075.710121:0:8467:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1789785075.710127:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785075.710129:0:8467:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789785075.710135:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789785075.710149:0:8467:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9dafb5c399b8) 00000020:00000080:0.0:1789785075.710167:0:8467:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789785075.710172:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789785075.710301:0:8467:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dafb5cd8800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789785075.710310:0:8467:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789785075.710316:0:8467:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2f18ee3fd845c021 00010000:00010000:2.0:1789785075.715128:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785075.719638:0:8467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1789785075.719902:0:8467:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1789785075.730869:0:8467:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789785075.731241:0:8467:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1789785075.743409:0:8467:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1789785075.743585:0:8467:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1789785075.751672:0:8467:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1789785075.755023:0:8467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789785075.755034:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789785075.755041:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785075.755043:0:8467:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789785075.755047:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789785075.755052:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785075.755053:0:8467:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789785075.755056:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789785075.755058:0:8467:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789785075.755092:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789785075.755096:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785075.755097:0:8467:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789785075.755100:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789785075.755451:0:8442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1789785075.755480:0:8442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789785075.755512:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08400/0x2f18ee3fd845c00c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c013 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.755523:0:8442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08400/0x2f18ee3fd845c00c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c013 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785075.755532:0:8442:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dafb5cd8800 from 1 10000000:01000000:0.0:1789785075.755535:0:8442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789785075.755572:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eac400/0x2f18ee3fd845c028 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.755579:0:8442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dae81eac400/0x2f18ee3fd845c028 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.755588:0:8442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dae81eac400/0x2f18ee3fd845c028 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785075.755608:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81ea9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548994432:0@lo:101: 00000100:00100000:0.0:1789785075.755687:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785075.755730:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf92353000 going to sleep for 11 seconds 00000100:00100000:2.0:1789785075.755859:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548994432 00000100:00100000:2.0:1789785075.755866:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548994432 00000100:00100000:2.0:1789785075.755906:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789785075.755923:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+14:8442:x1876725548994432:12345-0@lo:101: 00010000:00010000:2.0:1789785075.755937:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785075.755949:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1b08200/0x2f18ee3fd845c02f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c028 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.755971:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1b08200/0x2f18ee3fd845c02f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c028 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.755981:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1b08200/0x2f18ee3fd845c02f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c028 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.755989:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b08200, rc 0) 00000100:00100000:2.0:1789785075.756042:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+15:8442:x1876725548994432:12345-0@lo:101: Request processed in 127us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785075.756049:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789785075.756234:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81ea9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548994432:0@lo:101: 00010000:00010000:1.0:1789785075.756249:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dae81eac400/0x2f18ee3fd845c028 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c02f expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785075.756258:0:8442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dae81eac400/0x2f18ee3fd845c028 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c02f expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785075.756403:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548994560:0@lo:501: 00000100:00100000:1.0:1789785075.756434:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785075.756457:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb35c780 going to sleep for 11 seconds 00000100:00100000:2.0:1789785075.756795:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548994560 00000100:00100000:2.0:1789785075.756800:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548994560 00000100:00100000:2.0:1789785075.756837:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789785075.756845:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+15:8442:x1876725548994560:12345-0@lo:501: 00000100:00100000:2.0:1789785075.756961:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+15:8442:x1876725548994560:12345-0@lo:501: Request processed in 116us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785075.756969:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789785075.757230:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548994560:0@lo:501: 00000100:00100000:1.0:1789785075.757271:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548994688:0@lo:503: 00000100:00100000:1.0:1789785075.757312:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785075.757389:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb35c780 going to sleep for 11 seconds 00000100:00100000:2.0:1789785075.757599:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548994688 00000100:00100000:2.0:1789785075.757604:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548994688 00000100:00100000:2.0:1789785075.757636:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789785075.757643:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:8442:x1876725548994688:12345-0@lo:503: 00000100:00100000:2.0:1789785075.757734:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:8442:x1876725548994688:12345-0@lo:503: Request processed in 91us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785075.757741:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789785075.757848:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548994688:0@lo:503: 00000040:00080000:1.0:1789785075.758490:0:8442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789785075.758579:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548994816:0@lo:502: 00000100:00100000:1.0:1789785075.758620:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785075.758642:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb35c780 going to sleep for 11 seconds 00000100:00100000:0.0:1789785075.758698:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548994816 00000100:00100000:0.0:1789785075.758703:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548994816 00000100:00100000:0.0:1789785075.758741:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789785075.758748:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+15:8442:x1876725548994816:12345-0@lo:502: 00000100:00100000:0.0:1789785075.758834:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+15:8442:x1876725548994816:12345-0@lo:502: Request processed in 86us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785075.758841:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789785075.758946:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548994816:0@lo:502: 00000040:00080000:1.0:1789785075.759467:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789785075.759496:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789785075.759520:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548994944:0@lo:502: 00000100:00100000:1.0:1789785075.759559:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785075.759579:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb35c780 going to sleep for 11 seconds 00000100:00100000:0.0:1789785075.759634:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548994944 00000100:00100000:0.0:1789785075.759639:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548994944 00000100:00100000:0.0:1789785075.759673:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789785075.759687:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+15:8442:x1876725548994944:12345-0@lo:502: 00000100:00100000:0.0:1789785075.759764:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+15:8442:x1876725548994944:12345-0@lo:502: Request processed in 78us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785075.759770:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789785075.759873:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548994944:0@lo:502: 00000040:00080000:1.0:1789785075.759910:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789785075.760031:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789785075.761800:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789785075.761811:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785075.761814:0:8470:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789785075.761821:0:8470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dafb5cd8800 00000020:00000080:0.0:1789785075.761824:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789785075.761835:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785075.761838:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785075.761839:0:8470:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789785075.761842:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789785075.762991:0:8442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789785075.763034:0:8442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789785075.763058:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eac400/0x2f18ee3fd845c028 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c02f expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.763070:0:8442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dae81eac400/0x2f18ee3fd845c028 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c02f expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785075.763123:0:8442:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789785075.763126:0:8442:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dafb5cd8800 10000000:01000000:2.0:1789785075.763129:0:8442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dafb5cd8800 10000000:01000000:2.0:1789785075.763133:0:8442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789785075.763139:0:8442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dafb5cd8800 from 1 10000000:01000000:2.0:1789785075.763141:0:8442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789785075.763292:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845c036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.763307:0:8442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845c036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.763318:0:8442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845c036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785075.763357:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548995072:0@lo:101: 00000100:00100000:2.0:1789785075.763419:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785075.763458:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafb5c33a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789785075.763620:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548995072 00000100:00100000:0.0:1789785075.763627:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548995072 00000100:00100000:0.0:1789785075.763675:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789785075.763684:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:8442:x1876725548995072:12345-0@lo:101: 00010000:00010000:0.0:1789785075.763696:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785075.763709:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dae81eade00/0x2f18ee3fd845c03d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c036 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.763730:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dae81eade00/0x2f18ee3fd845c03d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c036 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.763740:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dae81eade00/0x2f18ee3fd845c03d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c036 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.763749:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eade00, rc 0) 00000100:00100000:0.0:1789785075.763787:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+16:8442:x1876725548995072:12345-0@lo:101: Request processed in 104us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785075.763802:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789785075.765035:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548995072:0@lo:101: 00010000:00010000:2.0:1789785075.765054:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845c036 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c03d expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.765065:0:8442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845c036 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c03d expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785075.765276:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548995200:0@lo:501: 00000100:00100000:2.0:1789785075.765323:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785075.765376:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafb5c33a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789785075.765429:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548995200 00000100:00100000:0.0:1789785075.765435:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548995200 00000100:00100000:0.0:1789785075.765474:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789785075.765482:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+16:8442:x1876725548995200:12345-0@lo:501: 00000100:00100000:3.0:1789785075.766453:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+16:8442:x1876725548995200:12345-0@lo:501: Request processed in 970us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785075.766463:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789785075.766623:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548995200:0@lo:501: 00000100:00100000:2.0:1789785075.766661:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548995328:0@lo:503: 00000100:00100000:2.0:1789785075.766702:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785075.766738:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafb5c33a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789785075.766755:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548995328 00000100:00100000:2.0:1789785075.766993:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548995328 00000100:00100000:2.0:1789785075.767044:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789785075.767059:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+16:8442:x1876725548995328:12345-0@lo:503: 00000100:00100000:3.0:1789785075.767449:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548995328:0@lo:503: 00000100:00100000:2.0:1789785075.768017:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+16:8442:x1876725548995328:12345-0@lo:503: Request processed in 100us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785075.768026:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000040:00080000:3.0:1789785075.768278:0:8442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789785075.768539:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca26300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548995456:0@lo:502: 00000100:00100000:2.0:1789785075.768582:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785075.768634:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafb5c33b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789785075.769109:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548995456 00000100:00100000:3.0:1789785075.769116:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548995456 00000100:00100000:3.0:1789785075.769617:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789785075.769630:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+16:8442:x1876725548995456:12345-0@lo:502: 00000100:00100000:3.0:1789785075.770029:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+16:8442:x1876725548995456:12345-0@lo:502: Request processed in 402us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785075.770119:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca26300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548995456:0@lo:502: 00000040:00080000:1.0:1789785075.770320:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789785075.770364:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789785075.770377:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789785075.770387:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789785075.770398:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789785075.770409:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789785075.770420:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789785075.770431:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789785075.770441:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789785075.770452:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789785075.770476:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789785075.770490:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789785075.770512:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789785075.770523:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789785075.770535:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789785075.770546:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789785075.770558:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789785075.770569:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789785075.770579:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789785075.770588:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789785075.770598:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789785075.770608:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789785075.770618:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789785075.770630:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789785075.770642:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789785075.770653:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789785075.770675:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789785075.770688:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1789785075.770699:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789785075.770710:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1789785075.770721:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1789785075.770733:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1789785075.770745:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1789785075.770755:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1789785075.770765:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1789785075.770775:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1789785075.770785:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1789785075.770816:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548995584:0@lo:502: 00000100:00100000:1.0:1789785075.770861:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785075.770890:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548995584 00000100:00100000:1.0:1789785075.770896:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548995584 00000100:00100000:3.0:1789785075.772445:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789785075.772796:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789785075.772809:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+16:8442:x1876725548995584:12345-0@lo:502: 00000100:00100000:1.0:1789785075.772976:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb35c780 going to sleep for 11 seconds 00000100:00100000:0.0:1789785075.773292:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+16:8442:x1876725548995584:12345-0@lo:502: Request processed in 486us (2429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785075.773299:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789785075.773480:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548995584:0@lo:502: 00000040:00080000:1.0:1789785075.773997:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1789785075.774029:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1789785075.774491:0:8472:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789785075.774516:0:8472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9dae82553370) 00000020:00000080:1.0:1789785075.774540:0:8472:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1789785075.774626:0:8472:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dafb5cd8800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789785075.774629:0:8472:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dafb5cd8800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789785075.774631:0:8472:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dafb5cd8800 3 00010000:00080000:1.0:1789785075.774657:0:8472:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dae8254e000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.146@tcp at head 00010000:00010000:1.0:1789785075.781679:0:8472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1789785075.781893:0:8472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789785075.781941:0:8472:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789785075.781954:0:8472:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2f18ee3fd845c04b 00000100:00080000:1.0:1789785075.781964:0:8472:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789785075.781969:0:8472:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dae8254e000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:1.0:1789785075.782002:0:8472:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafb113c000 x1876725548995712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789785075.782039:0:8472:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789785075.782088:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1876725548995712:0@lo:38: 00000100:00100000:3.0:1789785075.782154:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785075.784322:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548995712 00000100:00100000:1.0:1789785075.784335:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548995712 00000100:00100000:1.0:1789785075.784447:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789785075.784455:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1876725548995712:12345-0@lo:38: 00010000:00080000:1.0:1789785075.784483:0:6534:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:1.0:1789785075.784711:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2f18ee3fd845c052 00000004:00100000:1.0:1789785075.784729:0:6534:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789785075.785052:0:6534:0:(import.c:65:import_set_state_nolock()) ffff9dae8254b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789785075.785143:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1876725548995712:12345-0@lo:38: Request processed in 687us (2988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785075.785152:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789785075.785412:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dafb113c000 x1876725548995712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789785085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785075.785425:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789785075.785433:0:3658:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789785075.785440:0:3658:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789785075.785445:0:3658:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789785075.785447:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dae8254e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789785075.785453:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1876725548995712:0@lo:38: 00000100:00100000:2.0:1789785075.786020:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725548995840:0@lo:400: 00000100:00100000:2.0:1789785075.786062:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785075.786097:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789785075.786104:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725548995968:0@lo:400: 00000100:00100000:2.0:1789785075.786128:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785075.786313:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548995840 00000100:00100000:0.0:1789785075.786319:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548995840 00000100:00100000:0.0:1789785075.786393:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789785075.786402:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725548995840:12345-0@lo:400: 00000100:00100000:0.0:1789785075.786446:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725548995840:12345-0@lo:400: Request processed in 47us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785075.786453:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789785075.786605:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548995968 00000100:00100000:1.0:1789785075.786609:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548995968 00000100:00100000:1.0:1789785075.786637:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789785075.786643:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacaeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725548995968:12345-0@lo:400: 00000100:00100000:1.0:1789785075.786672:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacaeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725548995968:12345-0@lo:400: Request processed in 30us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785075.786678:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789785075.786710:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725548996096:0@lo:400: 00000100:00100000:2.0:1789785075.786826:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785075.786904:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789785075.787018:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548996096 00000100:00100000:1.0:1789785075.787022:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548996096 00000100:00100000:1.0:1789785075.787049:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789785075.787055:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725548996096:12345-0@lo:400: 00000100:00100000:1.0:1789785075.787085:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725548996096:12345-0@lo:400: Request processed in 31us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785075.787090:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789785075.787125:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725548996224:0@lo:400: 00000100:00100000:2.0:1789785075.787150:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789785075.787328:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dafb113d500 x1876725548996096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785075.787418:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548996224 00000100:00100000:1.0:1789785075.787422:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548996224 00000100:00100000:1.0:1789785075.787445:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789785075.787450:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacaeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725548996224:12345-0@lo:400: 00000100:00100000:1.0:1789785075.787480:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacaeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725548996224:12345-0@lo:400: Request processed in 29us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785075.787492:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789785075.787616:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725548996096:0@lo:400: 00000100:00100000:2.0:1789785075.787637:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725548996224:0@lo:400: 00000100:00100000:2.0:1789785075.787665:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725548995968:0@lo:400: 00010000:00080000:2.0:1789785075.787676:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dafb113ce00 x1876725548995840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785075.787697:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725548995840:0@lo:400: 00000020:01000004:1.0:1789785075.788683:0:8472:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789785075.788698:0:8472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9dae825519b8) 00000020:00000080:1.0:1789785075.788715:0:8472:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1789785075.788824:0:8472:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dafb5cd8800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789785075.788828:0:8472:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dafb5cd8800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789785075.788991:0:8472:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dafb5cd8800 3 00010000:00080000:1.0:1789785075.789033:0:8472:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dafb729d800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.146@tcp at head 00010000:00010000:1.0:1789785075.792169:0:8472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1789785075.792585:0:8472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789785075.792626:0:8472:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789785075.792638:0:8472:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x2f18ee3fd845c060 00000100:00080000:1.0:1789785075.792649:0:8472:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789785075.792654:0:8472:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9dafb729d800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:1.0:1789785075.792689:0:8472:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafb113c000 x1876725548996352/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789785075.792715:0:8472:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789785075.792879:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3658:1876725548996352:0@lo:38: 00000100:00100000:2.0:1789785075.792958:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785075.793429:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548996352 00000100:00100000:1.0:1789785075.793436:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548996352 00000100:00100000:1.0:1789785075.793475:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789785075.793483:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacaea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1876725548996352:12345-0@lo:38: 00010000:00080000:1.0:1789785075.793509:0:7896:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:1.0:1789785075.793547:0:7896:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x2f18ee3fd845c067 00000004:00100000:1.0:1789785075.793559:0:7896:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789785075.793582:0:7896:0:(import.c:65:import_set_state_nolock()) ffff9dae8254a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789785075.793629:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacaea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1876725548996352:12345-0@lo:38: Request processed in 146us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785075.793640:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:1.0:1789785075.793704:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00010000:00080000:2.0:1789785075.794200:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dafb113c000 x1876725548996352/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789785085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785075.794212:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789785075.794278:0:3658:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789785075.794286:0:3658:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789785075.794290:0:3658:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789785075.794292:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dafb729d800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789785075.794298:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3658:1876725548996352:0@lo:38: 00000020:01000000:2.0:1789785075.794327:0:8442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1789785075.794386:0:8442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789785075.794398:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845c036 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c03d expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.794407:0:8442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845c036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c03d expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789785075.794451:0:8442:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789785075.794454:0:8442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789785075.794455:0:8442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789785075.794456:0:8442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789785075.794457:0:8442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789785075.794459:0:8442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789785075.794460:0:8442:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789785075.794461:0:8442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789785075.794463:0:8442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789785075.794469:0:8442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789785075.794470:0:8442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789785075.794473:0:8442:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1789785075.794476:0:8442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789785075.794477:0:8442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789785075.794478:0:8442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789785075.794479:0:8442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789785075.794480:0:8442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789785075.794481:0:8442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789785075.794482:0:8442:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789785075.794483:0:8442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789785075.794484:0:8442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789785075.794485:0:8442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789785075.794486:0:8442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789785075.794503:0:8442:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789785075.794515:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548996480:0@lo:253: 00000100:00100000:2.0:1789785075.794804:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785075.794940:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafb5c33540 going to sleep for 11 seconds 00000100:00100000:0.0:1789785075.795071:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548996480 00000100:00100000:0.0:1789785075.795077:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548996480 00000100:00100000:0.0:1789785075.795147:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789785075.795163:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+16:8442:x1876725548996480:12345-0@lo:253: 20000000:01000000:0.0:1789785075.795186:0:6528:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789785075.795198:0:6528:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789785075.812625:0:6528:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789785075.812678:0:6528:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789785075.814603:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+16:8442:x1876725548996480:12345-0@lo:253: Request processed in 19441us (19792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785075.814616:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789785075.814768:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:8442:1876725548996480:0@lo:253: 10000000:01000000:3.0:1789785075.814783:0:8442:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789785075.814786:0:8442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789785075.814787:0:8442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789785075.814789:0:8442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789785075.814789:0:8442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789785075.814791:0:8442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789785075.814792:0:8442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789785075.814793:0:8442:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789785075.814795:0:8442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789785075.814796:0:8442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789785075.814798:0:8442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789785075.814799:0:8442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789785075.814813:0:8442:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1789785075.815541:0:6549:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789785075.815615:0:6549:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789785075.815636:0:6549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dafc2051000/0x2f18ee3fd845c06e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785075.815650:0:6549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc2051e00/0x2f18ee3fd845bf64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bf5d expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785075.815658:0:6549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9daf80031600/0x2f18ee3fd845bf80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bf79 expref: 15 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785075.815665:0:6549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dafc2051000/0x2f18ee3fd845c06e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785075.815701:0:6549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9daf80031600/0x2f18ee3fd845bf80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845bf79 expref: 15 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785075.815716:0:6549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9daf80031600/0x2f18ee3fd845bf80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf79 expref: 15 pid: 6527 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785075.815730:0:6549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1876725548996608:0@lo:104: 00000100:00100000:1.0:1789785075.815773:0:6549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789785075.815831:0:6549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc2051e00/0x2f18ee3fd845bf64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845bf5d expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785075.815840:0:6549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dafc2051e00/0x2f18ee3fd845bf64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf5d expref: 15 pid: 6526 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785075.815841:0:6516:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789785075.815854:0:6549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1876725548996736:0@lo:104: 00000100:00100000:0.0:1789785075.815859:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548996608 00000100:00100000:0.0:1789785075.815873:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548996608 00000100:00100000:1.0:1789785075.815899:0:6549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785075.815921:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548996736 00000100:00100000:0.0:1789785075.815926:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548996736 00000100:00100000:0.0:1789785075.815941:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789785075.815950:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5d03450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+4:6549:x1876725548996608:12345-0@lo:104: 00010000:00010000:0.0:1789785075.815962:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08000/0x2f18ee3fd845bf79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845bf80 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.816017:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789785075.816023:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5d03450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+4:6549:x1876725548996608:12345-0@lo:104: Request processed in 75us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785075.816024:0:6549:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb35c780 going to sleep for 11 seconds 00000100:00100000:0.0:1789785075.816034:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789785075.816044:0:6549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1876725548996608:0@lo:104: 00000100:00100000:0.0:1789785075.816074:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789785075.816082:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+3:6549:x1876725548996736:12345-0@lo:104: 00010000:00010000:0.0:1789785075.816089:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845bf5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845bf64 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.816133:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789785075.816138:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+3:6549:x1876725548996736:12345-0@lo:104: Request processed in 58us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785075.816145:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1789785075.816160:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789785075.816166:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08000/0x2f18ee3fd845bf79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845bf80 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.816173:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b08000 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:0.0:1789785075.816177:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08000/0x2f18ee3fd845bf79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845bf80 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.816195:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08000/0x2f18ee3fd845bf79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845bf80 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789785075.816203:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08000/0x2f18ee3fd845bf79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845bf80 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785075.816209:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789785075.816244:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08000/0x2f18ee3fd845bf79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bf80 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.816251:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789785075.816264:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08000/0x2f18ee3fd845bf79 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bf80 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.816270:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08000/0x2f18ee3fd845bf79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bf80 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.816281:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789785075.816284:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845bf5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845bf64 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.816288:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09c00 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:0.0:1789785075.816290:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845bf5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845bf64 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.816296:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845bf5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845bf64 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789785075.816301:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845bf5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845bf64 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785075.816311:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789785075.816324:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845bf5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bf64 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.816328:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789785075.816333:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845bf5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bf64 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.816363:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845bf5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bf64 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785075.816374:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785075.816376:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785075.816377:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785075.816433:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785075.816445:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725548996864:0@lo:103: 00000100:00100000:2.0:1789785075.816476:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785075.816512:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789785075.816517:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725548996992:0@lo:103: 00000100:00100000:2.0:1789785075.816547:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785075.816576:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548996864 00000100:00100000:2.0:1789785075.816580:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548996864 00010000:00010000:2.0:1789785075.816599:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9daf80031600/0x2f18ee3fd845bf80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf79 expref: 16 pid: 6527 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785075.816619:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548996992 00000100:00100000:2.0:1789785075.816627:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548996992 00010000:00010000:2.0:1789785075.816640:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc2051e00/0x2f18ee3fd845bf64 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf5d expref: 17 pid: 6526 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785075.816657:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789785075.816662:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+17:3659:x1876725548996864:12345-0@lo:103: 00010000:00010000:2.0:1789785075.816671:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785075.816676:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9daf80031600/0x2f18ee3fd845bf80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf79 expref: 17 pid: 6527 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.816687:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9daf80031600/0x2f18ee3fd845bf80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf79 expref: 17 pid: 6527 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.816699:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9daf80031600/0x2f18ee3fd845bf80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845bf79 expref: 17 pid: 6527 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.816711:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785075.816738:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+16:3659:x1876725548996864:12345-0@lo:103: Request processed in 76us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785075.816744:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789785075.816756:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789785075.816763:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacaeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+15:3659:x1876725548996992:12345-0@lo:103: 00010000:00010000:2.0:1789785075.816770:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785075.816775:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc2051e00/0x2f18ee3fd845bf64 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf5d expref: 15 pid: 6526 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.816783:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc2051e00/0x2f18ee3fd845bf64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845bf5d expref: 15 pid: 6526 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.816793:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dafc2051000/0x2f18ee3fd845c06e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.816807:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc2051000/0x2f18ee3fd845c06e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789785075.816818:0:6519:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004777175s 00010000:00010000:2.0:1789785075.816822:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dafc2051000/0x2f18ee3fd845c06e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.816829:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dafc2051000/0x2f18ee3fd845c06e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.816836:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dafc2051000/0x2f18ee3fd845c06e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.816842:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dafc2051000/0x2f18ee3fd845c06e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.816847:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc2051000 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:2.0:1789785075.816851:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dafc2051000/0x2f18ee3fd845c06e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.816858:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dafc2051000/0x2f18ee3fd845c06e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.816865:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dafc2051000/0x2f18ee3fd845c06e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785075.816874:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785075.816904:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacaeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+15:3659:x1876725548996992:12345-0@lo:103: Request processed in 141us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785075.816910:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789785075.816949:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725548996992:0@lo:103: 00000100:00100000:2.0:1789785075.816956:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725548996864:0@lo:103: 00010000:00010000:1.0:1789785075.817242:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc2051e00/0x2f18ee3fd845bf64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845bf5d expref: 14 pid: 6526 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785075.817253:0:6549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1876725548996736:0@lo:104: 00010000:00010000:1.0:1789785075.817269:0:6549:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dafc2051000/0x2f18ee3fd845c06e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785075.817276:0:6549:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dafc2051000/0x2f18ee3fd845c06e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785075.817282:0:6549:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dafc2051000/0x2f18ee3fd845c06e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785075.817288:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc2051000/0x2f18ee3fd845c06e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1789785075.822894:0:8442:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1789785075.823046:0:8442:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789785075.823210:0:8442:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1789785075.823361:0:8442:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789785075.823530:0:8442:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1789785075.823715:0:8442:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1789785075.828447:0:8442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789785075.848852:0:8442:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789785075.848861:0:8442:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789785075.848891:0:8442:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789785075.848989:0:8442:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.146@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789785075.849027:0:8442:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789785075.849056:0:8442:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1789785075.849979:0:8442:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789785075.850167:0:8442:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1789785076.741079:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789785076.867423:0:8528:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789785076.867829:0:8528:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789785077.062912:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725548997120:0@lo:41: 00000100:00100000:3.0:1789785077.062978:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785077.063298:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548997120 00000100:00100000:1.0:1789785077.063306:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548997120 00000100:00100000:1.0:1789785077.063370:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789785077.063380:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725548997120:12345-0@lo:41: 00000004:00000024:1.0:1789785077.063411:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1789785077.063455:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725548997120:12345-0@lo:41: Request processed in 76us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785077.063462:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789785077.063850:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725548997120:0@lo:41: 00010000:00010000:2.0:1789785077.762658:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785078.786598:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785079.812475:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785080.647532:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789785080.647557:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725548997248:0@lo:41: 00000100:00100000:0.0:1789785080.647735:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785080.647840:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548997248 00000100:00100000:2.0:1789785080.647848:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548997248 00000100:00100000:2.0:1789785080.647902:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789785080.647913:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725548997248:12345-0@lo:41: 00000004:00000024:2.0:1789785080.647945:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1789785080.648002:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725548997248:12345-0@lo:41: Request processed in 92us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785080.648010:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789785080.648101:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725548997248:0@lo:41: 00010000:00010000:0.0:1789785080.834680:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785081.155776:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725548997376:0@lo:400: 00000100:00100000:1.0:1789785081.155917:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785081.155984:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725548997888:0@lo:400: 00000100:00100000:1.0:1789785081.156012:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785081.156039:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789785081.156046:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725548997504:0@lo:400: 00000100:00100000:1.0:1789785081.156072:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785081.156168:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725548998016:0@lo:400: 00000100:00100000:1.0:1789785081.156192:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785081.156235:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725548997632:0@lo:400: 00000100:00100000:1.0:1789785081.156258:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785081.156277:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725548998144:0@lo:400: 00000100:00100000:1.0:1789785081.156301:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785081.156318:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789785081.156324:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725548997760:0@lo:400: 00000100:00100000:1.0:1789785081.156368:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785081.156400:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548997888 00000100:00100000:1.0:1789785081.156408:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548997888 00000100:00100000:1.0:1789785081.156449:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548997632 00000100:00100000:1.0:1789785081.156453:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548997632 00000100:00100000:1.0:1789785081.156468:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789785081.156476:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725548997888:12345-0@lo:400: 00000100:00100000:1.0:1789785081.156529:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725548997888:12345-0@lo:400: Request processed in 52us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785081.156536:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789785081.156553:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789785081.156559:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725548997632:12345-0@lo:400: 00000100:00100000:1.0:1789785081.156667:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725548997632:12345-0@lo:400: Request processed in 107us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785081.156685:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789785081.156705:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548997504 00000100:00100000:1.0:1789785081.156709:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548997504 00000100:00100000:1.0:1789785081.156727:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548998016 00000100:00100000:1.0:1789785081.156730:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548998016 00000100:00100000:1.0:1789785081.156752:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548998144 00000100:00100000:1.0:1789785081.156755:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548998144 00000100:00100000:1.0:1789785081.156767:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548997760 00000100:00100000:1.0:1789785081.156769:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548997760 00000100:00100000:1.0:1789785081.156782:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789785081.156787:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725548997504:12345-0@lo:400: 00000100:00100000:1.0:1789785081.157747:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725548997504:12345-0@lo:400: Request processed in 953us (1668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785081.157757:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789785081.157779:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789785081.157788:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725548998016:12345-0@lo:400: 00000100:00100000:1.0:1789785081.158245:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725548998016:12345-0@lo:400: Request processed in 457us (2050us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785081.158252:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789785081.158267:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789785081.158275:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725548998144:12345-0@lo:400: 00000100:00100000:1.0:1789785081.158301:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725548998144:12345-0@lo:400: Request processed in 28us (1999us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785081.158306:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789785081.158317:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789785081.158323:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725548997760:12345-0@lo:400: 00000100:00100000:1.0:1789785081.158367:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725548997760:12345-0@lo:400: Request processed in 44us (1998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785081.158384:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1789785081.158428:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789785081.158432:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789785081.158464:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafb113d500 x1876725548997760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785081.158478:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725548997760:0@lo:400: 00000100:00100000:1.0:1789785081.158490:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725548997632:0@lo:400: 00010000:00080000:1.0:1789785081.158499:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae828ff480 x1876725548998144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785081.158507:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725548998144:0@lo:400: 00010000:00080000:1.0:1789785081.158542:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafb113c000 x1876725548997504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785081.158551:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725548997504:0@lo:400: 00010000:00080000:1.0:1789785081.158561:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae828fc380 x1876725548998016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785081.158568:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725548998016:0@lo:400: 00000100:00100000:1.0:1789785081.158578:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725548997888:0@lo:400: 00000100:00100000:0.0:1789785081.159520:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548997376 00000100:00100000:0.0:1789785081.159529:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548997376 00000100:00100000:0.0:1789785081.159749:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789785081.159760:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+14:3659:x1876725548997376:12345-0@lo:400: 00000100:00100000:0.0:1789785081.159904:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+14:3659:x1876725548997376:12345-0@lo:400: Request processed in 146us (3987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785081.159911:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789785081.159988:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725548997376:0@lo:400: 10000000:01000000:1.0:1789785081.666665:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789785081.666673:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dafc189c800 from 30 10000000:01000000:1.0:1789785081.666679:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789785081.666721:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc2050200/0x2f18ee3fd845c075 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785081.666745:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc2050200/0x2f18ee3fd845c075 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785081.666756:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc2050200/0x2f18ee3fd845c075 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785081.666779:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548998272:0@lo:101: 00000100:00100000:1.0:1789785081.666844:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785081.666950:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb35c300 going to sleep for 11 seconds 00000100:00100000:0.0:1789785081.681191:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548998272 00000100:00100000:0.0:1789785081.681206:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548998272 00000100:00100000:0.0:1789785081.681283:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789785081.681293:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+14:6531:x1876725548998272:12345-0@lo:101: 00010000:00010000:0.0:1789785081.681308:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785081.681325:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dae81ead000/0x2f18ee3fd845c07c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c075 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785081.681368:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dae81ead000/0x2f18ee3fd845c07c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c075 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785081.681378:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dae81ead000/0x2f18ee3fd845c07c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c075 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785081.681386:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81ead000, rc 0) 00000100:00100000:0.0:1789785081.681464:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+15:6531:x1876725548998272:12345-0@lo:101: Request processed in 174us (14620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785081.681471:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789785081.681531:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548998272:0@lo:101: 00010000:00010000:0.0:1789785081.681549:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc2050200/0x2f18ee3fd845c075 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c07c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785081.681572:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc2050200/0x2f18ee3fd845c075 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c07c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785081.681646:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eaa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548998400:0@lo:501: 00000100:00100000:0.0:1789785081.681680:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785081.681707:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf987f5780 going to sleep for 11 seconds 00000100:00100000:0.0:1789785081.681721:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548998400 00000100:00100000:0.0:1789785081.681725:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548998400 00000100:00100000:0.0:1789785081.681747:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789785081.681754:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:6531:x1876725548998400:12345-0@lo:501: 00000100:00100000:0.0:1789785081.681864:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:6531:x1876725548998400:12345-0@lo:501: Request processed in 110us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785081.681871:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789785081.681900:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eaa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548998400:0@lo:501: 00000100:00100000:0.0:1789785081.681925:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eaa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548998528:0@lo:503: 00000100:00100000:0.0:1789785081.681960:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785081.681985:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf987f5780 going to sleep for 11 seconds 00000100:00100000:0.0:1789785081.681994:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548998528 00000100:00100000:0.0:1789785081.681997:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548998528 00000100:00100000:0.0:1789785081.682027:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789785081.682033:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:6531:x1876725548998528:12345-0@lo:503: 00000100:00100000:0.0:1789785081.682102:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:6531:x1876725548998528:12345-0@lo:503: Request processed in 68us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785081.682108:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789785081.682144:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eaa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548998528:0@lo:503: 00000100:00100000:0.0:1789785081.682364:0:8797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eaa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:8797:1876725548998656:0@lo:502: 00000100:00100000:0.0:1789785081.682396:0:8797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785081.682412:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548998656 00000100:00100000:0.0:1789785081.682415:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548998656 00000100:00100000:0.0:1789785081.682432:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789785081.682438:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:8797:x1876725548998656:12345-0@lo:502: 00000100:00100000:0.0:1789785081.682498:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:8797:x1876725548998656:12345-0@lo:502: Request processed in 60us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785081.682504:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789785081.682532:0:8797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf987f5180 going to sleep for 11 seconds 00000100:00100000:0.0:1789785081.682543:0:8797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eaa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:8797:1876725548998656:0@lo:502: 00000100:00100000:0.0:1789785081.682580:0:8797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eaa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:8797:1876725548998784:0@lo:502: 00000100:00100000:0.0:1789785081.682608:0:8797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785081.682625:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548998784 00000100:00100000:0.0:1789785081.682628:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548998784 00000100:00100000:0.0:1789785081.682645:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789785081.682651:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:8797:x1876725548998784:12345-0@lo:502: 00000100:00100000:0.0:1789785081.682701:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:8797:x1876725548998784:12345-0@lo:502: Request processed in 50us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785081.682707:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789785081.682731:0:8797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf987f5180 going to sleep for 11 seconds 00000100:00100000:0.0:1789785081.682741:0:8797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eaa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:8797:1876725548998784:0@lo:502: 00000040:00080000:0.0:1789785081.682757:0:8797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789785081.682797:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789785081.682808:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789785081.682815:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc2050200/0x2f18ee3fd845c075 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c07c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785081.682829:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc2050200/0x2f18ee3fd845c075 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c07c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785081.682838:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789785081.682840:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dafc189c800 from 5 10000000:01000000:0.0:1789785081.682843:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789785081.682864:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81ead800/0x2f18ee3fd845c083 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785081.682871:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dae81ead800/0x2f18ee3fd845c083 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785081.682880:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dae81ead800/0x2f18ee3fd845c083 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785081.682891:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eaa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548998912:0@lo:101: 00000100:00100000:0.0:1789785081.682914:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785081.682927:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf987f5180 going to sleep for 11 seconds 00000100:00100000:0.0:1789785081.682938:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548998912 00000100:00100000:0.0:1789785081.682941:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548998912 00000100:00100000:0.0:1789785081.682960:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789785081.682978:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:6531:x1876725548998912:12345-0@lo:101: 00010000:00010000:0.0:1789785081.682985:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785081.682994:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dae81eaca00/0x2f18ee3fd845c08a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c083 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785081.683011:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dae81eaca00/0x2f18ee3fd845c08a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c083 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785081.683030:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dae81eaca00/0x2f18ee3fd845c08a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c083 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785081.683038:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eaca00, rc 0) 00000100:00100000:0.0:1789785081.683068:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+16:6531:x1876725548998912:12345-0@lo:101: Request processed in 90us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785081.683073:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789785081.683101:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eaa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548998912:0@lo:101: 00010000:00010000:0.0:1789785081.683112:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dae81ead800/0x2f18ee3fd845c083 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c08a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785081.683121:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dae81ead800/0x2f18ee3fd845c083 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c08a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785081.683159:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eaa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548999040:0@lo:256: 00000100:00100000:0.0:1789785081.683187:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785081.683199:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf987f5180 going to sleep for 11 seconds 00000100:00100000:0.0:1789785081.683210:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548999040 00000100:00100000:0.0:1789785081.683213:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548999040 00000100:00100000:0.0:1789785081.683233:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789785081.683239:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+16:6531:x1876725548999040:12345-0@lo:256: 20000000:01000000:0.0:1789785081.683249:0:6526:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789785081.683263:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789785081.683266:0:6526:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1789785081.683331:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+16:6531:x1876725548999040:12345-0@lo:256: Request processed in 91us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785081.683357:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789785081.683392:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eaa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548999040:0@lo:256: 10000000:01000000:0.0:1789785081.683430:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789785081.683435:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81ead800/0x2f18ee3fd845c083 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c08a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785081.683442:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dae81ead800/0x2f18ee3fd845c083 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c08a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785081.683449:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789785081.683450:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1789785081.683453:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789785081.683465:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81ead200/0x2f18ee3fd845c091 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785081.683471:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dae81ead200/0x2f18ee3fd845c091 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785081.683478:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dae81ead200/0x2f18ee3fd845c091 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785081.683487:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eaa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548999168:0@lo:101: 00000100:00100000:0.0:1789785081.683509:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785081.683520:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf987f5180 going to sleep for 11 seconds 00000100:00100000:0.0:1789785081.683529:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548999168 00000100:00100000:0.0:1789785081.683531:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548999168 00000100:00100000:0.0:1789785081.683548:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789785081.683552:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+16:6531:x1876725548999168:12345-0@lo:101: 00010000:00010000:0.0:1789785081.683558:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785081.683566:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dae81eacc00/0x2f18ee3fd845c098 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c091 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785081.683584:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dae81eacc00/0x2f18ee3fd845c098 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c091 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785081.683591:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dae81eacc00/0x2f18ee3fd845c098 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c091 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785081.683597:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eacc00, rc 0) 00000100:00100000:0.0:1789785081.683622:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725548999168:12345-0@lo:101: Request processed in 69us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785081.683627:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789785081.683652:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eaa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548999168:0@lo:101: 00010000:00010000:0.0:1789785081.683661:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dae81ead200/0x2f18ee3fd845c091 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c098 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785081.683668:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dae81ead200/0x2f18ee3fd845c091 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c098 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785081.683704:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eaa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548999296:0@lo:501: 00000100:00100000:0.0:1789785081.683725:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785081.683737:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf987f5180 going to sleep for 11 seconds 00000100:00100000:0.0:1789785081.683746:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548999296 00000100:00100000:0.0:1789785081.683749:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548999296 00000100:00100000:0.0:1789785081.683767:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789785081.683772:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725548999296:12345-0@lo:501: 00000100:00100000:0.0:1789785081.683873:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725548999296:12345-0@lo:501: Request processed in 99us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785081.683879:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789785081.684358:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eaa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548999296:0@lo:501: 00000100:00100000:2.0:1789785081.684386:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548999424:0@lo:503: 00000100:00100000:2.0:1789785081.684429:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785081.684443:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf85889900 going to sleep for 11 seconds 00000100:00100000:0.0:1789785081.690333:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548999424 00000100:00100000:0.0:1789785081.690363:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548999424 00000100:00100000:0.0:1789785081.690424:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789785081.690435:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725548999424:12345-0@lo:503: 00000100:00100000:0.0:1789785081.690612:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725548999424:12345-0@lo:503: Request processed in 178us (6181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785081.690620:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789785081.693019:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725548999424:0@lo:503: 00000100:00100000:2.0:1789785081.700585:0:8798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:8798:1876725548999552:0@lo:502: 00000100:00100000:2.0:1789785081.700675:0:8798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785081.700725:0:8798:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf85889600 going to sleep for 11 seconds 00000100:00100000:1.0:1789785081.700850:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548999552 00000100:00100000:1.0:1789785081.700858:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548999552 00000100:00100000:1.0:1789785081.700903:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789785081.700912:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+17:8798:x1876725548999552:12345-0@lo:502: 00000100:00100000:1.0:1789785081.701059:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+17:8798:x1876725548999552:12345-0@lo:502: Request processed in 146us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785081.701069:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789785081.712906:0:8798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:8798:1876725548999552:0@lo:502: 00000020:01000000:2.0:1789785081.712953:0:8798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789785081.713013:0:8798:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789785081.713024:0:8798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785081.713026:0:8798:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789785081.713033:0:8798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789785081.713037:0:8798:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.146@tcp to nid 0x20000c0a8cb92 (192.168.203.146@tcp) 00000020:01000000:2.0:1789785081.713069:0:8798:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789785081.713072:0:8798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789785081.713086:0:8798:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9dafbb224d28) 00000020:00000080:2.0:1789785081.713108:0:8798:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1789785081.713113:0:8798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789785081.713212:0:8798:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1789785081.713218:0:8798:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789785081.713226:0:8798:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f18ee3fd845c0a6 00010000:00080000:2.0:1789785081.713255:0:8798:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dae81eba000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.146@tcp at head 00010000:00010000:2.0:1789785081.713541:0:8798:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1789785081.723994:0:8798:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789785081.724019:0:8798:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789785081.724252:0:8798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789785081.724500:0:8798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789785081.724579:0:8798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789785081.724664:0:8798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1789785081.730690:0:8802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789785081.730698:0:8802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789785081.733045:0:8798:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789785081.733059:0:8798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789785081.733097:0:8798:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789785081.733118:0:8798:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f18ee3fd845c0ad 00000100:00080000:2.0:1789785081.733127:0:8798:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789785081.733133:0:8798:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9dae81eba000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:2.0:1789785081.733165:0:8798:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafacae9500 x1876725548999680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789785081.733193:0:8798:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789785081.733266:0:8798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789785081.733270:0:8798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785081.733272:0:8798:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789785081.733276:0:8798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789785081.733279:0:8798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785081.733281:0:8798:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789785081.733284:0:8798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789785081.733286:0:8798:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789785081.733310:0:8798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacaea300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:8798:1876725548999808:0@lo:502: 00000100:00100000:3.0:1789785081.733427:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725548999680:0@lo:8: 00000100:00100000:3.0:1789785081.733493:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785081.733606:0:8798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785081.733624:0:8798:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf85889cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789785081.736433:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548999680 00000100:00100000:0.0:1789785081.736448:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548999680 00000100:00100000:0.0:1789785081.736498:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789785081.736508:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3658:x1876725548999680:12345-0@lo:8: 00000100:00100000:3.0:1789785081.736512:0:8450:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789785081.736523:0:8450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:0.0:1789785081.736539:0:8449:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:0.0:1789785081.736567:0:8449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f18ee3fd845c0b4 00002000:00100000:0.0:1789785081.736606:0:8449:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9dae81ec8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396e ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1789785081.736610:0:8449:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1789785081.736613:0:8449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789785081.736673:0:8449:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789785081.736882:0:8449:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1789785081.736908:0:8449:0:(import.c:65:import_set_state_nolock()) ffff9dae81ecf800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789785081.737007:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3658:x1876725548999680:12345-0@lo:8: Request processed in 499us (3512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785081.737014:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789785081.737040:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548999808 00000100:00100000:0.0:1789785081.737044:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548999808 00000100:00100000:0.0:1789785081.737072:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789785081.737079:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+17:8798:x1876725548999808:12345-0@lo:502: 00010000:00080000:3.0:1789785081.737167:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafacae9500 x1876725548999680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789785091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785081.737179:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789785081.737187:0:3658:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00100000:0.0:1789785081.737189:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+17:8798:x1876725548999808:12345-0@lo:502: Request processed in 108us (3581us total) trans 0 rc 0/0 00000100:00080000:3.0:1789785081.737196:0:3658:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789785081.737203:0:3658:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789785081.737206:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dae81eba000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789785081.737207:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000004:00080000:3.0:1789785081.737222:0:3658:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789785081.737228:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725548999680:0@lo:8: 00000100:00100000:3.0:1789785081.737283:0:8803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8803:1876725548999936:0@lo:700: 00000100:00100000:3.0:1789785081.737317:0:8803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785081.737527:0:8803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafb6226600 going to sleep for 11 seconds 00000100:00100000:0.0:1789785081.738437:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725548999936 00000100:00100000:0.0:1789785081.738446:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725548999936 00000100:00100000:0.0:1789785081.738499:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789785081.738507:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8803:x1876725548999936:12345-0@lo:700: 00000100:00100000:0.0:1789785081.738564:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eab800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8458:1876725549000064:0@lo:700: 00000100:00100000:0.0:1789785081.738612:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785081.738637:0:8458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf987f5000 going to sleep for 11 seconds 00000100:00100000:0.0:1789785081.738654:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549000064 00000100:00100000:0.0:1789785081.738657:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549000064 00000100:00100000:0.0:1789785081.738684:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789785081.738691:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8458:x1876725549000064:12345-0@lo:700: 00000100:00080000:1.0:1789785081.738835:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789785081.739199:0:8798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacaea300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:8798:1876725548999808:0@lo:502: 00000020:01000000:2.0:1789785081.739237:0:8798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789785081.739245:0:8798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785081.739247:0:8798:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789785081.739253:0:8798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000004:00080000:2.0:1789785081.739411:0:8802:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789785081.739466:0:8802:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 189993127457ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789785081.739473:0:8802:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000020:01000000:1.0:1789785081.739706:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1789785081.739730:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789785081.739741:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81ead200/0x2f18ee3fd845c091 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c098 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785081.739753:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dae81ead200/0x2f18ee3fd845c091 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c098 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785081.739763:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789785081.739773:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9daf89061800 from 30 10000000:01000000:1.0:1789785081.739777:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789785081.739807:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc2051a00/0x2f18ee3fd845c0bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785081.739816:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc2051a00/0x2f18ee3fd845c0bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785081.739825:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc2051a00/0x2f18ee3fd845c0bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785081.739843:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549000192:0@lo:101: 00000100:00100000:1.0:1789785081.739890:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785081.739926:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb35c300 going to sleep for 11 seconds 00000100:00100000:2.0:1789785081.740428:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549000192 00000100:00100000:2.0:1789785081.740436:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549000192 00000100:00100000:2.0:1789785081.740476:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789785081.740486:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725549000192:12345-0@lo:101: 00010000:00010000:2.0:1789785081.740498:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785081.740509:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1b09600/0x2f18ee3fd845c0c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c0bb expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785081.740531:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1b09600/0x2f18ee3fd845c0c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c0bb expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785081.740540:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1b09600/0x2f18ee3fd845c0c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c0bb expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785081.740547:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b09600, rc 0) 00000100:00100000:2.0:1789785081.740587:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+18:6531:x1876725549000192:12345-0@lo:101: Request processed in 103us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785081.740593:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789785081.740856:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549000192:0@lo:101: 00010000:00010000:1.0:1789785081.740870:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc2051a00/0x2f18ee3fd845c0bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c0c2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785081.740879:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc2051a00/0x2f18ee3fd845c0bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c0c2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785081.740936:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549000320:0@lo:501: 00000100:00100000:1.0:1789785081.743807:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785081.743854:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb35c300 going to sleep for 11 seconds 00000100:00100000:1.0:1789785081.743873:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549000320 00000100:00100000:1.0:1789785081.743881:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549000320 00000100:00100000:1.0:1789785081.743922:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789785081.743931:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+18:6531:x1876725549000320:12345-0@lo:501: 00000100:00100000:1.0:1789785081.744429:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+18:6531:x1876725549000320:12345-0@lo:501: Request processed in 498us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785081.744444:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789785081.744638:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549000320:0@lo:501: 00000100:00100000:0.0:1789785081.744683:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81ea8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549000448:0@lo:503: 00000100:00100000:0.0:1789785081.744729:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785081.744774:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf83f30f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789785081.744886:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549000448 00000100:00100000:1.0:1789785081.744892:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549000448 00000100:00100000:1.0:1789785081.744925:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789785081.744933:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+18:6531:x1876725549000448:12345-0@lo:503: 00000100:00100000:1.0:1789785081.747447:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+18:6531:x1876725549000448:12345-0@lo:503: Request processed in 2506us (2709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785081.747459:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000004:00080000:0.0:1789785081.749074:0:7465:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1789785081.749867:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81ea8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549000448:0@lo:503: 00000100:00100000:1.0:1789785081.752267:0:8807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:8807:1876725549000576:0@lo:502: 00000100:00100000:1.0:1789785081.752364:0:8807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785081.752401:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549000576 00000100:00100000:1.0:1789785081.752408:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549000576 00000100:00100000:1.0:1789785081.752450:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789785081.752458:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+18:8807:x1876725549000576:12345-0@lo:502: 00000100:00100000:1.0:1789785081.752570:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+18:8807:x1876725549000576:12345-0@lo:502: Request processed in 112us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785081.752577:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789785081.752624:0:8807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8a8a2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789785081.752645:0:8807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:8807:1876725549000576:0@lo:502: 00000100:00100000:1.0:1789785081.752688:0:8807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:8807:1876725549000704:0@lo:502: 00000100:00100000:1.0:1789785081.752723:0:8807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785081.752744:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549000704 00000100:00100000:1.0:1789785081.752748:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549000704 00000100:00100000:1.0:1789785081.752769:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789785081.752775:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+18:8807:x1876725549000704:12345-0@lo:502: 00000100:00100000:1.0:1789785081.752840:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+18:8807:x1876725549000704:12345-0@lo:502: Request processed in 64us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785081.752846:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789785081.752872:0:8807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf9823fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789785081.752884:0:8807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:8807:1876725549000704:0@lo:502: 00000040:00080000:1.0:1789785081.752901:0:8807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789785081.752954:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789785081.752984:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789785081.752995:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc2051a00/0x2f18ee3fd845c0bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c0c2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785081.753006:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc2051a00/0x2f18ee3fd845c0bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c0c2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785081.753016:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789785081.753019:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9daf89061800 from 5 10000000:01000000:1.0:1789785081.753022:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789785081.753044:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c0c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785081.753052:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c0c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785081.753061:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c0c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785081.753072:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549000832:0@lo:101: 00000100:00100000:1.0:1789785081.753097:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785081.753111:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf9823fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789785081.753129:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549000832 00000100:00100000:1.0:1789785081.753133:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549000832 00000100:00100000:1.0:1789785081.753154:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789785081.753161:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+18:6531:x1876725549000832:12345-0@lo:101: 00010000:00010000:1.0:1789785081.753169:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785081.753179:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc2050e00/0x2f18ee3fd845c0d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c0c9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785081.753200:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc2050e00/0x2f18ee3fd845c0d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c0c9 expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785081.753210:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc2050e00/0x2f18ee3fd845c0d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c0c9 expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785081.753219:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc2050e00, rc 0) 00000100:00100000:1.0:1789785081.753247:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+19:6531:x1876725549000832:12345-0@lo:101: Request processed in 86us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785081.753253:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789785081.753284:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549000832:0@lo:101: 00010000:00010000:1.0:1789785081.753295:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c0c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c0d0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785081.753304:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c0c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c0d0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785081.753366:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549000960:0@lo:256: 00000100:00100000:1.0:1789785081.753397:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785081.753410:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf9823fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789785081.753421:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549000960 00000100:00100000:1.0:1789785081.753430:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549000960 00000100:00100000:1.0:1789785081.753451:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789785081.753457:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+19:6531:x1876725549000960:12345-0@lo:256: 20000000:01000000:1.0:1789785081.753468:0:6526:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789785081.753484:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789785081.753487:0:6526:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789785081.753566:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+19:6531:x1876725549000960:12345-0@lo:256: Request processed in 109us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785081.753573:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789785081.753602:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549000960:0@lo:256: 10000000:01000000:1.0:1789785081.753638:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789785081.753644:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c0c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c0d0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785081.753651:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c0c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c0d0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785081.753658:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789785081.753660:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1789785081.753662:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789785081.753676:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc2051e00/0x2f18ee3fd845c0d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785081.753683:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc2051e00/0x2f18ee3fd845c0d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785081.753689:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc2051e00/0x2f18ee3fd845c0d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785081.753699:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549001088:0@lo:101: 00000100:00100000:1.0:1789785081.753731:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785081.753743:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb448c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789785081.753753:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549001088 00000100:00100000:1.0:1789785081.753757:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549001088 00000100:00100000:1.0:1789785081.753777:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789785081.753782:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+19:6531:x1876725549001088:12345-0@lo:101: 00010000:00010000:1.0:1789785081.753789:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785081.753797:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc2051000/0x2f18ee3fd845c0de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c0d7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785081.753812:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc2051000/0x2f18ee3fd845c0de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c0d7 expref: 20 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785081.753821:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc2051000/0x2f18ee3fd845c0de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c0d7 expref: 20 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785081.753828:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc2051000, rc 0) 00000100:00100000:1.0:1789785081.753854:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+20:6531:x1876725549001088:12345-0@lo:101: Request processed in 71us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785081.753860:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789785081.753887:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549001088:0@lo:101: 00010000:00010000:1.0:1789785081.753896:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc2051e00/0x2f18ee3fd845c0d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c0de expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785081.753904:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc2051e00/0x2f18ee3fd845c0d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c0de expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785081.753945:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549001216:0@lo:501: 40000000:02000000:0.0:1789785081.762389:0:6540:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:1.0:1789785081.764610:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785081.764660:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb448c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789785081.764690:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549001216 00000100:00100000:1.0:1789785081.764697:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549001216 00000100:00100000:1.0:1789785081.764743:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789785081.764752:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+20:6531:x1876725549001216:12345-0@lo:501: 00000100:00100000:1.0:1789785081.764888:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+20:6531:x1876725549001216:12345-0@lo:501: Request processed in 136us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785081.764896:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789785081.764945:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549001216:0@lo:501: 00000100:00100000:1.0:1789785081.765004:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549001344:0@lo:503: 00000100:00100000:1.0:1789785081.765053:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785081.765067:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb448c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789785081.765082:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549001344 00000100:00100000:1.0:1789785081.765085:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549001344 00000100:00100000:1.0:1789785081.765108:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789785081.765114:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+20:6531:x1876725549001344:12345-0@lo:503: 00000100:00100000:1.0:1789785081.765193:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+20:6531:x1876725549001344:12345-0@lo:503: Request processed in 78us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785081.765199:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789785081.765236:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549001344:0@lo:503: 00000100:00100000:0.0:1789785081.775747:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8458:x1876725549000064:12345-0@lo:700: Request processed in 37046us (37123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785081.775763:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789785081.778627:0:8810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eaad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:8810:1876725549001472:0@lo:502: 00000100:00100000:0.0:1789785081.778711:0:8810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785081.778751:0:8810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf83f30f00 going to sleep for 11 seconds 00010000:00080000:1.0:1789785081.779095:0:8458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae81eab800 x1876725549000064/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789785097 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785081.779110:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eab800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8458:1876725549000064:0@lo:700: 40000000:02000000:1.0:1789785081.779121:0:8458:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:0.0:1789785081.781516:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549001472 00000100:00100000:0.0:1789785081.781546:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549001472 00000100:00100000:0.0:1789785081.781602:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789785081.781612:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+20:8810:x1876725549001472:12345-0@lo:502: 00000100:00100000:0.0:1789785081.781776:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+20:8810:x1876725549001472:12345-0@lo:502: Request processed in 165us (3064us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785081.781785:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789785081.781845:0:8810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eaad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:8810:1876725549001472:0@lo:502: 00000020:01000000:0.0:1789785081.781878:0:8810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789785081.781885:0:8810:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789785081.781892:0:8810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785081.781895:0:8810:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789785081.781900:0:8810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789785081.781905:0:8810:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.146@tcp to nid 0x20000c0a8cb92 (192.168.203.146@tcp) 00000020:01000000:0.0:1789785081.781926:0:8810:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789785081.781929:0:8810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789785081.781944:0:8810:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9dafb5c3cd28) 00000020:00000080:0.0:1789785081.781977:0:8810:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1789785081.781983:0:8810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789785081.782080:0:8810:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789785081.782086:0:8810:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789785081.782102:0:8810:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f18ee3fd845c0ec 00010000:00080000:0.0:1789785081.782127:0:8810:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dae829b3000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.146@tcp at head 00010000:00010000:0.0:1789785081.782369:0:8810:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:0.0:1789785081.801077:0:8445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789785081.801507:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8803:x1876725548999936:12345-0@lo:700: Request processed in 62996us (64184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785081.801520:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789785081.801617:0:8803:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafaca24e00 x1876725548999936/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789785097 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785081.801632:0:8803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8803:1876725548999936:0@lo:700: 00000040:01000000:2.0:1789785081.806971:0:8810:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789785081.806999:0:8810:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789785081.807220:0:8810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789785081.807435:0:8810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789785081.807527:0:8810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789785081.807613:0:8810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789785081.811562:0:8816:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789785081.811571:0:8816:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789785081.816788:0:8810:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789785081.816804:0:8810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789785081.816850:0:8810:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000004:00080000:2.0:1789785081.817055:0:8803:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789785081.817080:0:8803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8803:1876725549001728:0@lo:7: 00000100:00100000:2.0:1789785081.817141:0:8803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785081.817188:0:8803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf85889d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789785081.817228:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacaea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549001600:0@lo:13: 00000100:00100000:1.0:1789785081.817262:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1789785081.817313:0:8810:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f18ee3fd845c0f3 00000100:00080000:0.0:1789785081.817322:0:8810:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789785081.817327:0:8810:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dae829b3000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:0.0:1789785081.817359:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549001728 00000100:00100000:0.0:1789785081.817366:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549001728 00000100:00100000:0.0:1789785081.817405:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789785081.817414:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8803:x1876725549001728:12345-0@lo:7: 00002000:00080000:0.0:1789785081.820785:0:8451:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1789785081.820793:0:8451:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789785081.820877:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8803:x1876725549001728:12345-0@lo:7: Request processed in 3460us (3732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785081.820887:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789785081.820936:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549001600 00000100:00100000:0.0:1789785081.820943:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549001600 00000100:00100000:0.0:1789785081.822659:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789785081.822686:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549001600:12345-0@lo:13: 00002000:00000024:0.0:1789785081.822720:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923808256 avail 3692285952 00000100:00100000:0.0:1789785081.822785:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549001600:12345-0@lo:13: Request processed in 115us (5522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785081.822792:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789785081.822847:0:8810:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dae81eaad80 x1876725549001856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789785081.822876:0:8810:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1789785081.822955:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549002240:0@lo:400: 00000100:00100000:0.0:1789785081.822998:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785081.823023:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789785081.823028:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549002368:0@lo:400: 00000100:00100000:0.0:1789785081.823060:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785081.823128:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549001856:0@lo:8: 00000100:00100000:3.0:1789785081.823183:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785081.823213:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549001856 00000100:00100000:3.0:1789785081.823218:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549001856 00000100:00100000:3.0:1789785081.823254:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789785081.823259:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3658:x1876725549001856:12345-0@lo:8: 00010000:00080000:3.0:1789785081.823283:0:8450:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:3.0:1789785081.823308:0:8450:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f18ee3fd845c0fa 00002000:00100000:3.0:1789785081.823322:0:8450:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9dae81e5d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396e ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789785081.823326:0:8450:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789785081.823329:0:8450:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789785081.823416:0:8450:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789785081.823439:0:8450:0:(import.c:65:import_set_state_nolock()) ffff9dafba56a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789785081.823476:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3658:x1876725549001856:12345-0@lo:8: Request processed in 215us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785081.823482:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789785081.823514:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae81eaad80 x1876725549001856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789785091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785081.823524:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789785081.823530:0:3658:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789785081.823538:0:3658:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789785081.823542:0:3658:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789785081.823544:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dae829b3000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789785081.823553:0:3658:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789785081.823557:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549001856:0@lo:8: 00000004:00080000:3.0:1789785081.823578:0:8816:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789785081.823631:0:8816:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 190077291629ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789785081.823636:0:8816:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:0.0:1789785081.823918:0:8810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785081.823925:0:8810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785081.823927:0:8810:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789785081.823930:0:8810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789785081.823934:0:8810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785081.823935:0:8810:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789785081.823937:0:8810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789785081.823939:0:8810:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789785081.823977:0:8810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eaad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:8810:1876725549002752:0@lo:502: 00000100:00100000:0.0:1789785081.824036:0:8810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785081.824062:0:8810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84c54f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789785081.824511:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549001984:0@lo:400: 00000100:00100000:0.0:1789785081.824546:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785081.824565:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549002496:0@lo:400: 00000100:00100000:0.0:1789785081.824586:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785081.824789:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789785081.824796:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549002112:0@lo:400: 00000100:00100000:0.0:1789785081.824823:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785081.824841:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81ea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549002624:0@lo:400: 00000100:00100000:0.0:1789785081.824865:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789785081.827546:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00080000:2.0:1789785081.827604:0:8803:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafacae8380 x1876725549001728/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789785097 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785081.827621:0:8803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8803:1876725549001728:0@lo:7: 00000004:00080000:2.0:1789785081.827633:0:8803:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789785081.827666:0:8803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8803:1876725549002880:0@lo:5: 00000100:00100000:2.0:1789785081.827768:0:8803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785081.827792:0:8803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf85889d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789785081.827813:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549002880 00000100:00100000:2.0:1789785081.827818:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549002880 00000100:00100000:2.0:1789785081.827861:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789785081.827869:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8803:x1876725549002880:12345-0@lo:5: 00002000:00080000:2.0:1789785081.827894:0:8451:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1789785081.827936:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8803:x1876725549002880:12345-0@lo:5: Request processed in 67us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785081.827942:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789785081.827981:0:8803:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafacae8380 x1876725549002880/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789785097 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785081.827990:0:8803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8803:1876725549002880:0@lo:5: 00000004:00080000:2.0:1789785081.827997:0:8803:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789785081.828429:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549002368 00000100:00100000:2.0:1789785081.828435:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549002368 00000100:00100000:2.0:1789785081.829265:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549002112 00000100:00100000:2.0:1789785081.829273:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549002112 00000100:00100000:1.0:1789785081.829466:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549002240 00000100:00100000:1.0:1789785081.829471:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549002240 00000100:00100000:1.0:1789785081.829493:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549001984 00000100:00100000:1.0:1789785081.829496:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549001984 00000100:00100000:1.0:1789785081.829506:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549002496 00000100:00100000:1.0:1789785081.829509:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549002496 00000100:00100000:1.0:1789785081.829519:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549002624 00000100:00100000:1.0:1789785081.829521:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549002624 00000100:00100000:1.0:1789785081.829535:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789785081.829543:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549002240:12345-0@lo:400: 00000100:00100000:1.0:1789785081.829621:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549002240:12345-0@lo:400: Request processed in 78us (6621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785081.829627:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789785081.829642:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789785081.829649:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549001984:12345-0@lo:400: 00000100:00100000:1.0:1789785081.829697:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549001984:12345-0@lo:400: Request processed in 49us (5150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785081.829703:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789785081.829714:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789785081.829720:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549002496:12345-0@lo:400: 00000100:00100000:1.0:1789785081.829746:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549002496:12345-0@lo:400: Request processed in 26us (5158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785081.829751:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789785081.829762:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789785081.829767:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549002624:12345-0@lo:400: 00000100:00100000:1.0:1789785081.829809:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549002624:12345-0@lo:400: Request processed in 42us (4943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785081.829816:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789785081.829872:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae81ea9f80 x1876725549002624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785081.829886:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81ea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549002624:0@lo:400: 00010000:00080000:1.0:1789785081.829898:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae81eaaa00 x1876725549001984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785081.829906:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549001984:0@lo:400: 00010000:00080000:1.0:1789785081.829915:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae81ea8a80 x1876725549002496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785081.829922:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549002496:0@lo:400: 00010000:00080000:1.0:1789785081.829956:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafacaea300 x1876725549001600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785097 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785081.829984:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacaea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549001600:0@lo:13: 00010000:00080000:0.0:1789785081.830129:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae81eaa300 x1876725549002240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785081.830140:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549002240:0@lo:400: 00000100:00100000:0.0:1789785081.830461:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789785081.830472:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549002368:12345-0@lo:400: 00000100:00100000:0.0:1789785081.830529:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549002368:12345-0@lo:400: Request processed in 60us (7467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785081.830541:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789785081.830558:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789785081.830564:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549002112:12345-0@lo:400: 00000100:00100000:0.0:1789785081.830598:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549002112:12345-0@lo:400: Request processed in 35us (5774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785081.830604:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789785081.830622:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549002752 00000100:00100000:0.0:1789785081.830627:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549002752 00000100:00100000:0.0:1789785081.830653:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789785081.830658:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+20:8810:x1876725549002752:12345-0@lo:502: 00000100:00100000:1.0:1789785081.830776:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549002368:0@lo:400: 00000100:00100000:1.0:1789785081.830802:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549002112:0@lo:400: 00000100:00100000:0.0:1789785081.831799:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+20:8810:x1876725549002752:12345-0@lo:502: Request processed in 1136us (7758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785081.831809:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789785081.834718:0:8810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eaad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:8810:1876725549002752:0@lo:502: 00000020:01000000:1.0:1789785081.834764:0:8810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785081.834772:0:8810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785081.834775:0:8810:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789785081.834781:0:8810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1789785081.837007:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1789785081.837040:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789785081.837051:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc2051e00/0x2f18ee3fd845c0d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c0de expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785081.837064:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc2051e00/0x2f18ee3fd845c0d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c0de expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785081.837074:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789785081.837077:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9daf983fcd28 from 1 10000000:01000000:0.0:1789785081.837079:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789785081.837114:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c101 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785081.837122:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c101 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785081.837143:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c101 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785081.837172:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eaa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549003008:0@lo:101: 00000100:00100000:0.0:1789785081.837235:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785081.837291:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8280a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789785081.838711:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549003008 00000100:00100000:1.0:1789785081.838734:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549003008 00000100:00100000:1.0:1789785081.838793:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789785081.838802:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+20:6531:x1876725549003008:12345-0@lo:101: 00010000:00010000:1.0:1789785081.838819:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785081.838835:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc2050000/0x2f18ee3fd845c108 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c101 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785081.838861:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc2050000/0x2f18ee3fd845c108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c101 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785081.838873:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc2050000/0x2f18ee3fd845c108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c101 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785081.838883:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc2050000, rc 0) 00000100:00100000:1.0:1789785081.838949:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549003008:12345-0@lo:101: Request processed in 148us (1713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785081.838955:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789785081.839018:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eaa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549003008:0@lo:101: 00010000:00010000:1.0:1789785081.839035:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c101 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c108 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785081.839044:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c101 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c108 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785081.839116:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549003136:0@lo:501: 00000100:00100000:1.0:1789785081.839148:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785081.839173:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb4489c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789785081.839186:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549003136 00000100:00100000:1.0:1789785081.839189:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549003136 00000100:00100000:1.0:1789785081.839219:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789785081.839224:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549003136:12345-0@lo:501: 00000100:00100000:1.0:1789785081.839291:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549003136:12345-0@lo:501: Request processed in 67us (143us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789785081.839298:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789785081.839326:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549003136:0@lo:501: 10000000:01000000:1.0:1789785081.839375:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789785081.839382:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c101 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c108 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785081.839389:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c108 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789785081.840232:0:8817:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789785081.840252:0:8817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81ea9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8817:1876725549003392:0@lo:7: 00000100:00100000:0.0:1789785081.840294:0:8817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785081.840317:0:8817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8280aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789785081.840371:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549003264:0@lo:13: 00000100:00100000:0.0:1789785081.840397:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785081.840432:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549003264 00000100:00100000:0.0:1789785081.840436:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549003264 00000100:00100000:0.0:1789785081.840476:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789785081.840484:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1876725549003264:12345-0@lo:13: 00002000:00000024:0.0:1789785081.840501:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923808256 avail 3692285952 00000100:00100000:0.0:1789785081.840537:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1876725549003264:12345-0@lo:13: Request processed in 54us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785081.840543:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789785081.840576:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae81ea8380 x1876725549003264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785097 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785081.840593:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549003264:0@lo:13: 00000100:00100000:3.0:1789785081.841061:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549003392 00000100:00100000:3.0:1789785081.841067:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549003392 00000100:00100000:3.0:1789785081.841106:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789785081.841120:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8817:x1876725549003392:12345-0@lo:7: 00000100:00080000:1.0:1789785081.841767:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1789785081.849305:0:8450:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1789785081.849315:0:8450:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789785081.849421:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8817:x1876725549003392:12345-0@lo:7: Request processed in 8297us (9122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785081.849431:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789785081.850562:0:8817:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae81ea9500 x1876725549003392/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789785097 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785081.850593:0:8817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81ea9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8817:1876725549003392:0@lo:7: 00000004:00080000:0.0:1789785081.850608:0:8817:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789785081.850648:0:8817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81ea9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8817:1876725549003520:0@lo:5: 00000100:00100000:0.0:1789785081.850771:0:8817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785081.850804:0:8817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8280aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789785081.850944:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549003520 00000100:00100000:2.0:1789785081.850952:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549003520 00000100:00100000:2.0:1789785081.851014:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789785081.851024:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8817:x1876725549003520:12345-0@lo:5: 00002000:00080000:2.0:1789785081.851048:0:8451:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789785081.851052:0:8451:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1789785081.857631:0:8445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1789785081.857649:0:8445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789785081.858694:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8817:x1876725549003520:12345-0@lo:5: Request processed in 7666us (7918us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789785081.858706:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789785081.858779:0:8817:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae81ea9500 x1876725549003520/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789785097 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785081.858801:0:8817:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789785081.858807:0:8817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81ea9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8817:1876725549003520:0@lo:5: 00000004:00080000:2.0:1789785081.858822:0:8817:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789785081.858867:0:8817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8817:1876725549003648:0@lo:700: 00000100:00100000:2.0:1789785081.858912:0:8817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785081.858932:0:8817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf85889d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789785081.859943:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549003648 00000100:00100000:2.0:1789785081.859951:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549003648 00000100:00100000:2.0:1789785081.860016:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789785081.860027:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacaea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8817:x1876725549003648:12345-0@lo:700: 00010000:00010000:2.0:1789785081.860547:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785081.875859:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacaea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8817:x1876725549003648:12345-0@lo:700: Request processed in 15826us (16937us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785081.875879:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789785081.875937:0:8817:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafacae8380 x1876725549003648/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789785097 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785081.875953:0:8817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8817:1876725549003648:0@lo:700: 00000004:02000040:0.0:1789785081.879929:0:8817:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000001:02000400:3.0:1789785081.889603:0:8826:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789785081.901498:0:8817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eaad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8817:1876725549003776:0@lo:5: 00000100:00100000:0.0:1789785081.901574:0:8817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785081.902271:0:8817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8280a240 going to sleep for 11 seconds 00000100:00100000:1.0:1789785081.903262:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549003776 00000100:00100000:1.0:1789785081.903273:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549003776 00000100:00100000:1.0:1789785081.903330:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789785081.903354:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8817:x1876725549003776:12345-0@lo:5: 00002000:00080000:1.0:1789785081.911418:0:8805:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1789785081.911437:0:8805:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1789785081.912892:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8817:x1876725549003776:12345-0@lo:5: Request processed in 9547us (11312us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789785081.912910:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789785081.913635:0:8817:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae81eaad80 x1876725549003776/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789785097 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785081.913652:0:8817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eaad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8817:1876725549003776:0@lo:5: 00000004:00080000:2.0:1789785081.913665:0:8817:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000100:00100000:3.0:1789785082.178528:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789785082.178554:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549003904:0@lo:41: 00000100:00100000:3.0:1789785082.178619:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785082.178804:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549003904 00000100:00100000:0.0:1789785082.178813:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549003904 00000100:00100000:0.0:1789785082.178895:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789785082.178905:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549003904:12345-0@lo:41: 00000004:00000024:0.0:1789785082.178939:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789785082.179018:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549003904:12345-0@lo:41: Request processed in 114us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785082.179025:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789785082.179135:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549003904:0@lo:41: 00000020:00000004:3.0:1789785082.818030:0:8879:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789785082.818616:0:8879:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789785082.883270:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789785083.667214:0:8445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1789785083.906558:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785084.931282:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789785085.518919:0:8980:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789785085.519155:0:8980:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789785085.762579:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549004032:0@lo:41: 00000100:00100000:0.0:1789785085.762661:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785085.762738:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549004032 00000100:00100000:0.0:1789785085.762745:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549004032 00000100:00100000:0.0:1789785085.762790:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789785085.762799:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549004032:12345-0@lo:41: 00000004:00000024:0.0:1789785085.762830:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789785085.762885:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549004032:12345-0@lo:41: Request processed in 86us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785085.762891:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789785085.762945:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549004032:0@lo:41: 00010000:00010000:2.0:1789785085.954630:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789785086.249426:0:9028:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789785086.249447:0:9028:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1789785086.978610:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785087.298545:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549004160:0@lo:13: 00000100:00100000:0.0:1789785087.298613:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785087.298707:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549004160 00000100:00100000:0.0:1789785087.298715:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549004160 00000100:00100000:0.0:1789785087.298766:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789785087.298776:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549004160:12345-0@lo:13: 00002000:00000024:0.0:1789785087.298803:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789785087.298957:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789785087.299042:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549004160:12345-0@lo:13: Request processed in 267us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785087.299049:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789785087.299999:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae81eabb80 x1876725549004160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785087.300011:0:3660:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789785087.300079:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549004160:0@lo:13: 00000100:00100000:0.0:1789785087.300417:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789785087.300431:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81ea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549004288:0@lo:41: 00000100:00100000:0.0:1789785087.300476:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785087.300569:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549004288 00000100:00100000:3.0:1789785087.300575:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549004288 00000100:00100000:3.0:1789785087.300617:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789785087.300626:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549004288:12345-0@lo:41: 00000004:00000024:3.0:1789785087.300655:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1789785087.300695:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549004288:12345-0@lo:41: Request processed in 70us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785087.300708:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789785087.300782:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81ea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549004288:0@lo:41: 00000100:00100000:3.0:1789785087.301125:0:8803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb415c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8803:1876725549004800:0@lo:5: 00000100:00100000:3.0:1789785087.301161:0:8803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785087.301232:0:8803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf982a8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789785087.301247:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549004928:0@lo:400: 00000100:00100000:3.0:1789785087.301274:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785087.301293:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549005440:0@lo:400: 00000100:00100000:3.0:1789785087.301312:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785087.301363:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549004544:0@lo:13: 00000100:00100000:0.0:1789785087.301394:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785087.301414:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549005184:0@lo:400: 00000100:00100000:0.0:1789785087.301433:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785087.301450:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789785087.301455:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549004672:0@lo:400: 00000100:00100000:0.0:1789785087.301472:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785087.301485:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549005312:0@lo:400: 00000100:00100000:0.0:1789785087.301514:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785087.301541:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549004928 00000100:00100000:0.0:1789785087.301545:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549004928 00000100:00100000:0.0:1789785087.301566:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549005184 00000100:00100000:0.0:1789785087.301569:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549005184 00000100:00100000:0.0:1789785087.301588:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549004672 00000100:00100000:0.0:1789785087.301591:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549004672 00000100:00100000:0.0:1789785087.301599:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549005312 00000100:00100000:0.0:1789785087.301601:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549005312 00000100:00100000:0.0:1789785087.301616:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789785087.301623:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549004928:12345-0@lo:400: 00000100:00100000:0.0:1789785087.301657:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549004928:12345-0@lo:400: Request processed in 34us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785087.301664:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789785087.301677:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789785087.301684:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549005184:12345-0@lo:400: 00000100:00100000:0.0:1789785087.301713:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549005184:12345-0@lo:400: Request processed in 29us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785087.301719:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789785087.301729:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789785087.301735:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549004672:12345-0@lo:400: 00000100:00100000:0.0:1789785087.301758:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549004672:12345-0@lo:400: Request processed in 23us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785087.301764:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789785087.301773:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789785087.301778:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549005312:12345-0@lo:400: 00000100:00100000:0.0:1789785087.301801:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549005312:12345-0@lo:400: Request processed in 23us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785087.301814:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1789785087.301836:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789785087.301839:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789785087.301859:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549004416:0@lo:400: 00000100:00100000:0.0:1789785087.301887:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785087.301910:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549005056:0@lo:400: 00000100:00100000:0.0:1789785087.301942:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785087.301970:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549004416 00000100:00100000:0.0:1789785087.301973:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549004416 00000100:00100000:0.0:1789785087.301997:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789785087.302003:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+21:3662:x1876725549004416:12345-0@lo:400: 00000100:00100000:0.0:1789785087.302035:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+21:3662:x1876725549004416:12345-0@lo:400: Request processed in 32us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785087.302041:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789785087.302063:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549005056 00000100:00100000:0.0:1789785087.302067:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549005056 00000100:00100000:0.0:1789785087.302087:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789785087.302094:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549005056:12345-0@lo:400: 00000100:00100000:0.0:1789785087.302122:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549005056:12345-0@lo:400: Request processed in 28us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785087.302128:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1789785087.302160:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae828fed80 x1876725549004672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785087.302172:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549004672:0@lo:400: 00010000:00080000:0.0:1789785087.302183:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae828ffb80 x1876725549005312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785087.302203:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549005312:0@lo:400: 00010000:00080000:0.0:1789785087.302215:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae828fe300 x1876725549005184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785087.302223:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549005184:0@lo:400: 00000100:00100000:0.0:1789785087.302249:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549004544 00000100:00100000:0.0:1789785087.302252:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549004544 00000100:00100000:0.0:1789785087.302284:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789785087.302290:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549004544:12345-0@lo:13: 00002000:00000024:0.0:1789785087.302303:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785087.302363:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549004544:12345-0@lo:13: Request processed in 48us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785087.302369:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789785087.302386:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789785087.302401:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549004416:0@lo:400: 00000100:00100000:0.0:1789785087.302410:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549005056:0@lo:400: 00010000:00080000:0.0:1789785087.302433:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafbb416d80 x1876725549004544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785087.302444:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549004544:0@lo:13: 00000100:00100000:1.0:1789785087.303635:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549004800 00000100:00100000:1.0:1789785087.303646:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549004800 00010000:00080000:3.0:1789785087.303842:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae828fea00 x1876725549004928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785087.303856:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549004928:0@lo:400: 00000100:00100000:0.0:1789785087.303965:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549005440 00000100:00100000:0.0:1789785087.303971:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549005440 00000100:00100000:1.0:1789785087.303997:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789785087.304006:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789785087.304011:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3661:x1876725549005440:12345-0@lo:400: 00000100:00100000:0.0:1789785087.304020:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8803:x1876725549004800:12345-0@lo:5: 00002000:00080000:0.0:1789785087.304053:0:8451:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1789785087.304075:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3661:x1876725549005440:12345-0@lo:400: Request processed in 69us (2759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785087.304083:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789785087.304846:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae828fca80 x1876725549005440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785087.304858:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549005440:0@lo:400: 00000100:00100000:0.0:1789785087.308045:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8803:x1876725549004800:12345-0@lo:5: Request processed in 4022us (6876us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789785087.308070:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789785087.308506:0:8803:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafbb415c00 x1876725549004800/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789785103 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785087.308522:0:8803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb415c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8803:1876725549004800:0@lo:5: 00000004:00080000:3.0:1789785087.308536:0:8803:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1789785087.308576:0:8803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb415f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8803:1876725549005568:0@lo:900: 00000100:00100000:3.0:1789785087.308681:0:8803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785087.308744:0:8803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf982a8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789785087.308808:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549005568 00000100:00100000:1.0:1789785087.308815:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549005568 00000100:00100000:1.0:1789785087.308885:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789785087.308894:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8803:x1876725549005568:12345-0@lo:900: 00000100:00100000:1.0:1789785087.310934:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8803:x1876725549005568:12345-0@lo:900: Request processed in 2023us (2235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785087.310946:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789785087.311042:0:8803:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafbb415f80 x1876725549005568/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789785103 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785087.311057:0:8803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb415f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8803:1876725549005568:0@lo:900: 00010000:00010000:3.0:1789785088.002880:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785089.033964:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785090.050642:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785090.882567:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789785090.882603:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549005696:0@lo:41: 00000100:00100000:2.0:1789785090.882701:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785090.882766:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549005696 00000100:00100000:2.0:1789785090.882773:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549005696 00000100:00100000:2.0:1789785090.883025:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789785090.883035:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549005696:12345-0@lo:41: 00000004:00000024:2.0:1789785090.883066:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789785090.883224:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549005696:12345-0@lo:41: Request processed in 189us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785090.883236:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789785090.883283:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549005696:0@lo:41: 00010000:00010000:3.0:1789785091.077956:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789785091.910975:0:8445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1789785092.098719:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785092.418591:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549006080:0@lo:400: 00000100:00100000:2.0:1789785092.418674:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785092.418722:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725549006592:0@lo:400: 00000100:00100000:1.0:1789785092.418734:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876725549005952:0@lo:400: 00000100:00100000:2.0:1789785092.418758:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785092.418785:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785092.418790:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789785092.418796:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549006208:0@lo:400: 00000100:00100000:1.0:1789785092.418801:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1876725549006464:0@lo:400: 00000100:00100000:2.0:1789785092.418816:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785092.418982:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549005824:0@lo:400: 00000100:00100000:1.0:1789785092.424434:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549006592 00000100:00100000:1.0:1789785092.424450:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549006592 00000100:00100000:1.0:1789785092.424527:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549005952 00000100:00100000:1.0:1789785092.424530:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549005952 00000100:00100000:1.0:1789785092.424543:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549006208 00000100:00100000:1.0:1789785092.424546:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549006208 00000100:00100000:1.0:1789785092.424562:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789785092.424725:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725549006592:12345-0@lo:400: 00000100:00100000:0.0:1789785092.424974:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc18c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549007232:0@lo:41: 00000100:00100000:3.0:1789785092.426849:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789785092.426870:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876725549005952:12345-0@lo:400: 00000100:00100000:3.0:1789785092.428619:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876725549005952:12345-0@lo:400: Request processed in 1753us (9828us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785092.428632:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789785092.428664:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789785092.428677:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549006208:12345-0@lo:400: 00000100:00100000:3.0:1789785092.428724:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549006208:12345-0@lo:400: Request processed in 53us (9907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785092.428729:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789785092.428762:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549006080 00000100:00100000:3.0:1789785092.428768:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549006080 00000100:00100000:3.0:1789785092.428804:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789785092.428810:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549006080:12345-0@lo:400: 00000100:00100000:3.0:1789785092.428837:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549006080:12345-0@lo:400: Request processed in 27us (10164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785092.428843:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789785092.428867:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785092.428914:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549006336:0@lo:400: 00000100:00100000:3.0:1789785092.428941:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785092.428961:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549006336 00000100:00100000:3.0:1789785092.428964:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549006336 00000100:00100000:3.0:1789785092.428983:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789785092.428988:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549006336:12345-0@lo:400: 00000100:00100000:3.0:1789785092.429013:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549006336:12345-0@lo:400: Request processed in 25us (71us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785092.429030:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789785092.429060:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549006336:0@lo:400: 00000100:00100000:3.0:1789785092.429067:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549006848:0@lo:400: 00000100:00100000:3.0:1789785092.429087:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785092.429117:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789785092.429122:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc18c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549006976:0@lo:13: 00000100:00100000:3.0:1789785092.429139:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785092.429159:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549006976 00000100:00100000:3.0:1789785092.429161:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549006976 00000100:00100000:3.0:1789785092.429185:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789785092.429190:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549006976:12345-0@lo:13: 00002000:00000024:3.0:1789785092.429209:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785092.429234:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549006976:12345-0@lo:13: Request processed in 44us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785092.429239:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789785092.429262:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafc18c4e00 x1876725549006976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785092.429277:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc18c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549006976:0@lo:13: 00000100:00100000:3.0:1789785092.435970:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785092.435988:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725549006592:12345-0@lo:400: Request processed in 11416us (17226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785092.436001:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789785092.436030:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549006464 00010000:00080000:3.0:1789785092.436032:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafc1b39180 x1876725549005952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785092.436035:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549006464 00000100:00100000:3.0:1789785092.436047:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876725549005952:0@lo:400: 00010000:00080000:2.0:1789785092.436049:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafc1b38380 x1876725549006208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785092.436064:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549006208:0@lo:400: 00000100:00100000:2.0:1789785092.436078:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549006720:0@lo:400: 00000100:00100000:1.0:1789785092.436083:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789785092.436093:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1876725549006464:12345-0@lo:400: 00000100:00100000:0.0:1789785092.436134:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785092.436142:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1876725549006464:12345-0@lo:400: Request processed in 52us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785092.436159:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789785092.436165:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc18c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549007104:0@lo:13: 00000100:00100000:0.0:1789785092.436190:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785092.436212:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549005824 00000100:00100000:0.0:1789785092.436216:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549005824 00000100:00100000:0.0:1789785092.436243:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789785092.436249:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+21:3659:x1876725549005824:12345-0@lo:400: 00000100:00100000:0.0:1789785092.436278:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+21:3659:x1876725549005824:12345-0@lo:400: Request processed in 30us (7411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785092.436284:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789785092.436325:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549006848 00000100:00100000:0.0:1789785092.436328:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549006848 00000100:00100000:0.0:1789785092.436364:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789785092.436370:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549006848:12345-0@lo:400: 00000100:00100000:0.0:1789785092.436396:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549006848:12345-0@lo:400: Request processed in 27us (7309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785092.436402:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789785092.436414:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789785092.436417:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789785092.436420:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789785092.436466:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafc1b38e00 x1876725549006464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785092.436476:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1876725549006464:0@lo:400: 00000100:00100000:2.0:1789785092.436656:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785092.436685:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549006080:0@lo:400: 00010000:00080000:2.0:1789785092.436698:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafc1b39500 x1876725549006592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785092.436709:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725549006592:0@lo:400: 00000100:00100000:0.0:1789785092.436721:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549006720 00000100:00100000:0.0:1789785092.436726:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549006720 00000100:00080000:2.0:1789785092.436759:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789785092.436774:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789785092.436783:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549006720:12345-0@lo:400: 00000100:00100000:0.0:1789785092.436823:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549006720:12345-0@lo:400: Request processed in 43us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785092.436829:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789785092.437112:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafc1b3a680 x1876725549006720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785092.437121:0:3661:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1789785092.437140:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549006720:0@lo:400: 00000100:00100000:0.0:1789785092.437835:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549007232 00000100:00100000:0.0:1789785092.437842:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549007232 00000100:00100000:0.0:1789785092.437877:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789785092.437895:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549007232:12345-0@lo:41: 00000004:00000024:0.0:1789785092.437926:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789785092.437980:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549007232:12345-0@lo:41: Request processed in 94us (1844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785092.437987:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789785092.438039:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc18c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549007232:0@lo:41: 00000100:00100000:2.0:1789785092.438092:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549007104 00000100:00100000:2.0:1789785092.438097:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549007104 00000100:00100000:2.0:1789785092.438144:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789785092.438154:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549007104:12345-0@lo:13: 00002000:00000024:2.0:1789785092.438170:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785092.438219:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549007104:12345-0@lo:13: Request processed in 67us (2026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785092.438226:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789785092.438258:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549005824:0@lo:400: 00010000:00080000:2.0:1789785092.438273:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafc1b3b100 x1876725549006848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785092.438282:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549006848:0@lo:400: 00010000:00080000:0.0:1789785092.438708:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafc18c5c00 x1876725549007104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785092.438723:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc18c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549007104:0@lo:13: 00000100:00100000:1.0:1789785092.441718:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1789785093.123487:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785094.147129:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785095.172577:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789785095.283424:0:9527:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789785095.283428:0:9527:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789785095.283429:0:9527:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789785095.283572:0:9527:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9dae829a7000 00000020:01000004:2.0:1789785095.283587:0:9527:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789785095.283601:0:9527:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789785095.283614:0:9527:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9dafbb220000) 00000020:00000080:2.0:1789785095.283630:0:9527:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789785095.332619:0:9527:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789785095.332694:0:9527:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1789785095.357090:0:9527:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789785095.357303:0:9527:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789785095.357316:0:9527:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789785095.357328:0:9527:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2f18ee3fd845c116 00000020:01000004:2.0:1789785095.357335:0:9527:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789785095.357372:0:9527:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.146@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789785095.357379:0:9527:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.146@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789785095.357386:0:9527:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789785095.358002:0:9527:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1789785095.358007:0:9527:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.146@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789785095.379310:0:9527:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.146@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789785095.379551:0:9527:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.146@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789785095.379555:0:9527:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789785095.379557:0:9527:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789785095.379559:0:9527:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789785095.379560:0:9527:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789785095.379562:0:9527:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789785095.379563:0:9527:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789785095.379565:0:9527:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789785095.379566:0:9527:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789785095.379568:0:9527:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789785095.379569:0:9527:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789785095.379571:0:9527:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789785095.379575:0:9527:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789785095.379577:0:9527:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789785095.379643:0:9527:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789785095.379644:0:9527:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789785095.379645:0:9527:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789785095.379646:0:9527:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789785095.379648:0:9527:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789785095.379649:0:9527:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789785095.379650:0:9527:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789785095.379651:0:9527:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789785095.379652:0:9527:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789785095.379653:0:9527:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789785095.379678:0:9527:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789785095.379695:0:9527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549007360:0@lo:253: 00000100:00100000:2.0:1789785095.379773:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785095.379874:0:9527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae82a3e300 going to sleep for 11 seconds 00000100:00100000:0.0:1789785095.379918:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549007360 00000100:00100000:0.0:1789785095.379925:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549007360 00000100:00100000:0.0:1789785095.380007:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789785095.380017:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+21:9527:x1876725549007360:12345-0@lo:253: 20000000:01000000:0.0:1789785095.380056:0:6526:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789785095.380060:0:6526:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789785095.380065:0:6526:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789785095.380069:0:6526:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789785095.380282:0:6526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789785095.380747:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1789785095.380763:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789785095.380781:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1789785095.380788:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789785095.380802:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1789785095.380817:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1789785095.380924:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1789785095.380939:0:6526:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.146@tcp 20000000:01000000:0.0:1789785095.380941:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.146@tcp (null) (null) (null) 00000040:00080000:0.0:1789785095.380955:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1789785095.380961:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789785095.380974:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1789785095.380979:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.146@tcp (null) (null) 00000040:00080000:0.0:1789785095.380990:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1789785095.380996:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789785095.381008:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1789785095.381023:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1789785095.381093:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1789785095.381104:0:6526:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.146@tcp 20000000:01000000:0.0:1789785095.381106:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.146@tcp (null) (null) (null) 00000040:00080000:0.0:1789785095.381119:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1789785095.381125:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789785095.381136:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1789785095.381141:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.146@tcp (null) (null) 00000040:00080000:0.0:1789785095.381153:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1789785095.381168:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789785095.381183:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1789785095.381199:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1789785095.382716:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1789785095.382738:0:6526:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.146@tcp 20000000:01000000:1.0:1789785095.382740:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.146@tcp (null) (null) (null) 00000040:00080000:1.0:1789785095.382756:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1789785095.382763:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789785095.382776:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1789785095.382782:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.146@tcp (null) (null) 00000040:00080000:1.0:1789785095.382793:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1789785095.382798:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789785095.382808:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1789785095.382819:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1789785095.382830:0:6526:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789785095.382833:0:6526:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789785095.382837:0:6526:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789785095.382888:0:6526:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789785095.382890:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789785095.383222:0:9533:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1789785095.383240:0:9533:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1789785095.383252:0:9533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1789785095.383809:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1789785095.383826:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1789785095.383837:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1789785095.383844:0:6526:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789785095.383850:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789785095.384822:0:9534:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1789785095.384851:0:9534:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1789785095.384869:0:9534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1789785095.385162:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1789785095.385180:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1789785095.385191:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1789785095.385200:0:6526:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789785095.385201:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789785095.385800:0:9535:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1789785095.385818:0:9535:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1789785095.385829:0:9535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1789785095.385967:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1789785095.385986:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1789785095.385999:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1789785095.386006:0:6526:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789785095.386008:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789785095.386333:0:9536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1789785095.386548:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1789785095.386565:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1789785095.386676:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1789785095.386793:0:6526:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789785095.386795:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789785095.387078:0:9537:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1789785095.387094:0:9537:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1789785095.387106:0:9537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1789785095.387319:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1789785095.387363:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1789785095.387378:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 10000000:01000000:1.0:1789785095.387391:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789785095.387465:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c11d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.387482:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dae81eac200/0x2f18ee3fd845c013 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c00c expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.387491:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dae81eade00/0x2f18ee3fd845c03d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c036 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.387498:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dae81ead000/0x2f18ee3fd845c07c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c075 expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.387504:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dae81eacc00/0x2f18ee3fd845c098 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c091 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.387510:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc1b09600/0x2f18ee3fd845c0c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c0bb expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.387517:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc2051000/0x2f18ee3fd845c0de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c0d7 expref: 21 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.387534:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc2050000/0x2f18ee3fd845c108 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c101 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.387542:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c11d lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.387576:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc2050000/0x2f18ee3fd845c108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c101 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.387756:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dafc2050000/0x2f18ee3fd845c108 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c101 expref: 21 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785095.387770:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1876725549007488:0@lo:104: 00000100:00100000:1.0:1789785095.387826:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789785095.387880:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc2051000/0x2f18ee3fd845c0de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c0d7 expref: 21 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.387889:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dafc2051000/0x2f18ee3fd845c0de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c0d7 expref: 21 pid: 6527 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785095.387897:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1876725549007616:0@lo:104: 00000100:00100000:1.0:1789785095.387914:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789785095.388006:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc1b09600/0x2f18ee3fd845c0c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c0bb expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.388014:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dafc1b09600/0x2f18ee3fd845c0c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c0bb expref: 21 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785095.388022:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1876725549007744:0@lo:104: 00000100:00100000:1.0:1789785095.388047:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785095.389120:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549007616 00000100:00100000:3.0:1789785095.389129:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549007616 00000100:00100000:3.0:1789785095.389169:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549007744 00000100:00100000:3.0:1789785095.389172:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549007744 00000100:00100000:3.0:1789785095.389186:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789785095.389194:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e00759f-51ad-47f9-8892-382c83919083+4:6526:x1876725549007616:12345-0@lo:104: 00010000:00010000:3.0:1789785095.389208:0:8466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc2051e00/0x2f18ee3fd845c0d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c0de expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.389265:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789785095.389271:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e00759f-51ad-47f9-8892-382c83919083+4:6526:x1876725549007616:12345-0@lo:104: Request processed in 78us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785095.389277:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789785095.389293:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789785095.389299:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e00759f-51ad-47f9-8892-382c83919083+3:6526:x1876725549007744:12345-0@lo:104: 00010000:00010000:3.0:1789785095.389305:0:8466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc2051a00/0x2f18ee3fd845c0bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c0c2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.389358:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789785095.389363:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e00759f-51ad-47f9-8892-382c83919083+3:6526:x1876725549007744:12345-0@lo:104: Request processed in 65us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785095.389369:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1789785095.389389:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789785095.389395:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc2051e00/0x2f18ee3fd845c0d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c0de expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.389413:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc2051e00 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:3.0:1789785095.389417:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc2051e00/0x2f18ee3fd845c0d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c0de expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.389425:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc2051e00/0x2f18ee3fd845c0d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c0de expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789785095.389431:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc2051e00/0x2f18ee3fd845c0d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c0de expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785095.389437:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789785095.389466:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc2051e00/0x2f18ee3fd845c0d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c0de expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.389472:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789785095.389489:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc2051e00/0x2f18ee3fd845c0d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c0de expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.389495:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc2051e00/0x2f18ee3fd845c0d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c0de expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.389506:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789785095.389509:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc2051a00/0x2f18ee3fd845c0bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c0c2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.389515:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc2051a00 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:3.0:1789785095.389518:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc2051a00/0x2f18ee3fd845c0bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c0c2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.389535:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc2051a00/0x2f18ee3fd845c0bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c0c2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789785095.389541:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc2051a00/0x2f18ee3fd845c0bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c0c2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785095.389545:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789785095.389796:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dae81eacc00/0x2f18ee3fd845c098 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c091 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.389807:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dae81eacc00/0x2f18ee3fd845c098 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c091 expref: 21 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785095.389818:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828ffb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1876725549008000:0@lo:104: 00000100:00100000:1.0:1789785095.389848:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789785095.389886:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dae81ead000/0x2f18ee3fd845c07c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c075 expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.389894:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dae81ead000/0x2f18ee3fd845c07c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c075 expref: 21 pid: 6528 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785095.389901:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1876725549008128:0@lo:104: 00000100:00100000:1.0:1789785095.389921:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789785095.389935:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dae81eade00/0x2f18ee3fd845c03d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c036 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.389943:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dae81eade00/0x2f18ee3fd845c03d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c036 expref: 21 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785095.389950:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1876725549008256:0@lo:104: 00000100:00100000:1.0:1789785095.389971:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789785095.389987:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dae81eac200/0x2f18ee3fd845c013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c00c expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.389995:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dae81eac200/0x2f18ee3fd845c013 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c00c expref: 21 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785095.390015:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1876725549008384:0@lo:104: 00000100:00100000:1.0:1789785095.390036:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1ae3540 going to sleep for 11 seconds 00000100:00100000:1.0:1789785095.390055:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1876725549007616:0@lo:104: 00000100:00100000:1.0:1789785095.390063:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1876725549007744:0@lo:104: 00000100:00100000:1.0:1789785095.390087:0:8466:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789785095.390102:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785095.390110:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549008000 00000100:00100000:1.0:1789785095.390114:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549008000 00000100:00100000:1.0:1789785095.390135:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549008128 00000100:00100000:1.0:1789785095.390138:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549008128 00000100:00100000:1.0:1789785095.390147:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549008256 00000100:00100000:1.0:1789785095.390149:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549008256 00000100:00100000:1.0:1789785095.390157:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549008384 00000100:00100000:1.0:1789785095.390159:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549008384 00000100:00100000:1.0:1789785095.390170:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789785095.390176:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e00759f-51ad-47f9-8892-382c83919083+6:6526:x1876725549008000:12345-0@lo:104: 00010000:00010000:1.0:1789785095.390184:0:8466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dae81ead200/0x2f18ee3fd845c091 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c098 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.390217:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789785095.390222:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e00759f-51ad-47f9-8892-382c83919083+6:6526:x1876725549008000:12345-0@lo:104: Request processed in 47us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785095.390229:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789785095.390243:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789785095.390249:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e00759f-51ad-47f9-8892-382c83919083+5:6526:x1876725549008128:12345-0@lo:104: 00010000:00010000:1.0:1789785095.390255:0:8466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc2050200/0x2f18ee3fd845c075 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c07c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.390288:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789785095.390293:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e00759f-51ad-47f9-8892-382c83919083+5:6526:x1876725549008128:12345-0@lo:104: Request processed in 45us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785095.390299:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789785095.390312:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789785095.390318:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8251dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e00759f-51ad-47f9-8892-382c83919083+4:6526:x1876725549008256:12345-0@lo:104: 00010000:00010000:1.0:1789785095.390325:0:8466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845c036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c03d expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.390371:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789785095.390376:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8251dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e00759f-51ad-47f9-8892-382c83919083+4:6526:x1876725549008256:12345-0@lo:104: Request processed in 60us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785095.390382:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789785095.390393:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789785095.390399:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e00759f-51ad-47f9-8892-382c83919083+3:6526:x1876725549008384:12345-0@lo:104: 00010000:00010000:1.0:1789785095.390406:0:8466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08400/0x2f18ee3fd845c00c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c013 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.390430:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789785095.390435:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e00759f-51ad-47f9-8892-382c83919083+3:6526:x1876725549008384:12345-0@lo:104: Request processed in 37us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785095.390440:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789785095.390463:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828ffb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1876725549008000:0@lo:104: 00000100:00100000:1.0:1789785095.390470:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1876725549008128:0@lo:104: 00000100:00100000:1.0:1789785095.390476:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1876725549008256:0@lo:104: 00000100:00100000:1.0:1789785095.390493:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1876725549008384:0@lo:104: 00010000:00010000:2.0:1789785095.390643:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:2.0:1789785095.390680:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549007872:0@lo:103: 00000100:00100000:2.0:1789785095.390712:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785095.390746:0:7484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549007872 00000100:00100000:2.0:1789785095.390750:0:7484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549007872 00010000:00010000:2.0:1789785095.390767:0:7484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc2051000/0x2f18ee3fd845c0de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c0d7 expref: 22 pid: 6527 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785095.390788:0:7484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789785095.390794:0:7484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e00759f-51ad-47f9-8892-382c83919083+22:3659:x1876725549007872:12345-0@lo:103: 00010000:00010000:2.0:1789785095.390804:0:7484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785095.390809:0:7484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc2051000/0x2f18ee3fd845c0de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c0d7 expref: 22 pid: 6527 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.390819:0:7484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc2051000/0x2f18ee3fd845c0de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c0d7 expref: 22 pid: 6527 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.390834:0:7484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc2051000/0x2f18ee3fd845c0de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c0d7 expref: 22 pid: 6527 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.390854:0:7484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785095.390896:0:7484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e00759f-51ad-47f9-8892-382c83919083+21:3659:x1876725549007872:12345-0@lo:103: Request processed in 102us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785095.390902:0:7484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789785095.390927:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549007872:0@lo:103: 00000100:00100000:0.0:1789785095.390988:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549007488 00000100:00100000:0.0:1789785095.390993:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549007488 00000100:00100000:0.0:1789785095.391042:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789785095.391049:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+3:6526:x1876725549007488:12345-0@lo:104: 00010000:00010000:0.0:1789785095.391057:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c108 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785095.391092:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789785095.391097:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+3:6526:x1876725549007488:12345-0@lo:104: Request processed in 49us (3271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785095.391103:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1789785095.391191:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc2051a00/0x2f18ee3fd845c0bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c0c2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.391198:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789785095.391237:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549008512:0@lo:103: 00000100:00100000:0.0:1789785095.391261:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785095.391316:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549008512 00000100:00100000:1.0:1789785095.391321:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549008512 00010000:00010000:1.0:1789785095.391355:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc1b09600/0x2f18ee3fd845c0c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c0bb expref: 21 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785095.391376:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789785095.391383:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+21:3660:x1876725549008512:12345-0@lo:103: 00010000:00010000:1.0:1789785095.391390:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785095.391394:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc1b09600/0x2f18ee3fd845c0c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c0bb expref: 21 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.391402:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc1b09600/0x2f18ee3fd845c0c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c0bb expref: 21 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.391413:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1b09600/0x2f18ee3fd845c0c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c0bb expref: 21 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.391423:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789785095.391513:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc2051a00/0x2f18ee3fd845c0bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c0c2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.391521:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc2051a00/0x2f18ee3fd845c0bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c0c2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.391532:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789785095.391535:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc2050200/0x2f18ee3fd845c075 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c07c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.391541:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc2050200 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:3.0:1789785095.391545:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc2050200/0x2f18ee3fd845c075 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c07c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.391552:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc2050200/0x2f18ee3fd845c075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c07c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789785095.391569:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc2050200/0x2f18ee3fd845c075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c07c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785095.391582:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789785095.391602:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc2050200/0x2f18ee3fd845c075 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c07c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.391608:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789785095.391621:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc2050200/0x2f18ee3fd845c075 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c07c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.391628:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc2050200/0x2f18ee3fd845c075 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c07c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.391637:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789785095.391640:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845c036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c03d expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.391645:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09400 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:3.0:1789785095.391649:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845c036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c03d expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.391655:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845c036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c03d expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789785095.391661:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845c036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c03d expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785095.391666:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789785095.391679:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845c036 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c03d expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.391684:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789785095.391696:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845c036 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c03d expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.391702:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09400/0x2f18ee3fd845c036 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c03d expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.391711:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789785095.391713:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08400/0x2f18ee3fd845c00c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c013 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.391719:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b08400 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:3.0:1789785095.391722:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08400/0x2f18ee3fd845c00c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c013 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.391728:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08400/0x2f18ee3fd845c00c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c013 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789785095.391734:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08400/0x2f18ee3fd845c00c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c013 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785095.391740:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789785095.391752:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08400/0x2f18ee3fd845c00c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c013 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.391757:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789785095.391799:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549008640:0@lo:103: 00000100:00100000:2.0:1789785095.391825:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785095.391842:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789785095.391848:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549008768:0@lo:103: 00000100:00100000:2.0:1789785095.391880:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785095.391896:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549008896:0@lo:103: 00000100:00100000:2.0:1789785095.391913:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785095.391928:0:7484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549008640 00000100:00100000:2.0:1789785095.391931:0:7484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549008640 00010000:00010000:2.0:1789785095.391943:0:7484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dae81ead000/0x2f18ee3fd845c07c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c075 expref: 21 pid: 6528 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785095.391953:0:7484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549008768 00000100:00100000:2.0:1789785095.391955:0:7484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549008768 00010000:00010000:2.0:1789785095.391967:0:7484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dae81eade00/0x2f18ee3fd845c03d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c036 expref: 22 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785095.391979:0:7484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549008896 00000100:00100000:2.0:1789785095.391981:0:7484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549008896 00010000:00010000:2.0:1789785095.391991:0:7484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dae81eac200/0x2f18ee3fd845c013 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c00c expref: 23 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785095.392003:0:7484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789785095.392023:0:7484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e00759f-51ad-47f9-8892-382c83919083+23:3661:x1876725549008640:12345-0@lo:103: 00010000:00010000:2.0:1789785095.392031:0:7484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785095.392035:0:7484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dae81ead000/0x2f18ee3fd845c07c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c075 expref: 23 pid: 6528 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.392043:0:7484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dae81ead000/0x2f18ee3fd845c07c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c075 expref: 23 pid: 6528 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.392052:0:7484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dae81ead000/0x2f18ee3fd845c07c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c075 expref: 23 pid: 6528 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.392060:0:7484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785095.392087:0:7484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e00759f-51ad-47f9-8892-382c83919083+22:3661:x1876725549008640:12345-0@lo:103: Request processed in 65us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785095.392099:0:7484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789785095.392112:0:7484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789785095.392119:0:7484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e00759f-51ad-47f9-8892-382c83919083+21:3661:x1876725549008768:12345-0@lo:103: 00010000:00010000:2.0:1789785095.392135:0:7484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785095.392144:0:7484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dae81eade00/0x2f18ee3fd845c03d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c036 expref: 21 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.392152:0:7484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dae81eade00/0x2f18ee3fd845c03d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c036 expref: 21 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.392164:0:7484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dae81eade00/0x2f18ee3fd845c03d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c036 expref: 21 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.392172:0:7484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785095.392198:0:7484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e00759f-51ad-47f9-8892-382c83919083+20:3661:x1876725549008768:12345-0@lo:103: Request processed in 80us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785095.392211:0:7484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789785095.392223:0:7484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789785095.392228:0:7484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e00759f-51ad-47f9-8892-382c83919083+19:3659:x1876725549008896:12345-0@lo:103: 00010000:00010000:2.0:1789785095.392236:0:7484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785095.392240:0:7484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dae81eac200/0x2f18ee3fd845c013 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c00c expref: 19 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.392247:0:7484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dae81eac200/0x2f18ee3fd845c013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c00c expref: 19 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.392257:0:7484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dae81eac200/0x2f18ee3fd845c013 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c00c expref: 19 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.392264:0:7484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785095.392288:0:7484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e00759f-51ad-47f9-8892-382c83919083+18:3659:x1876725549008896:12345-0@lo:103: Request processed in 60us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785095.392294:0:7484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789785095.392327:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549008768:0@lo:103: 00000100:00100000:2.0:1789785095.392335:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549008640:0@lo:103: 00000100:00100000:2.0:1789785095.392385:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549008896:0@lo:103: 00000100:00100000:1.0:1789785095.392407:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+17:3660:x1876725549008512:12345-0@lo:103: Request processed in 1024us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785095.392411:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549008512:0@lo:103: 00000100:00100000:1.0:1789785095.392479:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1789785095.392642:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08400/0x2f18ee3fd845c00c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c013 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.392650:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08400/0x2f18ee3fd845c00c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c013 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.392660:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789785095.392669:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c108 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.392675:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eac600 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:3.0:1789785095.392678:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c108 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.392684:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c108 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789785095.392691:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c108 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785095.392696:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789785095.392751:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c101 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c108 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.392758:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789785095.392768:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c101 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c108 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.392775:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c101 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c108 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.392784:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785095.392786:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785095.392788:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785095.392820:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789785095.392829:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549009024:0@lo:103: 00000100:00100000:2.0:1789785095.392854:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785095.392942:0:7484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549009024 00000100:00100000:3.0:1789785095.392946:0:7484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549009024 00010000:00010000:3.0:1789785095.392964:0:7484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc2050000/0x2f18ee3fd845c108 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c101 expref: 17 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785095.393030:0:7484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789785095.393037:0:7484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e00759f-51ad-47f9-8892-382c83919083+17:3659:x1876725549009024:12345-0@lo:103: 00010000:00010000:3.0:1789785095.393045:0:7484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785095.393049:0:7484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc2050000/0x2f18ee3fd845c108 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c101 expref: 17 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.393058:0:7484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc2050000/0x2f18ee3fd845c108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c101 expref: 17 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785095.393064:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1876725549007488:0@lo:104: 00010000:00010000:3.0:1789785095.393068:0:7484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc2050000/0x2f18ee3fd845c108 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c101 expref: 17 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.393076:0:7484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789785095.393095:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c11d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785095.393103:0:7484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e00759f-51ad-47f9-8892-382c83919083+16:3659:x1876725549009024:12345-0@lo:103: Request processed in 68us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785095.393111:0:7484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789785095.393159:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549009024:0@lo:103: 00010000:00010000:1.0:1789785095.393165:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785095.393171:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dae81ead200/0x2f18ee3fd845c091 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c098 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.393188:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81ead200 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:1.0:1789785095.393192:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dae81ead200/0x2f18ee3fd845c091 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c098 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.393199:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dae81ead200/0x2f18ee3fd845c091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c098 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789785095.393207:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dae81ead200/0x2f18ee3fd845c091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c098 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785095.393212:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789785095.393243:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dae81ead200/0x2f18ee3fd845c091 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c098 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.393250:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789785095.393270:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dae81ead200/0x2f18ee3fd845c091 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c098 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.393275:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dae81ead200/0x2f18ee3fd845c091 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c098 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.393286:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785095.393288:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785095.393289:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785095.393294:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785095.393296:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785095.393430:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549009152:0@lo:103: 00000100:00100000:3.0:1789785095.393456:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785095.395238:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549009152 00000100:00100000:1.0:1789785095.395250:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549009152 00010000:00010000:1.0:1789785095.395287:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dae81eacc00/0x2f18ee3fd845c098 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c091 expref: 16 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785095.395446:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789785095.395456:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb414000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+16:3661:x1876725549009152:12345-0@lo:103: 00010000:00010000:1.0:1789785095.395468:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785095.395474:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dae81eacc00/0x2f18ee3fd845c098 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c091 expref: 16 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.395487:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dae81eacc00/0x2f18ee3fd845c098 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c091 expref: 16 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.395504:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dae81eacc00/0x2f18ee3fd845c098 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c091 expref: 16 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.395517:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c11d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.395525:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c11d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.395541:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c11d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.395548:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c11d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.395566:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c11d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.395572:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c11d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.395588:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc2051400 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785095.395592:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c11d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.395599:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c11d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.395776:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c11d lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.395785:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c11d lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789785095.395794:0:6526:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:1.0:1789785095.395845:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c11d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.395854:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c11d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.395882:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785095.395984:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb414000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+15:3661:x1876725549009152:12345-0@lo:103: Request processed in 530us (2526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785095.395991:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789785095.396049:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549009152:0@lo:103: 00000100:00100000:3.0:1789785095.401297:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+14:9527:x1876725549007360:12345-0@lo:253: Request processed in 21273us (21515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785095.401323:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789785095.401393:0:9527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549007360:0@lo:253: 10000000:01000000:2.0:1789785095.401416:0:9527:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789785095.401419:0:9527:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789785095.401420:0:9527:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789785095.401421:0:9527:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789785095.401423:0:9527:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789785095.401424:0:9527:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789785095.401425:0:9527:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789785095.401426:0:9527:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789785095.401428:0:9527:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789785095.401429:0:9527:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789785095.401431:0:9527:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789785095.401453:0:9527:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dae829a7000 from lustre-OST0001 10000000:01000000:2.0:1789785095.401483:0:9527:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789785095.401486:0:9527:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789785095.401496:0:9527:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9daf983fcd28 local copy 10000000:01000000:2.0:1789785095.401500:0:9527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789785095.401534:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c124 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.401545:0:9527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c124 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.401555:0:9527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c124 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785095.401572:0:9527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549009280:0@lo:101: 00000100:00100000:2.0:1789785095.401609:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785095.401636:0:9527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae82a3e000 going to sleep for 11 seconds 00000100:00100000:0.0:1789785095.401696:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549009280 00000100:00100000:0.0:1789785095.401702:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549009280 00000100:00100000:0.0:1789785095.401746:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789785095.401755:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+14:9527:x1876725549009280:12345-0@lo:101: 00010000:00010000:0.0:1789785095.401768:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785095.401782:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845c12b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c124 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785095.401810:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845c12b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c124 expref: 15 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785095.401820:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845c12b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c124 expref: 15 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785095.401836:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eadc00, rc 0) 00000100:00100000:0.0:1789785095.401883:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+15:9527:x1876725549009280:12345-0@lo:101: Request processed in 129us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785095.401890:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789785095.401975:0:9527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549009280:0@lo:101: 00010000:00010000:2.0:1789785095.401988:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c124 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2f18ee3fd845c12b expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.402008:0:9527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c124 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2f18ee3fd845c12b expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785095.402088:0:9527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549009408:0@lo:501: 00000100:00100000:2.0:1789785095.402114:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785095.402135:0:9527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae82a3e000 going to sleep for 11 seconds 00000100:00100000:3.0:1789785095.402192:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549009408 00000100:00100000:3.0:1789785095.402196:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549009408 00000100:00100000:3.0:1789785095.402225:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789785095.402232:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:9527:x1876725549009408:12345-0@lo:501: 00000100:00100000:3.0:1789785095.402302:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:9527:x1876725549009408:12345-0@lo:501: Request processed in 70us (187us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789785095.402308:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789785095.402382:0:9527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549009408:0@lo:501: 10000000:01000000:2.0:1789785095.402393:0:9527:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.146@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789785095.402410:0:9527:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.146@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789785095.402416:0:9527:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c124 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2f18ee3fd845c12b expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.402423:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c124 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2f18ee3fd845c12b expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.402429:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c124 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2f18ee3fd845c12b expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.402450:0:9527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789785095.402473:0:9527:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dae829a7000 10000000:01000000:2.0:1789785095.402478:0:9527:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789785095.402483:0:9527:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789785095.402486:0:9527:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789785095.402491:0:9527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789785095.402493:0:9527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789785095.402510:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c132 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.402527:0:9527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c132 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.402534:0:9527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c132 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785095.402546:0:9527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549009536:0@lo:101: 00000100:00100000:2.0:1789785095.402571:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785095.402600:0:9527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae82a3ee40 going to sleep for 11 seconds 00010000:00010000:3.0:1789785095.402651:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789785095.402657:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c124 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2f18ee3fd845c12b expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.402664:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09800 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:3.0:1789785095.402668:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c124 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2f18ee3fd845c12b expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.402676:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c124 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x2f18ee3fd845c12b expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789785095.402683:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c124 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x2f18ee3fd845c12b expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785095.402688:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789785095.402707:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c124 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2f18ee3fd845c12b expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.402713:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789785095.402740:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c124 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2f18ee3fd845c12b expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.402759:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c124 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2f18ee3fd845c12b expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.402771:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785095.402772:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785095.402774:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785095.402781:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789785095.402791:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549009664:0@lo:103: 00000100:00100000:3.0:1789785095.402817:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785095.402890:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549009664 00000100:00100000:2.0:1789785095.402894:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549009664 00000100:00100000:2.0:1789785095.402933:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789785095.402941:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb415880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e00759f-51ad-47f9-8892-382c83919083+15:3661:x1876725549009664:12345-0@lo:103: 00010000:00010000:2.0:1789785095.402950:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785095.402962:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845c12b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f18ee3fd845c124 expref: 15 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.402975:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785095.403004:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb415880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e00759f-51ad-47f9-8892-382c83919083+14:3661:x1876725549009664:12345-0@lo:103: Request processed in 65us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785095.403010:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789785095.403033:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549009664:0@lo:103: 00000100:00100000:1.0:1789785095.403206:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549009536 00000100:00100000:1.0:1789785095.403212:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549009536 00000100:00100000:1.0:1789785095.403255:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789785095.403263:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+14:9527:x1876725549009536:12345-0@lo:101: 00010000:00010000:1.0:1789785095.403273:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785095.403284:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc2050400/0x2f18ee3fd845c139 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c132 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.403301:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc2050400/0x2f18ee3fd845c139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c132 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.403311:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc2050400/0x2f18ee3fd845c139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c132 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.403327:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc2050400, rc 0) 00000100:00100000:1.0:1789785095.403385:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+15:9527:x1876725549009536:12345-0@lo:101: Request processed in 123us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785095.403392:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789785095.403443:0:9527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549009536:0@lo:101: 00010000:00010000:2.0:1789785095.403456:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c132 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c139 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.403463:0:9527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c132 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c139 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785095.403531:0:9527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549009792:0@lo:501: 00000100:00100000:2.0:1789785095.403559:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785095.403588:0:9527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae82a3ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789785095.403678:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549009792 00000100:00100000:1.0:1789785095.403682:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549009792 00000100:00100000:1.0:1789785095.403715:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789785095.403722:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:9527:x1876725549009792:12345-0@lo:501: 00000100:00100000:1.0:1789785095.403826:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:9527:x1876725549009792:12345-0@lo:501: Request processed in 104us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785095.403833:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789785095.403857:0:9527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549009792:0@lo:501: 00000100:00100000:3.0:1789785095.403900:0:9527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb417100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549009920:0@lo:503: 00000100:00100000:3.0:1789785095.403941:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785095.403960:0:9527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab2840 going to sleep for 11 seconds 00000100:00100000:0.0:1789785095.404005:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549009920 00000100:00100000:0.0:1789785095.404009:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549009920 00000100:00100000:0.0:1789785095.404041:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789785095.404048:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+15:9527:x1876725549009920:12345-0@lo:503: 00000100:00100000:0.0:1789785095.404135:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+15:9527:x1876725549009920:12345-0@lo:503: Request processed in 86us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785095.404141:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789785095.404229:0:9527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb417100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549009920:0@lo:503: 00000040:00080000:3.0:1789785095.405526:0:9527:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789785095.405615:0:9527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb417100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549010048:0@lo:502: 00000100:00100000:3.0:1789785095.405673:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785095.405718:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549010048 00000100:00100000:3.0:1789785095.405721:0:9527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab2000 going to sleep for 11 seconds 00000100:00100000:2.0:1789785095.405726:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549010048 00000100:00100000:2.0:1789785095.405771:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789785095.405780:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+15:9527:x1876725549010048:12345-0@lo:502: 00000100:00100000:2.0:1789785095.405887:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+15:9527:x1876725549010048:12345-0@lo:502: Request processed in 108us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785095.405895:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789785095.406109:0:9527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb417100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549010048:0@lo:502: 00000040:00080000:3.0:1789785095.406279:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789785095.406304:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789785095.406317:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789785095.406327:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789785095.406732:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789785095.406761:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789785095.406788:0:9527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb417100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549010176:0@lo:502: 00000100:00100000:3.0:1789785095.406837:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785095.406859:0:9527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab2000 going to sleep for 11 seconds 00000100:00100000:0.0:1789785095.407180:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549010176 00000100:00100000:0.0:1789785095.407186:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549010176 00000100:00100000:0.0:1789785095.407230:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789785095.407239:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+15:9527:x1876725549010176:12345-0@lo:502: 00000100:00100000:0.0:1789785095.407561:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+15:9527:x1876725549010176:12345-0@lo:502: Request processed in 323us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785095.407581:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789785095.408091:0:9527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb417100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549010176:0@lo:502: 00000040:00080000:3.0:1789785095.408149:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789785095.408160:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1789785095.409796:0:9539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789785095.409803:0:9539:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1789785095.409808:0:9539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785095.409810:0:9539:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789785095.409815:0:9539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789785095.409842:0:9539:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9dae82b28000) 00000020:00000080:0.0:1789785095.409874:0:9539:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789785095.409882:0:9539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789785095.409959:0:9539:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dae829a7000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789785095.409972:0:9539:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789785095.409979:0:9539:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2f18ee3fd845c147 00010000:00010000:1.0:1789785095.414584:0:9539:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1789785095.414883:0:9539:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1789785095.417514:0:9539:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789785095.417920:0:9539:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789785095.425105:0:9539:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1789785095.425298:0:9539:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1789785095.435995:0:9539:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1789785095.437400:0:9539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789785095.437411:0:9539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789785095.437418:0:9539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785095.437420:0:9539:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789785095.437424:0:9539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789785095.437428:0:9539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785095.437430:0:9539:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789785095.437433:0:9539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789785095.437435:0:9539:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789785095.437456:0:9539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789785095.437460:0:9539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785095.437461:0:9539:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789785095.437464:0:9539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789785095.437614:0:9527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1789785095.437654:0:9527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789785095.437676:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c132 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c139 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785095.437688:0:9527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c139 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785095.437697:0:9527:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dae829a7000 from 1 10000000:01000000:0.0:1789785095.437700:0:9527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789785095.437734:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81ead400/0x2f18ee3fd845c14e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785095.437742:0:9527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dae81ead400/0x2f18ee3fd845c14e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785095.437754:0:9527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dae81ead400/0x2f18ee3fd845c14e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785095.437777:0:9527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc18c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549010304:0@lo:101: 00000100:00100000:0.0:1789785095.437835:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785095.437887:0:9527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf85828f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789785095.437903:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549010304 00000100:00100000:2.0:1789785095.437912:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549010304 00000100:00100000:2.0:1789785095.437974:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789785095.437983:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+15:9527:x1876725549010304:12345-0@lo:101: 00010000:00010000:2.0:1789785095.437998:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785095.438009:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1b09c00/0x2f18ee3fd845c155 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c14e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.438033:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1b09c00/0x2f18ee3fd845c155 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c14e expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.438044:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1b09c00/0x2f18ee3fd845c155 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c14e expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.438053:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b09c00, rc 0) 00000100:00100000:2.0:1789785095.438092:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+16:9527:x1876725549010304:12345-0@lo:101: Request processed in 110us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785095.438100:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789785095.438242:0:9527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc18c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549010304:0@lo:101: 00010000:00010000:0.0:1789785095.438255:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dae81ead400/0x2f18ee3fd845c14e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c155 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785095.438264:0:9527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dae81ead400/0x2f18ee3fd845c14e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c155 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785095.438390:0:9527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc18c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549010432:0@lo:501: 00000100:00100000:0.0:1789785095.438417:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785095.438438:0:9527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf85828f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789785095.438502:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549010432 00000100:00100000:2.0:1789785095.438506:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549010432 00000100:00100000:2.0:1789785095.438537:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789785095.438545:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+16:9527:x1876725549010432:12345-0@lo:501: 00000100:00100000:2.0:1789785095.438644:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+16:9527:x1876725549010432:12345-0@lo:501: Request processed in 99us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785095.438651:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789785095.438719:0:9527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc18c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549010432:0@lo:501: 00000100:00100000:0.0:1789785095.438745:0:9527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc18c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549010560:0@lo:503: 00000100:00100000:0.0:1789785095.438784:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785095.438810:0:9527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf85828f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789785095.438857:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549010560 00000100:00100000:2.0:1789785095.438870:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549010560 00000100:00100000:2.0:1789785095.439000:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789785095.439008:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+16:9527:x1876725549010560:12345-0@lo:503: 00000100:00100000:2.0:1789785095.439094:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+16:9527:x1876725549010560:12345-0@lo:503: Request processed in 86us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785095.439106:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789785095.439171:0:9527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc18c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549010560:0@lo:503: 00000040:00080000:0.0:1789785095.439407:0:9527:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789785095.439469:0:9527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc18c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549010688:0@lo:502: 00000100:00100000:0.0:1789785095.439506:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785095.445103:0:9527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf85828f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789785095.445199:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549010688 00000100:00100000:3.0:1789785095.445208:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549010688 00000100:00100000:3.0:1789785095.445249:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789785095.445257:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+16:9527:x1876725549010688:12345-0@lo:502: 00000100:00100000:3.0:1789785095.445419:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+16:9527:x1876725549010688:12345-0@lo:502: Request processed in 162us (5911us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785095.445426:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789785095.445536:0:9527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc18c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549010688:0@lo:502: 00000040:00080000:0.0:1789785095.445787:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789785095.445819:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789785095.445849:0:9527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc18c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549010816:0@lo:502: 00000100:00100000:0.0:1789785095.445967:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785095.445996:0:9527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf85828f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789785095.446051:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549010816 00000100:00100000:3.0:1789785095.446056:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549010816 00000100:00100000:3.0:1789785095.446074:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789785095.446079:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+16:9527:x1876725549010816:12345-0@lo:502: 00000100:00100000:3.0:1789785095.446153:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+16:9527:x1876725549010816:12345-0@lo:502: Request processed in 72us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785095.446160:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789785095.446304:0:9527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc18c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549010816:0@lo:502: 00000040:00080000:0.0:1789785095.446360:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789785095.446368:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789785095.446783:0:9543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789785095.446792:0:9543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785095.446794:0:9543:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789785095.446807:0:9543:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dae829a7000 00000020:00000080:0.0:1789785095.446810:0:9543:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789785095.446823:0:9543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785095.446827:0:9543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785095.446828:0:9543:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789785095.446831:0:9543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789785095.447006:0:9527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789785095.447030:0:9527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789785095.447053:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81ead400/0x2f18ee3fd845c14e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c155 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.447064:0:9527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dae81ead400/0x2f18ee3fd845c14e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c155 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785095.447110:0:9527:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789785095.447119:0:9527:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dae829a7000 10000000:01000000:3.0:1789785095.447122:0:9527:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dae829a7000 10000000:01000000:3.0:1789785095.447126:0:9527:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789785095.447131:0:9527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dae829a7000 from 1 10000000:01000000:3.0:1789785095.447133:0:9527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789785095.447160:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21cbc00/0x2f18ee3fd845c15c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.447168:0:9527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc21cbc00/0x2f18ee3fd845c15c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.447177:0:9527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc21cbc00/0x2f18ee3fd845c15c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785095.447193:0:9527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb417100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549010944:0@lo:101: 00000100:00100000:3.0:1789785095.447229:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785095.447256:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549010944 00000100:00100000:3.0:1789785095.447261:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549010944 00000100:00100000:3.0:1789785095.447284:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789785095.447290:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+16:9527:x1876725549010944:12345-0@lo:101: 00010000:00010000:3.0:1789785095.447300:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785095.447311:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc21caa00/0x2f18ee3fd845c163 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c15c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.447330:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc21caa00/0x2f18ee3fd845c163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c15c expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.447365:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc21caa00/0x2f18ee3fd845c163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c15c expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.447374:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc21caa00, rc 0) 00000100:00100000:3.0:1789785095.447409:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+17:9527:x1876725549010944:12345-0@lo:101: Request processed in 118us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785095.447415:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789785095.447449:0:9527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789785095.447463:0:9527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb417100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549010944:0@lo:101: 00010000:00010000:3.0:1789785095.447476:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc21cbc00/0x2f18ee3fd845c15c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c163 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.447484:0:9527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc21cbc00/0x2f18ee3fd845c15c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c163 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785095.447542:0:9527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb417100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549011072:0@lo:501: 00000100:00100000:3.0:1789785095.447564:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785095.447584:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549011072 00000100:00100000:3.0:1789785095.447587:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549011072 00000100:00100000:3.0:1789785095.447605:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789785095.447611:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+17:9527:x1876725549011072:12345-0@lo:501: 00000100:00100000:3.0:1789785095.447688:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+17:9527:x1876725549011072:12345-0@lo:501: Request processed in 77us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785095.447694:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789785095.447716:0:9527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789785095.447727:0:9527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb417100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549011072:0@lo:501: 00000100:00100000:3.0:1789785095.447753:0:9527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb417100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549011200:0@lo:503: 00000100:00100000:3.0:1789785095.447790:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785095.447808:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549011200 00000100:00100000:3.0:1789785095.447813:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549011200 00000100:00100000:3.0:1789785095.447829:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789785095.447845:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+17:9527:x1876725549011200:12345-0@lo:503: 00000100:00100000:3.0:1789785095.447932:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+17:9527:x1876725549011200:12345-0@lo:503: Request processed in 88us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785095.447939:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789785095.447968:0:9527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafa640b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785095.447982:0:9527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb417100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549011200:0@lo:503: 00000040:00080000:3.0:1789785095.448174:0:9527:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789785095.448235:0:9527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb417100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549011328:0@lo:502: 00000100:00100000:3.0:1789785095.448267:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785095.448289:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549011328 00000100:00100000:3.0:1789785095.448292:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549011328 00000100:00100000:3.0:1789785095.448309:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789785095.448315:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+17:9527:x1876725549011328:12345-0@lo:502: 00000100:00100000:3.0:1789785095.448402:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+17:9527:x1876725549011328:12345-0@lo:502: Request processed in 87us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785095.448409:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789785095.448437:0:9527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafa640b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785095.448450:0:9527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb417100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549011328:0@lo:502: 00000040:00080000:3.0:1789785095.448607:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789785095.448632:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789785095.448648:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789785095.448662:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789785095.448674:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789785095.448687:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789785095.448699:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789785095.448712:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789785095.448726:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789785095.448748:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789785095.448764:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789785095.448776:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789785095.448789:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789785095.448816:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789785095.448832:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789785095.448846:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789785095.448859:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789785095.448886:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789785095.448899:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789785095.448912:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789785095.448926:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789785095.448939:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789785095.448952:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789785095.448965:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789785095.448979:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1789785095.448991:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1789785095.449004:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1789785095.449017:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1789785095.449031:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1789785095.449057:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1789785095.449072:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1789785095.449086:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1789785095.449098:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1789785095.449111:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1789785095.449125:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1789785095.449138:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1789785095.449150:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1789785095.449162:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1789785095.449175:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1789785095.449188:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1789785095.449202:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1789785095.449214:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1789785095.449240:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1789785095.449256:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1789785095.449270:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1789785095.449296:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1789785095.449321:0:9527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb417100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549011456:0@lo:502: 00000100:00100000:3.0:1789785095.449382:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785095.449411:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549011456 00000100:00100000:3.0:1789785095.449416:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549011456 00000100:00100000:3.0:1789785095.449438:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789785095.449444:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+17:9527:x1876725549011456:12345-0@lo:502: 00000100:00100000:3.0:1789785095.449515:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+17:9527:x1876725549011456:12345-0@lo:502: Request processed in 70us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785095.449521:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789785095.449554:0:9527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8280ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1789785095.449568:0:9527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb417100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549011456:0@lo:502: 00000040:00080000:3.0:1789785095.449603:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1789785095.449610:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1789785095.450270:0:9544:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789785095.450283:0:9544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9dafbb223370) 00000020:00000080:2.0:1789785095.450303:0:9544:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1789785095.450399:0:9544:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dae829a7000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789785095.450403:0:9544:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dae829a7000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789785095.450406:0:9544:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dae829a7000 3 00010000:00080000:2.0:1789785095.450431:0:9544:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dae829b5000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.146@tcp at head 00010000:00010000:2.0:1789785095.453002:0:9544:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1789785095.453208:0:9544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789785095.453248:0:9544:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789785095.453259:0:9544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2f18ee3fd845c171 00000100:00080000:2.0:1789785095.453268:0:9544:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789785095.453273:0:9544:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dae829b5000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:2.0:1789785095.453304:0:9544:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafc1b38380 x1876725549011584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789785095.453376:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1876725549011584:0@lo:38: 00000100:00100000:0.0:1789785095.453435:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789785095.456526:0:9544:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000020:01000004:2.0:1789785095.456938:0:9544:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789785095.456963:0:9544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9dae83720000) 00000020:00000080:2.0:1789785095.456986:0:9544:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1789785095.457080:0:9544:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dae829a7000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789785095.457085:0:9544:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dae829a7000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789785095.457088:0:9544:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dae829a7000 3 00000100:00080000:3.0:1789785095.457111:0:9546:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9dafbb417100 x1876725549011712/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785095.457124:0:9546:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8280ac00 going to sleep for 0 seconds 00010000:00080000:2.0:1789785095.457140:0:9544:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dae83733000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.146@tcp at head 00010000:00010000:2.0:1789785095.459365:0:9544:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1789785095.459585:0:9544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1789785095.459628:0:9544:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789785095.459640:0:9544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x2f18ee3fd845c17f 00000100:00080000:2.0:1789785095.459655:0:9544:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789785095.459660:0:9544:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9dae83733000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:2.0:1789785095.459694:0:9544:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafc1b3aa00 x1876725549011840/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789785095.460022:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3658:1876725549011840:0@lo:38: 00000100:00100000:0.0:1789785095.460090:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785095.460156:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549011584 00000100:00100000:0.0:1789785095.460163:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549011584 00000100:00100000:0.0:1789785095.460191:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549011840 00000100:00100000:0.0:1789785095.460194:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549011840 00000100:00100000:0.0:1789785095.460213:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789785095.460221:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1876725549011584:12345-0@lo:38: 00010000:00080000:0.0:1789785095.460242:0:6535:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:0.0:1789785095.460270:0:6535:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2f18ee3fd845c186 00000004:00100000:0.0:1789785095.460284:0:6535:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789785095.460313:0:6535:0:(import.c:65:import_set_state_nolock()) ffff9dae81ecd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789785095.460380:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1876725549011584:12345-0@lo:38: Request processed in 158us (6944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785095.460388:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789785095.460403:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789785095.460407:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1876725549011840:12345-0@lo:38: 00010000:00080000:0.0:1789785095.460421:0:6535:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:0.0:1789785095.460452:0:6535:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x2f18ee3fd845c18d 00000004:00100000:0.0:1789785095.460459:0:6535:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789785095.460481:0:6535:0:(import.c:65:import_set_state_nolock()) ffff9dae81ec8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789785095.460512:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1876725549011840:12345-0@lo:38: Request processed in 103us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785095.460519:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789785095.460714:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafc1b3aa00 x1876725549011840/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789785105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785095.460724:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789785095.460731:0:3658:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789785095.460738:0:3658:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789785095.460742:0:3658:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789785095.460744:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dae83733000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789785095.460750:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3658:1876725549011840:0@lo:38: 00010000:00080000:0.0:1789785095.460763:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafc1b38380 x1876725549011584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789785105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785095.460771:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789785095.460774:0:3658:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789785095.460778:0:3658:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789785095.460781:0:3658:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789785095.460783:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dae829b5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789785095.460788:0:3658:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000a24c2a08): req@ffff9dafbb417100 x1876725549011712/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785095.460805:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1876725549011584:0@lo:38: 00000100:00100000:0.0:1789785095.460858:0:9546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785095.460965:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549011712 00000100:00100000:0.0:1789785095.460970:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549011712 00000100:00100000:0.0:1789785095.461007:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789785095.461021:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9546:x1876725549011712:12345-0@lo:901: 00000100:00100000:0.0:1789785095.461095:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9546:x1876725549011712:12345-0@lo:901: Request processed in 75us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785095.461102:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789785095.461119:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789785095.461142:0:9546:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafbb417100 x1876725549011712/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789785111 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785095.461152:0:9546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb417100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9546:1876725549011712:0@lo:901: 00000100:00100000:0.0:1789785095.461991:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549011968:0@lo:400: 00000100:00100000:0.0:1789785095.462033:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785095.462059:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549012480:0@lo:400: 00000100:00100000:0.0:1789785095.462089:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785095.462110:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789785095.462116:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549012096:0@lo:400: 00000100:00100000:0.0:1789785095.462146:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785095.462164:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549012608:0@lo:400: 00000100:00100000:0.0:1789785095.462190:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785095.462223:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549011968 00000100:00100000:0.0:1789785095.462229:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549011968 00000100:00100000:0.0:1789785095.462262:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549012480 00000100:00100000:0.0:1789785095.462265:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549012480 00000100:00100000:0.0:1789785095.462283:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549012608 00000100:00100000:0.0:1789785095.462285:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549012608 00000100:00100000:0.0:1789785095.462301:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789785095.462308:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549011968:12345-0@lo:400: 00000100:00100000:0.0:1789785095.462997:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549011968:12345-0@lo:400: Request processed in 686us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785095.463012:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789785095.463033:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789785095.463041:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549012480:12345-0@lo:400: 00000100:00100000:0.0:1789785095.463075:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549012480:12345-0@lo:400: Request processed in 36us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785095.463081:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789785095.463093:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789785095.463100:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549012608:12345-0@lo:400: 00000100:00100000:0.0:1789785095.463124:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549012608:12345-0@lo:400: Request processed in 25us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785095.463130:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789785095.463151:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549012096 00000100:00100000:0.0:1789785095.463155:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549012096 00000100:00100000:0.0:1789785095.463180:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789785095.463187:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549012096:12345-0@lo:400: 00000100:00100000:0.0:1789785095.463218:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549012096:12345-0@lo:400: Request processed in 32us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785095.463224:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1789785095.463245:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789785095.463248:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789785095.463277:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549012096:0@lo:400: 00010000:00080000:0.0:1789785095.463290:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae83875500 x1876725549012608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785095.463299:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549012608:0@lo:400: 00010000:00080000:0.0:1789785095.463308:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafb113ce00 x1876725549011968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785095.463323:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549011968:0@lo:400: 00010000:00080000:0.0:1789785095.463333:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae83874e00 x1876725549012480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785095.463356:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549012480:0@lo:400: 00000100:00100000:2.0:1789785095.464017:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549012224:0@lo:400: 00000100:00100000:2.0:1789785095.464057:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785095.464079:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549012736:0@lo:400: 00000100:00100000:2.0:1789785095.464101:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785095.464121:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789785095.464128:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549012352:0@lo:400: 00000100:00100000:2.0:1789785095.464151:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785095.464172:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549012864:0@lo:400: 00000100:00100000:2.0:1789785095.464196:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785095.464238:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549012352 00000100:00100000:2.0:1789785095.464243:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549012352 00000100:00100000:2.0:1789785095.464277:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789785095.464286:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549012352:12345-0@lo:400: 00000100:00100000:2.0:1789785095.464526:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549012352:12345-0@lo:400: Request processed in 52us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785095.464535:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789785095.464699:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549012352:0@lo:400: 00000100:00080000:2.0:1789785095.464725:0:9544:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789785095.464882:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549012736 00000100:00100000:0.0:1789785095.465972:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549012736 00000100:00100000:0.0:1789785095.466020:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549012864 00000100:00100000:0.0:1789785095.466025:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549012864 00000100:00100000:0.0:1789785095.466048:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789785095.466057:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549012736:12345-0@lo:400: 00000100:00100000:0.0:1789785095.466121:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549012736:12345-0@lo:400: Request processed in 64us (2017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785095.466128:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789785095.466143:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789785095.466149:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549012864:12345-0@lo:400: 00000100:00100000:0.0:1789785095.466177:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549012864:12345-0@lo:400: Request processed in 28us (1981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785095.466183:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789785095.466227:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae83877100 x1876725549012864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785095.466239:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549012864:0@lo:400: 00010000:00080000:0.0:1789785095.466251:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae83876680 x1876725549012736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785095.466259:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549012736:0@lo:400: 00000100:00080000:0.0:1789785095.466291:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789785095.466307:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549012224 00000100:00100000:0.0:1789785095.466311:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549012224 00000100:00100000:0.0:1789785095.466349:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789785095.466358:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549012224:12345-0@lo:400: 00000100:00100000:0.0:1789785095.466394:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549012224:12345-0@lo:400: Request processed in 38us (2336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785095.466400:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1789785095.466425:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafb113c000 x1876725549012224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785095.466435:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549012224:0@lo:400: 00000040:00080000:2.0:1789785095.468170:0:9544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1789785095.468315:0:9527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1789785095.468392:0:9527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789785095.468418:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21cbc00/0x2f18ee3fd845c15c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c163 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.468430:0:9527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc21cbc00/0x2f18ee3fd845c15c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c163 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789785095.468473:0:9527:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789785095.468478:0:9527:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789785095.468480:0:9527:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789785095.468481:0:9527:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789785095.468482:0:9527:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789785095.468484:0:9527:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789785095.468485:0:9527:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789785095.468486:0:9527:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789785095.468487:0:9527:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789785095.468489:0:9527:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789785095.468490:0:9527:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789785095.468494:0:9527:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1789785095.468496:0:9527:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789785095.468497:0:9527:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789785095.468498:0:9527:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789785095.468499:0:9527:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789785095.468500:0:9527:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789785095.468501:0:9527:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789785095.468502:0:9527:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789785095.468503:0:9527:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789785095.468504:0:9527:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789785095.468505:0:9527:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789785095.468506:0:9527:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789785095.468527:0:9527:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789785095.468625:0:9527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549012992:0@lo:253: 00000100:00100000:3.0:1789785095.468687:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785095.468717:0:9527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8280ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1789785095.468742:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549012992 00000100:00100000:3.0:1789785095.468747:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549012992 00000100:00100000:3.0:1789785095.468777:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789785095.468784:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+17:9527:x1876725549012992:12345-0@lo:253: 20000000:01000000:3.0:1789785095.468806:0:6526:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789785095.468818:0:6526:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789785095.476811:0:6526:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789785095.476857:0:6526:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789785095.476969:0:6549:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789785095.476974:0:6549:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789785095.476995:0:6549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c194 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.477015:0:6549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dae81eaca00/0x2f18ee3fd845c08a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c083 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.477027:0:6549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc2050e00/0x2f18ee3fd845c0d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c0c9 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.477035:0:6549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c194 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.477086:0:6549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc2050e00/0x2f18ee3fd845c0d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c0c9 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.477101:0:6549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dafc2050e00/0x2f18ee3fd845c0d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c0c9 expref: 17 pid: 6528 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785095.477116:0:6549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83877800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1876725549013120:0@lo:104: 00000100:00100000:1.0:1789785095.477170:0:6549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785095.477202:0:9527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e00759f-51ad-47f9-8892-382c83919083:9527:1876725549012992:0@lo:253: 10000000:01000000:0.0:1789785095.477217:0:9527:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789785095.477220:0:9527:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789785095.477222:0:9527:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789785095.477224:0:9527:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789785095.477226:0:9527:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789785095.477228:0:9527:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789785095.477229:0:9527:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789785095.477231:0:9527:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789785095.477232:0:9527:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789785095.477234:0:9527:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789785095.477235:0:9527:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789785095.477237:0:9527:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789785095.477253:0:9527:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1789785095.477261:0:6549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dae81eaca00/0x2f18ee3fd845c08a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c083 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785095.477273:0:6549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dae81eaca00/0x2f18ee3fd845c08a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c083 expref: 17 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785095.477282:0:6549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83874000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1876725549013248:0@lo:104: 00000100:00100000:1.0:1789785095.477304:0:6549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785095.477384:0:6549:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1ae3900 going to sleep for 11 seconds 00000100:00100000:2.0:1789785095.477428:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549013120 00000100:00100000:2.0:1789785095.477434:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549013120 00000100:00100000:3.0:1789785095.477461:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+17:9527:x1876725549012992:12345-0@lo:253: Request processed in 8553us (8650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785095.477485:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789785095.477488:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549013248 00000100:00100000:2.0:1789785095.477501:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549013248 00000100:00100000:2.0:1789785095.477528:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789785095.477538:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83875880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+4:6549:x1876725549013120:12345-0@lo:104: 00010000:00010000:2.0:1789785095.477549:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c0c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c0d0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.477601:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789785095.477606:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83875880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+4:6549:x1876725549013120:12345-0@lo:104: Request processed in 71us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785095.477612:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789785095.477626:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789785095.477632:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83876d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+3:6549:x1876725549013248:12345-0@lo:104: 00010000:00010000:2.0:1789785095.477639:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dae81ead800/0x2f18ee3fd845c083 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c08a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.477672:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789785095.477678:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83876d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+3:6549:x1876725549013248:12345-0@lo:104: Request processed in 46us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785095.477686:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1789785095.477706:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789785095.477711:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c0c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c0d0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.477718:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc2051600 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:2.0:1789785095.477723:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c0c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c0d0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.477731:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c0c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c0d0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789785095.477749:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c0c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c0d0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785095.477755:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1789785095.477766:0:6549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83877800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1876725549013120:0@lo:104: 00000100:00100000:3.0:1789785095.477778:0:6549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83874000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1876725549013248:0@lo:104: 00010000:00010000:2.0:1789785095.477786:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c0c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c0d0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.477794:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789785095.477795:0:6549:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c194 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.477814:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c0c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c0d0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.477823:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c0c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c0d0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.477834:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789785095.477838:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dae81ead800/0x2f18ee3fd845c083 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c08a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.477843:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81ead800 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:2.0:1789785095.477846:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dae81ead800/0x2f18ee3fd845c083 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c08a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.477852:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dae81ead800/0x2f18ee3fd845c083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c08a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789785095.477868:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dae81ead800/0x2f18ee3fd845c083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c08a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785095.477874:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789785095.477898:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dae81ead800/0x2f18ee3fd845c083 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c08a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.477903:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789785095.477909:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dae81ead800/0x2f18ee3fd845c083 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c08a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.477915:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dae81ead800/0x2f18ee3fd845c083 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c08a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.477927:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785095.477929:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785095.477930:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785095.477948:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549013376:0@lo:103: 00000100:00100000:2.0:1789785095.477977:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785095.478005:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789785095.478011:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549013504:0@lo:103: 00000100:00100000:2.0:1789785095.478032:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785095.478062:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549013376 00000100:00100000:2.0:1789785095.478065:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549013376 00010000:00010000:2.0:1789785095.478082:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc2050e00/0x2f18ee3fd845c0d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c0c9 expref: 17 pid: 6528 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785095.478100:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549013504 00000100:00100000:2.0:1789785095.478103:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549013504 00010000:00010000:2.0:1789785095.478111:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dae81eaca00/0x2f18ee3fd845c08a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c083 expref: 18 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785095.478128:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789785095.478134:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+18:3659:x1876725549013376:12345-0@lo:103: 00010000:00010000:2.0:1789785095.478153:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785095.478159:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc2050e00/0x2f18ee3fd845c0d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c0c9 expref: 18 pid: 6528 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.478169:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc2050e00/0x2f18ee3fd845c0d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c0c9 expref: 18 pid: 6528 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.478182:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc2050e00/0x2f18ee3fd845c0d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c0c9 expref: 18 pid: 6528 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.478193:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785095.478221:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+17:3659:x1876725549013376:12345-0@lo:103: Request processed in 87us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785095.478227:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789785095.478241:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789785095.478248:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+16:3659:x1876725549013504:12345-0@lo:103: 00010000:00010000:2.0:1789785095.478256:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785095.478261:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dae81eaca00/0x2f18ee3fd845c08a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c083 expref: 16 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.478270:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dae81eaca00/0x2f18ee3fd845c08a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c083 expref: 16 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.478280:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dae81eaca00/0x2f18ee3fd845c08a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c083 expref: 16 pid: 6526 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.478291:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c194 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.478299:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c194 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789785095.478330:0:6520:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004777175s 00010000:00010000:2.0:1789785095.478334:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c194 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.478363:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c194 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.478369:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c194 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.478376:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c194 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.478382:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc2051400 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:2.0:1789785095.478386:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c194 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.478394:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c194 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.478406:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c194 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785095.478416:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789785095.478431:0:6549:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c194 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785095.478442:0:6549:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c194 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785095.478444:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+15:3659:x1876725549013504:12345-0@lo:103: Request processed in 195us (410us total) trans 0 rc 0/0 00010000:00010000:3.0:1789785095.478459:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c194 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785095.478460:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789785095.478517:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549013504:0@lo:103: 00000100:00100000:2.0:1789785095.478525:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549013376:0@lo:103: 00010000:00010000:1.0:1789785095.478733:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1789785095.485259:0:9527:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1789785095.485569:0:9527:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789785095.485908:0:9527:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1789785095.486032:0:9527:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789785095.486167:0:9527:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1789785095.486517:0:9527:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1789785095.487991:0:9527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789785095.510502:0:9527:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789785095.510513:0:9527:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789785095.510553:0:9527:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789785095.510595:0:9527:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.146@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789785095.510612:0:9527:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1789785095.510630:0:9527:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1789785095.511581:0:9527:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789785095.514612:0:9527:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:1.0:1789785096.010869:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549013632:0@lo:41: 00000100:00100000:1.0:1789785096.010944:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785096.019396:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549013632 00000100:00100000:2.0:1789785096.019412:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549013632 00000100:00100000:2.0:1789785096.019473:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789785096.019483:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549013632:12345-0@lo:41: 00000004:00000024:2.0:1789785096.019517:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789785096.019603:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549013632:12345-0@lo:41: Request processed in 121us (8658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785096.019610:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789785096.019894:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549013632:0@lo:41: 00010000:00010000:0.0:1789785096.196211:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789785096.478353:0:9600:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789785096.479619:0:9600:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789785097.224026:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785097.538579:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549013760:0@lo:13: 00000100:00100000:3.0:1789785097.538651:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785097.538765:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549013888:0@lo:41: 00000100:00100000:2.0:1789785097.538797:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785097.538831:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789785097.538837:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549014016:0@lo:13: 00000100:00100000:2.0:1789785097.538869:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785097.538902:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549013760 00000100:00100000:1.0:1789785097.538908:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549013888 00000100:00100000:2.0:1789785097.538910:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549013760 00000100:00100000:1.0:1789785097.538915:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549013888 00000100:00100000:2.0:1789785097.538953:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549014016 00000100:00100000:2.0:1789785097.538957:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549014016 00000100:00100000:1.0:1789785097.538965:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789785097.538977:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549013888:12345-0@lo:41: 00000100:00100000:2.0:1789785097.538979:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789785097.538992:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549013760:12345-0@lo:13: 00000004:00000024:1.0:1789785097.539014:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00002000:00000024:2.0:1789785097.539026:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785097.539069:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549013888:12345-0@lo:41: Request processed in 95us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785097.539090:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1789785097.539126:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789785097.541942:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549013760:12345-0@lo:13: Request processed in 2944us (3283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785097.541954:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789785097.541984:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789785097.541998:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549014016:12345-0@lo:13: 00002000:00000024:2.0:1789785097.542029:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785097.542090:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549014016:12345-0@lo:13: Request processed in 98us (3220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785097.542096:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789785097.542145:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83876300 x1876725549014016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785113 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785097.542165:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549014016:0@lo:13: 00000100:00100000:2.0:1789785097.542181:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549013888:0@lo:41: 00010000:00080000:3.0:1789785097.546470:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae828fc000 x1876725549013760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785113 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785097.546505:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549013760:0@lo:13: 00010000:00010000:1.0:1789785098.242541:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785099.268811:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785100.297133:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789785100.626952:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789785100.626960:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dafb5cd8800 from 39 10000000:01000000:0.0:1789785100.626965:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789785100.627011:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c19b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785100.627023:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c19b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785100.627034:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c19b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785100.627057:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549014144:0@lo:101: 00000100:00100000:0.0:1789785100.627121:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785100.627177:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf987f5600 going to sleep for 11 seconds 00000100:00100000:2.0:1789785100.627499:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549014144 00000100:00100000:2.0:1789785100.627507:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549014144 00000100:00100000:2.0:1789785100.627556:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789785100.627565:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+15:6531:x1876725549014144:12345-0@lo:101: 00010000:00010000:2.0:1789785100.627579:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785100.627592:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1b08400/0x2f18ee3fd845c1a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c19b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785100.627616:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1b08400/0x2f18ee3fd845c1a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c19b expref: 16 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785100.627628:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1b08400/0x2f18ee3fd845c1a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c19b expref: 16 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785100.627638:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b08400, rc 0) 00000100:00100000:2.0:1789785100.627680:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+16:6531:x1876725549014144:12345-0@lo:101: Request processed in 116us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785100.627686:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789785100.627732:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549014144:0@lo:101: 00010000:00010000:2.0:1789785100.627759:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c19b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c1a2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785100.627768:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c19b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c1a2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785100.627837:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549014272:0@lo:501: 00000100:00100000:2.0:1789785100.627865:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785100.627894:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549014272 00000100:00100000:2.0:1789785100.627897:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789785100.627901:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549014272 00000100:00100000:0.0:1789785100.627936:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789785100.627943:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+16:6531:x1876725549014272:12345-0@lo:501: 00000100:00100000:0.0:1789785100.628085:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+16:6531:x1876725549014272:12345-0@lo:501: Request processed in 141us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785100.628091:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725549014400:0@lo:400: 00000100:00100000:0.0:1789785100.628095:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789785100.628143:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785100.628165:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1876725549014912:0@lo:400: 00000100:00100000:1.0:1789785100.628186:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785100.628203:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1876725549015424:0@lo:400: 00000100:00100000:1.0:1789785100.628225:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785100.628244:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789785100.628249:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549014528:0@lo:400: 00000100:00100000:1.0:1789785100.628284:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785100.628301:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725549015040:0@lo:400: 00000100:00100000:1.0:1789785100.628320:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785100.628334:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549015552:0@lo:400: 00000100:00100000:1.0:1789785100.628386:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785100.628408:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876725549014656:0@lo:400: 00000100:00100000:1.0:1789785100.628429:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785100.628438:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549015168:0@lo:400: 00000100:00100000:1.0:1789785100.628456:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785100.628473:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789785100.628478:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549014784:0@lo:400: 00000100:00100000:1.0:1789785100.628494:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785100.628509:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549015296:0@lo:400: 00000100:00100000:1.0:1789785100.628526:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785100.628562:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549014400 00000100:00100000:1.0:1789785100.628566:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549014400 00000100:00100000:1.0:1789785100.628589:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549014912 00000100:00100000:1.0:1789785100.628592:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549014912 00000100:00100000:1.0:1789785100.628610:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549015424 00000100:00100000:1.0:1789785100.628613:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549015424 00000100:00100000:1.0:1789785100.628624:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549015040 00000100:00100000:1.0:1789785100.628627:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549015040 00000100:00100000:1.0:1789785100.628638:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549015552 00000100:00100000:1.0:1789785100.628640:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549015552 00000100:00100000:1.0:1789785100.628649:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549014656 00000100:00100000:1.0:1789785100.628651:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549014656 00000100:00100000:1.0:1789785100.628663:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789785100.628669:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725549014400:12345-0@lo:400: 00000100:00100000:1.0:1789785100.628705:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725549014400:12345-0@lo:400: Request processed in 36us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785100.628711:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789785100.628724:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789785100.628730:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1876725549014912:12345-0@lo:400: 00000100:00100000:1.0:1789785100.628758:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1876725549014912:12345-0@lo:400: Request processed in 28us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785100.628764:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789785100.628774:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789785100.628779:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1876725549015424:12345-0@lo:400: 00000100:00100000:1.0:1789785100.628803:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1876725549015424:12345-0@lo:400: Request processed in 24us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785100.628809:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789785100.628819:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789785100.628836:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725549015040:12345-0@lo:400: 00000100:00100000:1.0:1789785100.628875:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725549015040:12345-0@lo:400: Request processed in 40us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785100.628880:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789785100.628892:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789785100.628898:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549015552:12345-0@lo:400: 00000100:00100000:1.0:1789785100.628920:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549015552:12345-0@lo:400: Request processed in 24us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785100.628925:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789785100.628937:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789785100.628942:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876725549014656:12345-0@lo:400: 00000100:00100000:1.0:1789785100.628968:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876725549014656:12345-0@lo:400: Request processed in 26us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785100.628973:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789785100.628995:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549014528 00000100:00100000:1.0:1789785100.628998:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549014528 00000100:00100000:1.0:1789785100.629018:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549014784 00000100:00100000:1.0:1789785100.629020:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549014784 00000100:00100000:1.0:1789785100.629032:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789785100.629039:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549014528:12345-0@lo:400: 00000100:00100000:1.0:1789785100.629069:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549014528:12345-0@lo:400: Request processed in 31us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785100.629075:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789785100.629085:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789785100.629091:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549014784:12345-0@lo:400: 00000100:00100000:1.0:1789785100.629115:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549014784:12345-0@lo:400: Request processed in 25us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785100.629130:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789785100.629151:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549015168 00000100:00100000:1.0:1789785100.629155:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549015168 00000100:00100000:1.0:1789785100.629178:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549015296 00000100:00100000:1.0:1789785100.629181:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549015296 00000100:00100000:1.0:1789785100.629198:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789785100.629204:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549015168:12345-0@lo:400: 00000100:00100000:1.0:1789785100.629234:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549015168:12345-0@lo:400: Request processed in 30us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785100.629240:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789785100.629251:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789785100.629256:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549015296:12345-0@lo:400: 00000100:00100000:1.0:1789785100.629280:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549015296:12345-0@lo:400: Request processed in 24us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785100.629285:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1789785100.629304:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789785100.629308:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789785100.629310:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789785100.629333:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549014528:0@lo:400: 00010000:00080000:1.0:1789785100.629366:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83874380 x1876725549015040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785100.629377:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725549015040:0@lo:400: 00010000:00080000:1.0:1789785100.629386:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83874000 x1876725549015552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785100.629394:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549015552:0@lo:400: 00010000:00080000:1.0:1789785100.629403:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83877b80 x1876725549014400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785100.629419:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725549014400:0@lo:400: 00010000:00080000:1.0:1789785100.629431:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83874700 x1876725549014912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785100.629439:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1876725549014912:0@lo:400: 00010000:00080000:1.0:1789785100.629447:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83876300 x1876725549015424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785100.629454:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1876725549015424:0@lo:400: 00000100:00100000:1.0:1789785100.629485:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549014784:0@lo:400: 00010000:00080000:1.0:1789785100.629494:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83875c00 x1876725549015296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785100.629500:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549015296:0@lo:400: 00010000:00080000:1.0:1789785100.629508:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83875f80 x1876725549014656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785100.629515:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876725549014656:0@lo:400: 00010000:00080000:1.0:1789785100.629523:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83877480 x1876725549015168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785100.629529:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549015168:0@lo:400: 00000100:00100000:2.0:1789785100.631929:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549014272:0@lo:501: 00000100:00100000:2.0:1789785100.631987:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549015680:0@lo:503: 00000100:00100000:2.0:1789785100.632058:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785100.632094:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789785100.632110:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549015680 00000100:00100000:2.0:1789785100.632115:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549015680 00000100:00100000:2.0:1789785100.632158:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789785100.632166:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+16:6531:x1876725549015680:12345-0@lo:503: 00000100:00100000:2.0:1789785100.632278:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+16:6531:x1876725549015680:12345-0@lo:503: Request processed in 111us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785100.632285:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789785100.632333:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549015680:0@lo:503: 00000100:00100000:2.0:1789785100.632521:0:9850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b38e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:9850:1876725549015808:0@lo:502: 00000100:00100000:2.0:1789785100.632555:0:9850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785100.632573:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549015808 00000100:00100000:2.0:1789785100.632577:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549015808 00000100:00100000:2.0:1789785100.632598:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789785100.632611:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+16:9850:x1876725549015808:12345-0@lo:502: 00000100:00100000:2.0:1789785100.632686:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+16:9850:x1876725549015808:12345-0@lo:502: Request processed in 75us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785100.632693:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789785100.632727:0:9850:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6480 going to sleep for 11 seconds 00000100:00100000:2.0:1789785100.632739:0:9850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b38e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:9850:1876725549015808:0@lo:502: 00000100:00100000:2.0:1789785100.632776:0:9850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b38e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:9850:1876725549015936:0@lo:502: 00000100:00100000:2.0:1789785100.632806:0:9850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785100.632834:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549015936 00000100:00100000:2.0:1789785100.632839:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549015936 00000100:00100000:2.0:1789785100.632858:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789785100.632864:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+16:9850:x1876725549015936:12345-0@lo:502: 00000100:00100000:2.0:1789785100.632921:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+16:9850:x1876725549015936:12345-0@lo:502: Request processed in 56us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785100.632927:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789785100.632955:0:9850:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6480 going to sleep for 11 seconds 00000100:00100000:2.0:1789785100.632967:0:9850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b38e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:9850:1876725549015936:0@lo:502: 00000040:00080000:2.0:1789785100.632985:0:9850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789785100.633035:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789785100.633053:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789785100.633062:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c19b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c1a2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785100.633072:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c19b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c1a2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785100.633081:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789785100.633090:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1789785100.633093:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789785100.633115:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09600/0x2f18ee3fd845c1a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785100.633123:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09600/0x2f18ee3fd845c1a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785100.633131:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09600/0x2f18ee3fd845c1a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785100.633143:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549016064:0@lo:101: 00000100:00100000:2.0:1789785100.633167:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785100.633181:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6480 going to sleep for 11 seconds 00000100:00100000:2.0:1789785100.633192:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549016064 00000100:00100000:2.0:1789785100.633195:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549016064 00000100:00100000:2.0:1789785100.633215:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789785100.633220:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+16:6531:x1876725549016064:12345-0@lo:101: 00010000:00010000:2.0:1789785100.633228:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785100.633238:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1b08000/0x2f18ee3fd845c1b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c1a9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785100.633256:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1b08000/0x2f18ee3fd845c1b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c1a9 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785100.633278:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1b08000/0x2f18ee3fd845c1b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c1a9 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785100.633287:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b08000, rc 0) 00000100:00100000:2.0:1789785100.633315:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725549016064:12345-0@lo:101: Request processed in 94us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785100.633328:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789785100.633377:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549016064:0@lo:101: 00010000:00010000:2.0:1789785100.633389:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09600/0x2f18ee3fd845c1a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c1b0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785100.633398:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09600/0x2f18ee3fd845c1a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c1b0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785100.633436:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549016192:0@lo:501: 00000100:00100000:2.0:1789785100.633457:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785100.633469:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6480 going to sleep for 11 seconds 00000100:00100000:2.0:1789785100.633479:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549016192 00000100:00100000:2.0:1789785100.633481:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549016192 00000100:00100000:2.0:1789785100.633499:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789785100.633504:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725549016192:12345-0@lo:501: 00000100:00100000:2.0:1789785100.633591:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725549016192:12345-0@lo:501: Request processed in 86us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785100.633597:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789785100.633624:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549016192:0@lo:501: 00000100:00100000:2.0:1789785100.633645:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549016320:0@lo:503: 00000100:00100000:2.0:1789785100.633673:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785100.633685:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6480 going to sleep for 11 seconds 00000100:00100000:2.0:1789785100.633696:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549016320 00000100:00100000:2.0:1789785100.633700:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549016320 00000100:00100000:2.0:1789785100.633723:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789785100.633729:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725549016320:12345-0@lo:503: 00000100:00100000:2.0:1789785100.633799:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725549016320:12345-0@lo:503: Request processed in 70us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785100.633804:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789785100.635426:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549016320:0@lo:503: 00000100:00100000:3.0:1789785100.642089:0:9853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb415f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:9853:1876725549016448:0@lo:502: 00000100:00100000:3.0:1789785100.642166:0:9853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785100.642209:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549016448 00000100:00100000:3.0:1789785100.642216:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549016448 00000100:00100000:3.0:1789785100.642257:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789785100.642267:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+17:9853:x1876725549016448:12345-0@lo:502: 00000100:00100000:3.0:1789785100.642400:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+17:9853:x1876725549016448:12345-0@lo:502: Request processed in 134us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785100.642408:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789785100.642460:0:9853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae82a446c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785100.642481:0:9853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb415f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:9853:1876725549016448:0@lo:502: 00000020:01000000:3.0:1789785100.642510:0:9853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789785100.642518:0:9853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789785100.642520:0:9853:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789785100.642524:0:9853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789785100.642526:0:9853:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789785100.645913:0:9853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb415f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:9853:1876725549016576:0@lo:502: 00000100:00100000:3.0:1789785100.645990:0:9853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785100.646026:0:9853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae82a446c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789785100.646971:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549016576 00000100:00100000:2.0:1789785100.646981:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549016576 00000100:00100000:2.0:1789785100.647032:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789785100.647042:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+17:9853:x1876725549016576:12345-0@lo:502: 00000100:00100000:2.0:1789785100.647177:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+17:9853:x1876725549016576:12345-0@lo:502: Request processed in 136us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785100.647184:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789785100.649414:0:9853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb415f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:9853:1876725549016576:0@lo:502: 00000020:01000000:3.0:1789785100.649458:0:9853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789785100.649467:0:9853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789785100.649469:0:9853:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789785100.649473:0:9853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1789785100.649723:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1789785100.649746:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789785100.649758:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09600/0x2f18ee3fd845c1a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c1b0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785100.649769:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09600/0x2f18ee3fd845c1a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c1b0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785100.649779:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789785100.649781:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dafc189c800 from 39 10000000:01000000:2.0:1789785100.649784:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789785100.649814:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c1b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785100.649833:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c1b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785100.649843:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c1b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785100.649882:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b39180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549016704:0@lo:101: 00000100:00100000:2.0:1789785100.649935:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785100.649979:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6480 going to sleep for 11 seconds 00000100:00100000:3.0:1789785100.650124:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549016704 00000100:00100000:3.0:1789785100.650131:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549016704 00000100:00100000:3.0:1789785100.650180:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789785100.650188:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725549016704:12345-0@lo:101: 00010000:00010000:3.0:1789785100.650201:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785100.650213:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc21ca600/0x2f18ee3fd845c1be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c1b7 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785100.650234:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc21ca600/0x2f18ee3fd845c1be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c1b7 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785100.650242:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc21ca600/0x2f18ee3fd845c1be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c1b7 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785100.650251:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc21ca600, rc 0) 00000100:00100000:3.0:1789785100.650298:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+18:6531:x1876725549016704:12345-0@lo:101: Request processed in 110us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785100.650305:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789785100.650455:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b39180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549016704:0@lo:101: 00010000:00010000:0.0:1789785100.650468:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c1b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c1be expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785100.650482:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c1b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c1be expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785100.650611:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549016832:0@lo:501: 00000100:00100000:0.0:1789785100.650638:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785100.650699:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf92353240 going to sleep for 11 seconds 00000100:00100000:3.0:1789785100.652930:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549016832 00000100:00100000:3.0:1789785100.653118:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549016832 00000100:00100000:3.0:1789785100.653237:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789785100.653248:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+18:6531:x1876725549016832:12345-0@lo:501: 00000100:00100000:3.0:1789785100.653440:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+18:6531:x1876725549016832:12345-0@lo:501: Request processed in 195us (2800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785100.653448:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789785100.655925:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549016832:0@lo:501: 00000100:00100000:2.0:1789785100.656065:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549016960:0@lo:503: 00000100:00100000:2.0:1789785100.656140:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785100.656187:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789785100.656245:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549016960 00000100:00100000:0.0:1789785100.656252:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549016960 00000100:00100000:0.0:1789785100.656313:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789785100.656322:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+18:6531:x1876725549016960:12345-0@lo:503: 00000100:00100000:0.0:1789785100.656443:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+18:6531:x1876725549016960:12345-0@lo:503: Request processed in 121us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785100.656450:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789785100.656867:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549016960:0@lo:503: 00000100:00100000:2.0:1789785100.657260:0:9854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:9854:1876725549017088:0@lo:502: 00000100:00100000:2.0:1789785100.657404:0:9854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785100.657445:0:9854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789785100.657476:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549017088 00000100:00100000:3.0:1789785100.657526:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549017088 00000100:00100000:3.0:1789785100.657640:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789785100.657648:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+18:9854:x1876725549017088:12345-0@lo:502: 00000100:00100000:3.0:1789785100.657741:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+18:9854:x1876725549017088:12345-0@lo:502: Request processed in 94us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785100.657754:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789785100.657796:0:9854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:9854:1876725549017088:0@lo:502: 00000100:00100000:3.0:1789785100.657849:0:9854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb415f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:9854:1876725549017216:0@lo:502: 00000100:00100000:3.0:1789785100.657882:0:9854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785100.657900:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549017216 00000100:00100000:3.0:1789785100.657904:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549017216 00000100:00100000:3.0:1789785100.657924:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789785100.657930:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+18:9854:x1876725549017216:12345-0@lo:502: 00000100:00100000:2.0:1789785100.658161:0:9854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae82a44780 going to sleep for 11 seconds 00000100:00100000:3.0:1789785100.658258:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+18:9854:x1876725549017216:12345-0@lo:502: Request processed in 327us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785100.658304:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789785100.658409:0:9854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb415f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:9854:1876725549017216:0@lo:502: 00000040:00080000:2.0:1789785100.658430:0:9854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1789785100.658633:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1789785100.658657:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789785100.658666:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c1b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c1be expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785100.658676:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c1b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c1be expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785100.658685:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789785100.658687:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dafc189c800 from 6 10000000:01000000:3.0:1789785100.658690:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789785100.658717:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb400/0x2f18ee3fd845c1c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785100.658724:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb400/0x2f18ee3fd845c1c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785100.658745:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb400/0x2f18ee3fd845c1c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785100.658759:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb416d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549017344:0@lo:101: 00000100:00100000:3.0:1789785100.658786:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785100.658808:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae82a44300 going to sleep for 11 seconds 00000100:00100000:2.0:1789785100.658861:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549017344 00000100:00100000:2.0:1789785100.658928:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549017344 00000100:00100000:2.0:1789785100.659030:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789785100.659037:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+18:6531:x1876725549017344:12345-0@lo:101: 00010000:00010000:2.0:1789785100.659047:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785100.659059:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1b09400/0x2f18ee3fd845c1cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c1c5 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785100.659078:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1b09400/0x2f18ee3fd845c1cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c1c5 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785100.659102:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1b09400/0x2f18ee3fd845c1cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c1c5 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785100.659110:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b09400, rc 0) 00000100:00100000:2.0:1789785100.659142:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+19:6531:x1876725549017344:12345-0@lo:101: Request processed in 106us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785100.659148:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789785100.659214:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb416d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549017344:0@lo:101: 00010000:00010000:3.0:1789785100.659225:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb400/0x2f18ee3fd845c1c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c1cc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785100.659233:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb400/0x2f18ee3fd845c1c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c1cc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785100.659370:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb416d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549017472:0@lo:256: 00000100:00100000:3.0:1789785100.659399:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785100.659416:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae82a44300 going to sleep for 11 seconds 00000100:00100000:3.0:1789785100.659430:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549017472 00000100:00100000:3.0:1789785100.659433:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549017472 00000100:00100000:3.0:1789785100.659455:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789785100.659461:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+19:6531:x1876725549017472:12345-0@lo:256: 20000000:01000000:3.0:1789785100.659473:0:6528:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789785100.659489:0:6528:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789785100.659493:0:6528:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789785100.659642:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+19:6531:x1876725549017472:12345-0@lo:256: Request processed in 181us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785100.659648:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789785100.659682:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb416d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549017472:0@lo:256: 10000000:01000000:3.0:1789785100.659723:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789785100.659728:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb400/0x2f18ee3fd845c1c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c1cc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785100.659735:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb400/0x2f18ee3fd845c1c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c1cc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785100.659741:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789785100.659743:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1789785100.659745:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789785100.659760:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c1d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785100.659766:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c1d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785100.659772:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c1d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785100.659783:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb416d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549017600:0@lo:101: 00000100:00100000:3.0:1789785100.659806:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785100.659820:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae82a44300 going to sleep for 11 seconds 00000100:00100000:3.0:1789785100.659842:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549017600 00000100:00100000:3.0:1789785100.659845:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549017600 00000100:00100000:3.0:1789785100.659862:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789785100.660013:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+19:6531:x1876725549017600:12345-0@lo:101: 00010000:00010000:3.0:1789785100.660022:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785100.660033:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9daf829d2a00/0x2f18ee3fd845c1da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c1d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785100.660057:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9daf829d2a00/0x2f18ee3fd845c1da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c1d3 expref: 20 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785100.660065:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9daf829d2a00/0x2f18ee3fd845c1da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c1d3 expref: 20 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785100.660072:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf829d2a00, rc 0) 00000100:00100000:3.0:1789785100.660100:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+20:6531:x1876725549017600:12345-0@lo:101: Request processed in 234us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785100.660107:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789785100.660136:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb416d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549017600:0@lo:101: 00010000:00010000:3.0:1789785100.660147:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c1d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c1da expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785100.660154:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c1d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c1da expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785100.660197:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb416d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549017728:0@lo:501: 00000100:00100000:3.0:1789785100.660220:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785100.660234:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae82a44300 going to sleep for 11 seconds 00000100:00100000:3.0:1789785100.660245:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549017728 00000100:00100000:3.0:1789785100.660248:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549017728 00000100:00100000:3.0:1789785100.660263:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789785100.660592:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+20:6531:x1876725549017728:12345-0@lo:501: 00000100:00100000:3.0:1789785100.660705:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+20:6531:x1876725549017728:12345-0@lo:501: Request processed in 115us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785100.660813:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb416d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549017728:0@lo:501: 00000100:00100000:1.0:1789785100.660854:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83981c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549017856:0@lo:503: 00000100:00100000:1.0:1789785100.660905:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785100.660922:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1b3e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789785100.661286:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549017856 00000100:00100000:2.0:1789785100.661291:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549017856 00000100:00100000:2.0:1789785100.661314:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789785100.661321:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549017856:12345-0@lo:503: 00000100:00100000:2.0:1789785100.661452:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549017856:12345-0@lo:503: Request processed in 132us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785100.661460:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789785100.661681:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83981c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549017856:0@lo:503: 00000100:00100000:1.0:1789785100.661907:0:9855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83981c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:9855:1876725549017984:0@lo:502: 00000100:00100000:1.0:1789785100.661957:0:9855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785100.662704:0:9855:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1b3e300 going to sleep for 11 seconds 00000100:00100000:3.0:1789785100.662774:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789785100.662811:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549017984 00000100:00100000:3.0:1789785100.662816:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549017984 00000100:00100000:3.0:1789785100.663019:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789785100.663030:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+20:9855:x1876725549017984:12345-0@lo:502: 00000100:00100000:3.0:1789785100.663142:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+20:9855:x1876725549017984:12345-0@lo:502: Request processed in 114us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785100.663149:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789785100.663223:0:9855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83981c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:9855:1876725549017984:0@lo:502: 00000020:01000000:1.0:1789785100.663251:0:9855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789785100.663258:0:9855:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789785100.663264:0:9855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785100.663267:0:9855:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789785100.663271:0:9855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789785100.663275:0:9855:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.146@tcp to nid 0x20000c0a8cb92 (192.168.203.146@tcp) 00000020:01000000:1.0:1789785100.663297:0:9855:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789785100.663300:0:9855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789785100.663314:0:9855:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9dae82554d28) 00000020:00000080:1.0:1789785100.663355:0:9855:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1789785100.663361:0:9855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789785100.663453:0:9855:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1789785100.663459:0:9855:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789785100.663466:0:9855:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f18ee3fd845c1e8 00010000:00080000:1.0:1789785100.663493:0:9855:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dafbf3c0000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.146@tcp at head 00010000:00010000:1.0:1789785100.663727:0:9855:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1789785100.664057:0:9855:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1789785100.664070:0:9855:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1789785100.664235:0:9855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789785100.664598:0:9855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789785100.664739:0:9855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789785100.664859:0:9855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789785100.666186:0:9856:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789785100.666191:0:9856:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789785100.667150:0:9855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789785100.667161:0:9855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789785100.667210:0:9855:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789785100.667235:0:9855:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f18ee3fd845c1ef 00000100:00080000:1.0:1789785100.667246:0:9855:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789785100.667251:0:9855:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dafbf3c0000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:1.0:1789785100.667298:0:9855:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dae83981c00 x1876725549018112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789785100.667374:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549018112:0@lo:8: 00000100:00100000:0.0:1789785100.667443:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789785100.667523:0:9855:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789785100.667608:0:9855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785100.667613:0:9855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785100.667614:0:9855:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789785100.667617:0:9855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789785100.667622:0:9855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785100.667623:0:9855:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789785100.667626:0:9855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789785100.667627:0:9855:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789785100.667654:0:9855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83982300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:9855:1876725549018240:0@lo:502: 00000100:00100000:1.0:1789785100.667698:0:9855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785100.667724:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549018240 00000100:00100000:1.0:1789785100.667729:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549018240 00000100:00100000:1.0:1789785100.667774:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789785100.667782:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+20:9855:x1876725549018240:12345-0@lo:502: 00000100:00100000:2.0:1789785100.667980:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549018112 00000100:00100000:2.0:1789785100.667985:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549018112 00000100:00100000:2.0:1789785100.668009:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789785100.668013:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3658:x1876725549018112:12345-0@lo:8: 00010000:00080000:2.0:1789785100.668034:0:8449:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:2.0:1789785100.668059:0:8449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f18ee3fd845c1f6 00002000:00100000:2.0:1789785100.668072:0:8449:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9dae83734000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396e ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1789785100.668076:0:8449:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1789785100.668080:0:8449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789785100.668129:0:8449:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789785100.668356:0:8449:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1789785100.668379:0:8449:0:(import.c:65:import_set_state_nolock()) ffff9dae83731800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789785100.668554:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+20:9855:x1876725549018240:12345-0@lo:502: Request processed in 771us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785100.668563:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789785100.668604:0:9855:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1b3e900 going to sleep for 11 seconds 00000100:00100000:1.0:1789785100.668626:0:9855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83982300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:9855:1876725549018240:0@lo:502: 00000020:01000000:1.0:1789785100.668655:0:9855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785100.668660:0:9855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785100.668662:0:9855:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789785100.668671:0:9855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:1.0:1789785100.668737:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1789785100.668760:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789785100.668771:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c1d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c1da expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785100.668783:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c1d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c1da expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785100.668795:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789785100.668798:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9daf89061800 from 39 10000000:01000000:1.0:1789785100.668801:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789785100.669118:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c1fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785100.669128:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c1fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785100.669138:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c1fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785100.669156:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83982300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549018368:0@lo:101: 00000100:00100000:1.0:1789785100.669185:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785100.669202:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1b3e900 going to sleep for 11 seconds 00000100:00100000:3.0:1789785100.669677:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549018368 00000100:00100000:3.0:1789785100.669684:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549018368 00000100:00100000:3.0:1789785100.669717:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789785100.669724:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+20:6531:x1876725549018368:12345-0@lo:101: 00010000:00010000:3.0:1789785100.669736:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785100.669747:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9daf829d3000/0x2f18ee3fd845c204 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c1fd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785100.669768:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9daf829d3000/0x2f18ee3fd845c204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c1fd expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785100.669778:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9daf829d3000/0x2f18ee3fd845c204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c1fd expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785100.669787:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf829d3000, rc 0) 00000100:00100000:3.0:1789785100.669833:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549018368:12345-0@lo:101: Request processed in 98us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785100.669840:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789785100.670021:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83982300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549018368:0@lo:101: 00010000:00010000:3.0:1789785100.670034:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c1fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c204 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785100.670058:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c1fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c204 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785100.670113:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb416d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549018496:0@lo:501: 00000100:00100000:3.0:1789785100.670136:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785100.670158:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf987f53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785100.670167:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549018496 00000100:00100000:3.0:1789785100.670170:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549018496 00000100:00100000:3.0:1789785100.670185:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789785100.670189:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549018496:12345-0@lo:501: 00000100:00100000:3.0:1789785100.670761:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549018496:12345-0@lo:501: Request processed in 569us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785100.670770:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789785100.675069:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb416d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549018496:0@lo:501: 00000100:00100000:1.0:1789785100.675135:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83983b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549018624:0@lo:503: 00000100:00100000:1.0:1789785100.675197:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785100.675230:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1b3ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789785100.675249:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549018624 00000100:00100000:1.0:1789785100.675261:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549018624 00000100:00100000:1.0:1789785100.675652:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789785100.675660:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549018624:12345-0@lo:503: 00000100:00100000:1.0:1789785100.675767:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549018624:12345-0@lo:503: Request processed in 106us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785100.675774:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789785100.675819:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83983b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549018624:0@lo:503: 00000100:00100000:2.0:1789785100.676212:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3658:x1876725549018112:12345-0@lo:8: Request processed in 6251us (6822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785100.676222:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789785100.678716:0:9858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:9858:1876725549018752:0@lo:502: 00000100:00100000:2.0:1789785100.678784:0:9858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785100.678838:0:9858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8398e300 going to sleep for 11 seconds 00010000:00080000:0.0:1789785100.680164:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83981c00 x1876725549018112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789785110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785100.680178:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789785100.680187:0:3658:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789785100.680195:0:3658:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789785100.680200:0:3658:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789785100.680204:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dafbf3c0000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789785100.680229:0:3658:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789785100.680235:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549018112:0@lo:8: 00000004:00080000:0.0:1789785100.680286:0:9856:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789785100.680409:0:9856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 208934069743ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789785100.680415:0:9856:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789785100.681754:0:9857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b39180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9857:1876725549018880:0@lo:700: 00000100:00100000:1.0:1789785100.681768:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549018752 00000100:00100000:1.0:1789785100.681774:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549018752 00000100:00100000:2.0:1789785100.681814:0:9857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785100.681817:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789785100.681841:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+21:9858:x1876725549018752:12345-0@lo:502: 00000100:00100000:2.0:1789785100.681853:0:9857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8398ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789785100.682356:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+21:9858:x1876725549018752:12345-0@lo:502: Request processed in 498us (3553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785100.682364:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789785100.682408:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549018880 00000100:00100000:1.0:1789785100.682413:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549018880 00000100:00100000:1.0:1789785100.682447:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789785100.682454:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9857:x1876725549018880:12345-0@lo:700: 00000100:00100000:1.0:1789785100.682484:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83983b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8459:1876725549019008:0@lo:700: 00000100:00100000:1.0:1789785100.682510:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785100.682527:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1b3ef00 going to sleep for 11 seconds 00000100:00080000:1.0:1789785100.682539:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789785100.682555:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549019008 00000100:00100000:1.0:1789785100.682558:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549019008 00000100:00100000:2.0:1789785100.682657:0:9858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:9858:1876725549018752:0@lo:502: 00000100:00100000:1.0:1789785100.682693:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789785100.682702:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8459:x1876725549019008:12345-0@lo:700: 00000100:00100000:2.0:1789785100.682706:0:9858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:9858:1876725549019136:0@lo:502: 00000100:00100000:2.0:1789785100.682740:0:9858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785100.682762:0:9858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8398e300 going to sleep for 11 seconds 00000100:00100000:1.0:1789785100.686005:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549019136 00000100:00100000:1.0:1789785100.686031:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549019136 00000100:00100000:0.0:1789785100.686487:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789785100.686500:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+21:9858:x1876725549019136:12345-0@lo:502: 00000100:00100000:0.0:1789785100.687170:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+21:9858:x1876725549019136:12345-0@lo:502: Request processed in 669us (4425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785100.687180:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789785100.687236:0:9858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:9858:1876725549019136:0@lo:502: 00000040:00080000:0.0:1789785100.687270:0:9858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000004:00080000:1.0:1789785100.688185:0:7465:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000020:01000000:1.0:1789785100.688219:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1789785100.688245:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789785100.688256:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c1fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c204 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785100.688268:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c1fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c204 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785100.688278:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789785100.688280:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9daf89061800 from 6 10000000:01000000:1.0:1789785100.688284:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789785100.688317:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc2051000/0x2f18ee3fd845c20b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785100.688325:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc2051000/0x2f18ee3fd845c20b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785100.688335:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc2051000/0x2f18ee3fd845c20b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785100.688368:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83981f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549019264:0@lo:101: 00000100:00100000:1.0:1789785100.688416:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785100.688453:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549019264 00000100:00100000:1.0:1789785100.688456:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1b3e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789785100.688459:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549019264 00000100:00100000:0.0:1789785100.688500:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789785100.688509:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549019264:12345-0@lo:101: 00010000:00010000:0.0:1789785100.688520:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785100.688541:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dae81ead800/0x2f18ee3fd845c212 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c20b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785100.688563:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dae81ead800/0x2f18ee3fd845c212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c20b expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785100.688575:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dae81ead800/0x2f18ee3fd845c212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c20b expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785100.688582:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81ead800, rc 0) 00000100:00100000:0.0:1789785100.688624:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549019264:12345-0@lo:101: Request processed in 116us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785100.688630:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789785100.689612:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83981f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549019264:0@lo:101: 00010000:00010000:1.0:1789785100.689631:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc2051000/0x2f18ee3fd845c20b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c212 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785100.689641:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc2051000/0x2f18ee3fd845c20b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c212 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785100.689697:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83981f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549019392:0@lo:256: 00000100:00100000:1.0:1789785100.689736:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785100.689776:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1b3e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789785100.690875:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549019392 00000100:00100000:0.0:1789785100.690885:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549019392 00000100:00100000:0.0:1789785100.690934:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789785100.691061:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549019392:12345-0@lo:256: 20000000:01000000:0.0:1789785100.691087:0:6528:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789785100.691106:0:6528:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789785100.691109:0:6528:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1789785100.691222:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549019392:12345-0@lo:256: Request processed in 279us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785100.691230:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789785100.691256:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83981f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549019392:0@lo:256: 10000000:01000000:1.0:1789785100.691309:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789785100.691318:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc2051000/0x2f18ee3fd845c20b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c212 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785100.691326:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc2051000/0x2f18ee3fd845c20b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c212 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785100.691334:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789785100.691350:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1789785100.691353:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789785100.691378:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc2050000/0x2f18ee3fd845c219 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785100.691386:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc2050000/0x2f18ee3fd845c219 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785100.691395:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc2050000/0x2f18ee3fd845c219 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785100.691408:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83981f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549019520:0@lo:101: 00000100:00100000:1.0:1789785100.691437:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785100.691466:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1b3e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789785100.692229:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549019520 00000100:00100000:0.0:1789785100.692237:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549019520 00000100:00100000:0.0:1789785100.692276:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789785100.692283:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549019520:12345-0@lo:101: 00010000:00010000:0.0:1789785100.692294:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785100.692305:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845c220 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c219 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785100.692324:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845c220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c219 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785100.692333:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845c220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c219 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785100.692356:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eadc00, rc 0) 00000100:00100000:0.0:1789785100.692397:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549019520:12345-0@lo:101: Request processed in 114us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785100.692403:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789785100.692414:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83981f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549019520:0@lo:101: 00010000:00010000:1.0:1789785100.692433:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc2050000/0x2f18ee3fd845c219 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c220 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785100.692442:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc2050000/0x2f18ee3fd845c219 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c220 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785100.692498:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83981f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549019648:0@lo:501: 00000100:00100000:1.0:1789785100.692545:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785100.692595:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1b3e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789785100.692607:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549019648 00000100:00100000:1.0:1789785100.692610:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549019648 00000100:00100000:1.0:1789785100.692648:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789785100.692655:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549019648:12345-0@lo:501: 00000100:00100000:1.0:1789785100.693132:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549019648:12345-0@lo:501: Request processed in 476us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785100.693139:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 40000000:02000000:1.0:1789785100.693800:0:6540:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1789785100.694401:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83981f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549019648:0@lo:501: 00000100:00100000:2.0:1789785100.694452:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549019776:0@lo:503: 00000100:00100000:2.0:1789785100.694505:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785100.694601:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8398e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789785100.694619:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549019776 00000100:00100000:2.0:1789785100.694624:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549019776 00000100:00100000:2.0:1789785100.694664:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789785100.694672:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549019776:12345-0@lo:503: 00000100:00100000:2.0:1789785100.694780:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549019776:12345-0@lo:503: Request processed in 108us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785100.694788:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789785100.694841:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549019776:0@lo:503: 00000100:00100000:2.0:1789785100.704921:0:9859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:9859:1876725549019904:0@lo:502: 00000100:00100000:2.0:1789785100.704995:0:9859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785100.705038:0:9859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8398e540 going to sleep for 11 seconds 00000100:00100000:3.0:1789785100.707512:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549019904 00000100:00100000:3.0:1789785100.707526:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549019904 00000100:00100000:3.0:1789785100.707593:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789785100.707602:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+23:9859:x1876725549019904:12345-0@lo:502: 00000100:00100000:3.0:1789785100.707767:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+23:9859:x1876725549019904:12345-0@lo:502: Request processed in 165us (2770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785100.707774:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789785100.707845:0:9859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:9859:1876725549019904:0@lo:502: 00000020:01000000:3.0:1789785100.707882:0:9859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789785100.707890:0:9859:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789785100.707896:0:9859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789785100.707898:0:9859:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789785100.707903:0:9859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789785100.707913:0:9859:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.146@tcp to nid 0x20000c0a8cb92 (192.168.203.146@tcp) 00000020:01000000:3.0:1789785100.707935:0:9859:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789785100.707938:0:9859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789785100.708098:0:9859:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9dafba55b370) 00000020:00000080:3.0:1789785100.708123:0:9859:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1789785100.708130:0:9859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789785100.708220:0:9859:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789785100.708226:0:9859:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789785100.708233:0:9859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f18ee3fd845c22e 00010000:00080000:3.0:1789785100.708259:0:9859:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dafb5ec4000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.146@tcp at head 00010000:00010000:3.0:1789785100.708508:0:9859:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000100:00100000:1.0:1789785100.710960:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8459:x1876725549019008:12345-0@lo:700: Request processed in 28252us (28442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785100.710973:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789785100.711026:0:8459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83983b80 x1876725549019008/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789785116 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785100.711042:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83983b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8459:1876725549019008:0@lo:700: 40000000:02000000:1.0:1789785100.711056:0:8459:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:01000000:3.0:1789785100.711692:0:9859:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789785100.711706:0:9859:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789785100.711882:0:9859:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789785100.712076:0:9859:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789785100.712211:0:9859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789785100.712302:0:9859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1789785100.725016:0:9860:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789785100.725031:0:9860:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789785100.736392:0:9859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789785100.736408:0:9859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789785100.736454:0:9859:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789785100.736481:0:9859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f18ee3fd845c235 00000100:00080000:3.0:1789785100.736490:0:9859:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789785100.736497:0:9859:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dafb5ec4000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:3.0:1789785100.736535:0:9859:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafbb415f80 x1876725549020032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789785100.736571:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549020032:0@lo:8: 00000100:00100000:3.0:1789785100.736655:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785100.736731:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549020032 00000100:00100000:3.0:1789785100.736737:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549020032 00000100:00100000:3.0:1789785100.736773:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789785100.736789:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb415500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3658:x1876725549020032:12345-0@lo:8: 00010000:00080000:3.0:1789785100.736814:0:8805:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:3.0:1789785100.736848:0:8805:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f18ee3fd845c23c 00002000:00100000:3.0:1789785100.736861:0:8805:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9dae839ed000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396e ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789785100.736865:0:8805:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789785100.736868:0:8805:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789785100.736952:0:8805:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789785100.736977:0:8805:0:(import.c:65:import_set_state_nolock()) ffff9dae839e9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789785100.737038:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb415500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3658:x1876725549020032:12345-0@lo:8: Request processed in 249us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785100.737046:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789785100.737086:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb415f80 x1876725549020032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789785110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785100.737095:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789785100.737102:0:3658:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789785100.737109:0:3658:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789785100.737113:0:3658:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789785100.737116:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dafb5ec4000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789785100.737131:0:3658:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789785100.737136:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549020032:0@lo:8: 00000100:00080000:3.0:1789785100.737155:0:9859:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789785100.737213:0:9859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789785100.737218:0:9859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789785100.737220:0:9859:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789785100.737222:0:9859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789785100.737226:0:9859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789785100.737228:0:9859:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789785100.737237:0:9859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789785100.737239:0:9859:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789785100.737263:0:9859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb415f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:9859:1876725549020160:0@lo:502: 00000100:00100000:3.0:1789785100.737304:0:9859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785100.737330:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549020160 00000100:00100000:3.0:1789785100.737334:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549020160 00000100:00100000:3.0:1789785100.738050:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789785100.738060:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+23:9859:x1876725549020160:12345-0@lo:502: 00000100:00100000:3.0:1789785100.738294:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+23:9859:x1876725549020160:12345-0@lo:502: Request processed in 234us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785100.738302:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000004:00080000:3.0:1789785100.738371:0:9860:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1789785100.738414:0:9859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf987f59c0 going to sleep for 11 seconds 00000004:00080000:3.0:1789785100.738424:0:9860:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 208992084554ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789785100.738432:0:9860:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1789785100.738438:0:9859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb415f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:9859:1876725549020160:0@lo:502: 00000020:01000000:2.0:1789785100.738472:0:9859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789785100.738478:0:9859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785100.738480:0:9859:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789785100.738484:0:9859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1789785100.738545:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1789785100.738567:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789785100.738577:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc2050000/0x2f18ee3fd845c219 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c220 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785100.738588:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc2050000/0x2f18ee3fd845c219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c220 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785100.738598:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789785100.738602:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9daf983fcd28 from 1 10000000:01000000:2.0:1789785100.738605:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789785100.738632:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c243 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785100.738640:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c243 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785100.738650:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c243 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785100.738678:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549020288:0@lo:101: 00000100:00100000:2.0:1789785100.738711:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785100.738732:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8398ea80 going to sleep for 11 seconds 00000001:00100000:1.0:1789785100.739878:0:9529:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789785100.740074:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9857:x1876725549018880:12345-0@lo:700: Request processed in 57617us (58256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785100.740090:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789785100.742053:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549020288 00000100:00100000:0.0:1789785100.742066:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549020288 00000100:00100000:1.0:1789785100.742131:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789785100.742144:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549020288:12345-0@lo:101: 00010000:00010000:1.0:1789785100.742160:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785100.742179:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc2050200/0x2f18ee3fd845c24a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c243 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785100.742204:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc2050200/0x2f18ee3fd845c24a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c243 expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785100.742213:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc2050200/0x2f18ee3fd845c24a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c243 expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785100.742221:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc2050200, rc 0) 00000100:00100000:1.0:1789785100.742291:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:6531:x1876725549020288:12345-0@lo:101: Request processed in 150us (3578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785100.742298:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789785100.742393:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549020288:0@lo:101: 00010000:00010000:0.0:1789785100.742409:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c243 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c24a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785100.742419:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c243 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c24a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785100.742514:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549020416:0@lo:501: 00000100:00100000:0.0:1789785100.742547:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785100.742588:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf982a8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789785100.742638:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549020416 00000100:00100000:1.0:1789785100.742642:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549020416 00000100:00100000:1.0:1789785100.742669:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789785100.742676:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:6531:x1876725549020416:12345-0@lo:501: 00000100:00100000:1.0:1789785100.742754:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:6531:x1876725549020416:12345-0@lo:501: Request processed in 67us (195us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789785100.742761:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00010000:00080000:2.0:1789785100.742869:0:9857:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafc1b39180 x1876725549018880/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789785116 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785100.742881:0:9857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b39180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9857:1876725549018880:0@lo:700: 00000100:00100000:0.0:1789785100.743621:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549020416:0@lo:501: 10000000:01000000:0.0:1789785100.743654:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789785100.743663:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c243 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c24a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785100.743673:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c24a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789785100.753770:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1789785100.756422:0:9857:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789785100.756454:0:9857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9857:1876725549020672:0@lo:7: 00000100:00100000:2.0:1789785100.756521:0:9857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785100.756561:0:9857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8398ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789785100.756581:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549020672 00000100:00100000:2.0:1789785100.756587:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549020672 00000100:00100000:2.0:1789785100.757039:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789785100.757184:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9857:x1876725549020672:12345-0@lo:7: 00000100:00100000:1.0:1789785100.758132:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549020544:0@lo:13: 00000100:00100000:1.0:1789785100.758211:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785100.758284:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549020544 00000100:00100000:1.0:1789785100.758298:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549020544 00000100:00100000:1.0:1789785100.758371:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789785100.758381:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3659:x1876725549020544:12345-0@lo:13: 00002000:00000024:1.0:1789785100.758406:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1789785100.758456:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3659:x1876725549020544:12345-0@lo:13: Request processed in 78us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785100.758463:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789785100.758502:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafc1b39180 x1876725549020544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785100.758520:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549020544:0@lo:13: 00000004:00080000:0.0:1789785100.760460:0:9861:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789785100.760485:0:9861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9861:1876725549020928:0@lo:7: 00000100:00100000:1.0:1789785100.760536:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549020800:0@lo:13: 00000100:00100000:1.0:1789785100.760577:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785100.760636:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549020800 00000100:00100000:1.0:1789785100.760643:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549020800 00000100:00100000:1.0:1789785100.760848:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789785100.760860:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1876725549020800:12345-0@lo:13: 00002000:00000024:1.0:1789785100.760883:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1789785100.760930:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1876725549020800:12345-0@lo:13: Request processed in 73us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785100.760938:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789785100.760965:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789785100.761116:0:9861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785100.761147:0:9861:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf982a8e40 going to sleep for 11 seconds 00010000:00080000:1.0:1789785100.761244:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae828fed80 x1876725549020800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785100.761266:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549020800:0@lo:13: 00000100:00100000:3.0:1789785100.764110:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549020928 00000100:00100000:3.0:1789785100.764122:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549020928 00000100:00100000:3.0:1789785100.764335:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789785100.764364:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9861:x1876725549020928:12345-0@lo:7: 00002000:00080000:2.0:1789785100.767729:0:8449:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1789785100.767907:0:8449:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789785100.768001:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9857:x1876725549020672:12345-0@lo:7: Request processed in 10950us (11476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785100.768012:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789785100.768064:0:9857:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafc1b3b480 x1876725549020672/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789785116 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785100.768080:0:9857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9857:1876725549020672:0@lo:7: 00000004:00080000:2.0:1789785100.768093:0:9857:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789785100.768132:0:9857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9857:1876725549021056:0@lo:5: 00000100:00100000:2.0:1789785100.768171:0:9857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785100.768206:0:9857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8398ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789785100.768258:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549021056 00000100:00100000:1.0:1789785100.768265:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549021056 00000100:00100000:1.0:1789785100.768317:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789785100.768328:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacaeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9857:x1876725549021056:12345-0@lo:5: 00002000:00080000:1.0:1789785100.768376:0:8450:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1789785100.768415:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacaeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9857:x1876725549021056:12345-0@lo:5: Request processed in 89us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785100.768422:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00002000:00080000:0.0:1789785100.770160:0:8805:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1789785100.770167:0:8805:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789785100.770239:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9861:x1876725549020928:12345-0@lo:7: Request processed in 5877us (9121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785100.770254:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789785100.770301:0:9861:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae828fc700 x1876725549020928/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789785116 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785100.770315:0:9861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9861:1876725549020928:0@lo:7: 00000004:00080000:0.0:1789785100.770328:0:9861:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789785100.770394:0:9861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9861:1876725549021184:0@lo:5: 00000100:00100000:0.0:1789785100.770426:0:9861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785100.770448:0:9861:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf982a8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789785100.770466:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549021184 00000100:00100000:0.0:1789785100.770472:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549021184 00000100:00100000:0.0:1789785100.770506:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789785100.770516:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9861:x1876725549021184:12345-0@lo:5: 00002000:00080000:0.0:1789785100.770537:0:8805:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789785100.770540:0:8805:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00010000:00080000:2.0:1789785100.771296:0:9857:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafacae8000 x1876725549021056/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789785116 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785100.771309:0:9857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9857:1876725549021056:0@lo:5: 00000004:00080000:2.0:1789785100.771321:0:9857:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789785100.771450:0:9857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9857:1876725549021312:0@lo:5: 00000100:00100000:2.0:1789785100.771482:0:9857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785100.771541:0:9857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8398ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789785100.771562:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549021312 00000100:00100000:2.0:1789785100.771567:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549021312 00000100:00100000:0.0:1789785100.771661:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789785100.771671:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9857:x1876725549021312:12345-0@lo:5: 00002000:00080000:0.0:1789785100.771699:0:8451:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1789785100.775716:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9857:x1876725549021312:12345-0@lo:5: Request processed in 4040us (4226us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789785100.775729:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789785100.777072:0:9857:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafacae8000 x1876725549021312/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789785116 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785100.777092:0:9857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9857:1876725549021312:0@lo:5: 00000004:00080000:3.0:1789785100.777106:0:9857:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789785100.777157:0:9857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb417800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9857:1876725549021440:0@lo:900: 00000100:00100000:3.0:1789785100.777208:0:9857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785100.777237:0:9857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf987f5240 going to sleep for 11 seconds 00000100:00100000:3.0:1789785100.777350:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549021440 00000100:00100000:3.0:1789785100.777357:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549021440 00000100:00100000:3.0:1789785100.777414:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789785100.777423:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9857:x1876725549021440:12345-0@lo:900: 00000100:00100000:3.0:1789785100.777488:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9857:x1876725549021440:12345-0@lo:900: Request processed in 66us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785100.777496:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789785100.777630:0:9857:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb417800 x1876725549021440/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789785116 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785100.777642:0:9857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb417800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9857:1876725549021440:0@lo:900: 00000001:00080000:3.0:1789785100.788160:0:9529:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:3.0:1789785100.788177:0:9529:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1789785100.788186:0:9529:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789785100.790685:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9861:x1876725549021184:12345-0@lo:5: Request processed in 20161us (20249us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789785100.790700:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1789785100.790799:0:9861:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae828fc700 x1876725549021184/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789785116 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785100.790813:0:9861:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789785100.790819:0:9861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9861:1876725549021184:0@lo:5: 00000004:00080000:0.0:1789785100.790847:0:9861:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789785100.790906:0:9861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9861:1876725549021568:0@lo:700: 00000100:00100000:0.0:1789785100.790955:0:9861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785100.791020:0:9861:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1afba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789785100.793017:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549021568 00000100:00100000:1.0:1789785100.793028:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549021568 00000100:00100000:0.0:1789785100.793269:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789785100.793281:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9861:x1876725549021568:12345-0@lo:700: 00000100:00100000:3.0:1789785100.815398:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9861:x1876725549021568:12345-0@lo:700: Request processed in 22110us (24433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785100.815413:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789785100.815652:0:9861:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae828fc700 x1876725549021568/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789785116 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785100.815667:0:9861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9861:1876725549021568:0@lo:700: 00000004:02000040:0.0:1789785100.817717:0:9861:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1789785100.832241:0:9861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83980700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9861:1876725549021696:0@lo:5: 00000100:00100000:1.0:1789785100.832311:0:9861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785100.832385:0:9861:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1b3e600 going to sleep for 11 seconds 00000100:00100000:2.0:1789785100.834287:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549021696 00000100:00100000:2.0:1789785100.834300:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549021696 00000100:00100000:2.0:1789785100.834408:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789785100.834418:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9861:x1876725549021696:12345-0@lo:5: 00002000:00080000:1.0:1789785100.846031:0:8449:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1789785100.846050:0:8449:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1789785100.852369:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9861:x1876725549021696:12345-0@lo:5: Request processed in 17918us (20023us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789785100.852383:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789785100.852427:0:9861:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83980700 x1876725549021696/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789785116 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785100.852448:0:9861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83980700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9861:1876725549021696:0@lo:5: 00000004:00080000:1.0:1789785100.852464:0:9861:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:02000400:2.0:1789785101.069183:0:9900:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789785101.122793:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549021824:0@lo:41: 00000100:00100000:1.0:1789785101.122875:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785101.126376:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549021824 00000100:00100000:1.0:1789785101.126390:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549021824 00000100:00100000:1.0:1789785101.126443:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789785101.126453:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549021824:12345-0@lo:41: 00000004:00000024:1.0:1789785101.126488:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789785101.126604:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549021824:12345-0@lo:41: Request processed in 140us (3717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785101.126612:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789785101.126656:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549021824:0@lo:41: 00010000:00010000:1.0:1789785101.314890:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789785102.044970:0:9952:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789785102.045178:0:9952:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789785102.338572:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785102.658904:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549021952:0@lo:13: 00000100:00100000:3.0:1789785102.658974:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785102.659157:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549021952 00000100:00100000:0.0:1789785102.659165:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549021952 00000100:00100000:0.0:1789785102.659221:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789785102.659230:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549021952:12345-0@lo:13: 00002000:00000024:0.0:1789785102.659258:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785102.659303:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549021952:12345-0@lo:13: Request processed in 74us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785102.659320:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789785102.659417:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789785102.659445:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae828fc700 x1876725549021952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785118 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785102.659464:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549021952:0@lo:13: 00000100:00100000:3.0:1789785102.659842:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549022080:0@lo:13: 00000100:00100000:3.0:1789785102.659874:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785102.664475:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549022080 00000100:00100000:0.0:1789785102.664488:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549022080 00000100:00100000:0.0:1789785102.664554:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789785102.664562:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549022080:12345-0@lo:13: 00002000:00000024:0.0:1789785102.664584:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785102.664684:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549022080:12345-0@lo:13: Request processed in 121us (4808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785102.664691:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789785102.664743:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae828fea00 x1876725549022080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785118 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785102.664769:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549022080:0@lo:13: 00000100:00100000:1.0:1789785102.665097:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549022208:0@lo:41: 00000100:00100000:1.0:1789785102.665134:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785102.665166:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549022208 00000100:00100000:1.0:1789785102.665170:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549022208 00000100:00100000:1.0:1789785102.665194:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789785102.665200:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549022208:12345-0@lo:41: 00000004:00000024:1.0:1789785102.665222:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789785102.665252:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549022208:12345-0@lo:41: Request processed in 52us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785102.665258:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789785102.665284:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549022208:0@lo:41: 00000100:00080000:3.0:1789785102.680629:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789785102.851197:0:9529:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:2.0:1789785103.365833:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785104.390226:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789785104.747961:0:10054:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789785104.748250:0:10054:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789785105.410854:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789785105.634700:0:10102:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789785105.634716:0:10102:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1789785106.022280:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785106.022484:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530099840 00000100:00100000:3.0:1789785106.022498:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530099840 00000100:00100000:3.0:1789785106.022561:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 179 00000100:00100000:3.0:1789785106.022571:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2396:x1876725530099840:12345-192.168.203.46@tcp:250: 00010000:00080000:3.0:1789785106.022608:0:6527:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 0dddf7d7-41ac-477b-b9db-b5e699635211@192.168.203.46@tcp t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:3.0:1789785106.022668:0:6527:0:(genops.c:1385:class_connect()) connect: client 0dddf7d7-41ac-477b-b9db-b5e699635211, cookie 0x2f18ee3fd845c251 00000100:00080000:3.0:1789785106.022841:0:6527:0:(import.c:65:import_set_state_nolock()) ffff9dae839ef800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789785106.022933:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+5:2396:x1876725530099840:12345-192.168.203.46@tcp:250: Request processed in 362us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785106.022943:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 179 00000100:00100000:0.0:1789785106.027006:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785106.027235:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530099968 00000100:00100000:1.0:1789785106.027248:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530099968 00000100:00100000:1.0:1789785106.027314:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 180 00000100:00100000:1.0:1789785106.027326:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+5:6155:x1876725530099968:12345-192.168.203.46@tcp:101: 00010000:00010000:1.0:1789785106.027377:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785106.027417:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc2050e00/0x2f18ee3fd845c258 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd84db expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785106.027476:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc2050e00/0x2f18ee3fd845c258 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd84db expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785106.027489:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc2050e00/0x2f18ee3fd845c258 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd84db expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785106.027612:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc2050e00, rc 0) 00000100:00100000:1.0:1789785106.027694:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+6:6155:x1876725530099968:12345-192.168.203.46@tcp:101: Request processed in 370us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785106.027701:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 180 00000100:00100000:0.0:1789785106.029262:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785106.029364:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530100096 00000100:00100000:1.0:1789785106.029374:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530100096 00000100:00100000:1.0:1789785106.029489:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 181 00000100:00100000:1.0:1789785106.029501:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+6:6155:x1876725530100096:12345-192.168.203.46@tcp:501: 00000100:00100000:1.0:1789785106.029635:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+6:6155:x1876725530100096:12345-192.168.203.46@tcp:501: Request processed in 135us (381us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789785106.029643:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 181 00000100:00100000:0.0:1789785106.040297:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785106.040434:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530100224 00000100:00100000:3.0:1789785106.040457:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530100224 00000100:00100000:3.0:1789785106.040543:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 182 00000100:00100000:3.0:1789785106.040556:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+6:6155:x1876725530100224:12345-192.168.203.46@tcp:101: 00010000:00010000:3.0:1789785106.040577:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785106.040598:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9daf829d3800/0x2f18ee3fd845c25f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd84e2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785106.040631:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9daf829d3800/0x2f18ee3fd845c25f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd84e2 expref: 7 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785106.040644:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9daf829d3800/0x2f18ee3fd845c25f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd84e2 expref: 7 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785106.040655:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf829d3800, rc 0) 00000100:00100000:3.0:1789785106.040730:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+7:6155:x1876725530100224:12345-192.168.203.46@tcp:101: Request processed in 176us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785106.040738:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 182 00000100:00100000:0.0:1789785106.042718:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785106.042838:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530100352 00000100:00100000:1.0:1789785106.042849:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530100352 00000100:00100000:1.0:1789785106.042917:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 183 00000100:00100000:1.0:1789785106.042928:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+7:6155:x1876725530100352:12345-192.168.203.46@tcp:501: 00000100:00100000:1.0:1789785106.043139:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+8:6155:x1876725530100352:12345-192.168.203.46@tcp:501: Request processed in 212us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785106.043148:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 183 00000100:00100000:0.0:1789785106.047881:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785106.048047:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530100480 00000100:00100000:1.0:1789785106.048075:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530100480 00000100:00100000:1.0:1789785106.048145:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 184 00000100:00100000:1.0:1789785106.048158:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+8:6155:x1876725530100480:12345-192.168.203.46@tcp:503: 00000100:00100000:1.0:1789785106.048413:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+8:6155:x1876725530100480:12345-192.168.203.46@tcp:503: Request processed in 256us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785106.048422:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 184 00000100:00100000:0.0:1789785106.052135:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785106.052241:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530100608 00000100:00100000:1.0:1789785106.052254:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530100608 00000100:00100000:1.0:1789785106.052633:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 185 00000100:00100000:1.0:1789785106.052647:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+8:6173:x1876725530100608:12345-192.168.203.46@tcp:502: 00000100:00100000:1.0:1789785106.052887:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+8:6173:x1876725530100608:12345-192.168.203.46@tcp:502: Request processed in 242us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785106.052897:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 185 00000100:00100000:0.0:1789785106.101523:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785106.101632:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530100736 00000100:00100000:3.0:1789785106.101645:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530100736 00000100:00100000:3.0:1789785106.101715:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 186 00000100:00100000:3.0:1789785106.101726:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+8:6173:x1876725530100736:12345-192.168.203.46@tcp:502: 00000100:00100000:3.0:1789785106.101955:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+8:6173:x1876725530100736:12345-192.168.203.46@tcp:502: Request processed in 229us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785106.101964:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 186 00000100:00100000:0.0:1789785106.108496:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785106.108602:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530100864 00000100:00100000:1.0:1789785106.108618:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530100864 00000100:00100000:1.0:1789785106.108697:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 187 00000100:00100000:1.0:1789785106.108711:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+8:6155:x1876725530100864:12345-192.168.203.46@tcp:101: 00010000:00010000:1.0:1789785106.108732:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785106.108757:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c266 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8513 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785106.108803:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8513 expref: 9 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785106.108816:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8513 expref: 9 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785106.108828:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc2051400, rc 0) 00000100:00100000:1.0:1789785106.109011:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+9:6155:x1876725530100864:12345-192.168.203.46@tcp:101: Request processed in 300us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785106.109019:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 187 00000100:00100000:0.0:1789785106.115923:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785106.116156:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530100992 00000100:00100000:1.0:1789785106.116170:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530100992 00000100:00100000:1.0:1789785106.116242:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 188 00000100:00100000:1.0:1789785106.116255:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+9:6155:x1876725530100992:12345-192.168.203.46@tcp:256: 20000000:01000000:1.0:1789785106.116292:0:6526:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789785106.116326:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789785106.116331:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789785106.116334:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789785106.116374:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789785106.116377:0:6526:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1789785106.120934:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+9:6155:x1876725530100992:12345-192.168.203.46@tcp:256: Request processed in 4665us (5008us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785106.120954:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 188 00000100:00100000:0.0:1789785106.128145:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785106.129125:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530101120 00000100:00100000:1.0:1789785106.129140:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530101120 00000100:00100000:1.0:1789785106.129220:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 189 00000100:00100000:1.0:1789785106.129232:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+9:6155:x1876725530101120:12345-192.168.203.46@tcp:101: 00010000:00010000:1.0:1789785106.129254:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785106.129277:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc2051a00/0x2f18ee3fd845c26d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd851a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785106.129315:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc2051a00/0x2f18ee3fd845c26d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd851a expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785106.129329:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc2051a00/0x2f18ee3fd845c26d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd851a expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785106.129404:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc2051a00, rc 0) 00000100:00100000:1.0:1789785106.129474:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+10:6155:x1876725530101120:12345-192.168.203.46@tcp:101: Request processed in 244us (1344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785106.129500:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 189 00000100:00100000:0.0:1789785106.139779:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785106.140965:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530101248 00000100:00100000:1.0:1789785106.140982:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530101248 00000100:00100000:1.0:1789785106.141067:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 190 00000100:00100000:1.0:1789785106.141079:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+10:6155:x1876725530101248:12345-192.168.203.46@tcp:501: 00000100:00100000:1.0:1789785106.141828:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+10:6155:x1876725530101248:12345-192.168.203.46@tcp:501: Request processed in 695us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785106.141839:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 190 00000100:00100000:0.0:1789785106.143668:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785106.143746:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530101376 00000100:00100000:3.0:1789785106.143756:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530101376 00000100:00100000:3.0:1789785106.143824:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 191 00000100:00100000:3.0:1789785106.143834:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+10:6155:x1876725530101376:12345-192.168.203.46@tcp:503: 00000100:00100000:3.0:1789785106.144002:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+10:6155:x1876725530101376:12345-192.168.203.46@tcp:503: Request processed in 168us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785106.144010:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 191 00000100:00100000:0.0:1789785106.149145:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785106.149258:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530101504 00000100:00100000:1.0:1789785106.149272:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530101504 00000100:00100000:1.0:1789785106.149380:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 192 00000100:00100000:1.0:1789785106.149391:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+10:6180:x1876725530101504:12345-192.168.203.46@tcp:502: 00000100:00100000:1.0:1789785106.149606:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+10:6180:x1876725530101504:12345-192.168.203.46@tcp:502: Request processed in 216us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785106.149615:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 192 00000100:00100000:0.0:1789785106.152133:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785106.152277:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530101632 00000100:00100000:1.0:1789785106.152289:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530101632 00000100:00100000:1.0:1789785106.152465:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 193 00000100:00100000:1.0:1789785106.152476:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+10:6180:x1876725530101632:12345-192.168.203.46@tcp:502: 00000100:00100000:1.0:1789785106.152653:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+10:6180:x1876725530101632:12345-192.168.203.46@tcp:502: Request processed in 178us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785106.152672:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 193 00000100:00100000:0.0:1789785106.157814:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785106.157869:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785106.157980:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530101760 00000100:00100000:1.0:1789785106.157992:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530101760 00000100:00100000:1.0:1789785106.158041:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530102016 00000100:00100000:1.0:1789785106.158044:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530102016 00000100:00100000:1.0:1789785106.158074:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:1.0:1789785106.158084:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1876725530101760:12345-192.168.203.46@tcp:38: 00010000:00080000:1.0:1789785106.158123:0:7896:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp t0 exp 0000000000000000 cur 214 last 0 00000100:00100000:3.0:1789785106.158394:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 8 00000100:00100000:3.0:1789785106.158401:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1876725530102016:12345-192.168.203.46@tcp:38: 00010000:00080000:3.0:1789785106.158419:0:6533:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:3.0:1789785106.158484:0:6533:0:(genops.c:1385:class_connect()) connect: client 026b2112-ee35-499c-8d01-18663664f08e, cookie 0x2f18ee3fd845c27b 00000004:00100000:3.0:1789785106.158527:0:6533:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789785106.158803:0:6533:0:(import.c:65:import_set_state_nolock()) ffff9dae839e8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789785106.158896:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+6:2396:x1876725530102016:12345-192.168.203.46@tcp:38: Request processed in 492us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785106.158904:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 8 00000020:00000080:1.0:1789785106.159134:0:7896:0:(genops.c:1385:class_connect()) connect: client 026b2112-ee35-499c-8d01-18663664f08e, cookie 0x2f18ee3fd845c274 00000004:00100000:1.0:1789785106.159153:0:7896:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789785106.159317:0:7896:0:(import.c:65:import_set_state_nolock()) ffff9dae8397d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789785106.159361:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+6:2396:x1876725530101760:12345-192.168.203.46@tcp:38: Request processed in 1277us (1564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785106.159369:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:0.0:1789785106.243440:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549022464:0@lo:13: 00000100:00100000:2.0:1789785106.243509:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789785106.243527:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549022592:0@lo:13: 00000100:00100000:2.0:1789785106.243608:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785106.243770:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785106.243884:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549022720:0@lo:400: 00000100:00100000:3.0:1789785106.243925:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785106.243970:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549022720 00000100:00100000:3.0:1789785106.243977:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549022720 00000100:00100000:3.0:1789785106.244023:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789785106.244032:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:3660:x1876725549022720:12345-0@lo:400: 00000100:00100000:3.0:1789785106.244091:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:3660:x1876725549022720:12345-0@lo:400: Request processed in 59us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785106.244104:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789785106.244156:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549022720:0@lo:400: 00000100:00100000:3.0:1789785106.244206:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549022336:0@lo:41: 00000100:00100000:3.0:1789785106.244233:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785106.244250:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725549022848:0@lo:400: 00000100:00100000:3.0:1789785106.244270:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785106.244288:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789785106.244293:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549022976:0@lo:400: 00000100:00100000:3.0:1789785106.244321:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785106.244371:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549022336 00000100:00100000:3.0:1789785106.244375:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549022336 00000100:00100000:3.0:1789785106.244398:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549022976 00000100:00100000:3.0:1789785106.244401:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549022976 00000100:00100000:3.0:1789785106.244413:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789785106.244419:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549022336:12345-0@lo:41: 00000004:00000024:3.0:1789785106.244449:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789785106.244486:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549022336:12345-0@lo:41: Request processed in 67us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785106.244493:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789785106.244503:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789785106.244508:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549022976:12345-0@lo:400: 00000100:00100000:3.0:1789785106.244531:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549022976:12345-0@lo:400: Request processed in 23us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785106.244537:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789785106.244569:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549022976:0@lo:400: 00000100:00100000:3.0:1789785106.244583:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549022336:0@lo:41: 00000100:00100000:3.0:1789785106.244619:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549022592 00000100:00100000:3.0:1789785106.244622:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549022592 00000100:00100000:3.0:1789785106.244647:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549022464 00000100:00100000:3.0:1789785106.244649:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549022464 00000100:00100000:3.0:1789785106.244660:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789785106.244665:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549022592:12345-0@lo:13: 00002000:00000024:3.0:1789785106.244684:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785106.244725:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549022592:12345-0@lo:13: Request processed in 59us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785106.244731:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789785106.244744:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789785106.244750:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549022464:12345-0@lo:13: 00002000:00000024:3.0:1789785106.244759:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785106.244790:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549022464:12345-0@lo:13: Request processed in 31us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785106.244795:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1789785106.244813:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789785106.244835:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3d1500 x1876725549022592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785122 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785106.244846:0:3660:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789785106.244854:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549022848 00000100:00100000:1.0:1789785106.244860:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549022848 00000100:00100000:3.0:1789785106.244864:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549022592:0@lo:13: 00000100:00100000:1.0:1789785106.244900:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789785106.244910:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725549022848:12345-0@lo:400: 00000100:00100000:1.0:1789785106.244965:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725549022848:12345-0@lo:400: Request processed in 58us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785106.244972:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1789785106.245033:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3d3800 x1876725549022848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785106.245043:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725549022848:0@lo:400: 00010000:00080000:0.0:1789785106.245382:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae828fc700 x1876725549022464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785122 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785106.245404:0:3662:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1789785106.245419:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549022464:0@lo:13: 00000100:00100000:3.0:1789785106.247642:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725549023360:0@lo:400: 00000100:00100000:3.0:1789785106.247721:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785106.247765:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549023872:0@lo:400: 00000100:00100000:3.0:1789785106.247803:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785106.247823:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789785106.247828:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549023488:0@lo:400: 00000100:00100000:3.0:1789785106.247849:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785106.247915:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549023360 00000100:00100000:2.0:1789785106.247923:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549023360 00000100:00100000:2.0:1789785106.247982:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549023872 00000100:00100000:2.0:1789785106.247997:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549023872 00000100:00100000:2.0:1789785106.248022:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789785106.248029:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725549023360:12345-0@lo:400: 00000100:00100000:2.0:1789785106.248081:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725549023360:12345-0@lo:400: Request processed in 52us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785106.248088:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789785106.248105:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789785106.248110:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549023872:12345-0@lo:400: 00000100:00100000:2.0:1789785106.248131:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549023872:12345-0@lo:400: Request processed in 22us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785106.248137:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1789785106.248200:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789785106.248231:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3d2a00 x1876725549023360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785106.248246:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725549023360:0@lo:400: 00010000:00080000:3.0:1789785106.248255:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3d0a80 x1876725549023872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785106.248263:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549023872:0@lo:400: 00000100:00100000:0.0:1789785106.248365:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549023488 00000100:00100000:0.0:1789785106.248369:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549023488 00000100:00100000:0.0:1789785106.248408:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789785106.248415:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf44aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549023488:12345-0@lo:400: 00000100:00100000:0.0:1789785106.248452:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf44aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549023488:12345-0@lo:400: Request processed in 38us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785106.248458:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789785106.248476:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1876725549023232:0@lo:400: 00000100:00100000:0.0:1789785106.248501:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785106.248514:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1876725549023744:0@lo:400: 00000100:00100000:0.0:1789785106.248529:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785106.248540:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789785106.248545:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1876725549023104:0@lo:400: 00000100:00100000:0.0:1789785106.248564:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785106.248575:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549023616:0@lo:400: 00000100:00100000:0.0:1789785106.248593:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785106.248659:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549023616 00000100:00100000:3.0:1789785106.248663:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549023616 00000100:00100000:3.0:1789785106.248692:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789785106.248698:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549023616:12345-0@lo:400: 00000100:00100000:3.0:1789785106.248729:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549023616:12345-0@lo:400: Request processed in 31us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785106.248735:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789785106.248749:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789785106.248763:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3d1c00 x1876725549023488/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785106.248773:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549023488:0@lo:400: 00000100:00100000:2.0:1789785106.248865:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549023232 00000100:00100000:2.0:1789785106.248869:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549023232 00000100:00100000:2.0:1789785106.248900:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549023744 00000100:00100000:2.0:1789785106.248904:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549023744 00000100:00100000:2.0:1789785106.248916:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549023104 00000100:00100000:2.0:1789785106.248918:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549023104 00000100:00100000:2.0:1789785106.248931:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789785106.248938:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1876725549023232:12345-0@lo:400: 00000100:00100000:2.0:1789785106.248969:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1876725549023232:12345-0@lo:400: Request processed in 32us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785106.248975:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789785106.248985:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789785106.248991:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1876725549023744:12345-0@lo:400: 00000100:00100000:2.0:1789785106.249014:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1876725549023744:12345-0@lo:400: Request processed in 24us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785106.249019:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789785106.249029:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789785106.249042:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1876725549023104:12345-0@lo:400: 00000100:00100000:2.0:1789785106.249066:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1876725549023104:12345-0@lo:400: Request processed in 26us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785106.249072:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1789785106.249130:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789785106.249185:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3d0000 x1876725549023104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785106.249195:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1876725549023104:0@lo:400: 00010000:00080000:0.0:1789785106.249204:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3d2300 x1876725549023616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785106.249212:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549023616:0@lo:400: 00010000:00080000:0.0:1789785106.249229:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3d2d80 x1876725549023232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785106.249236:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1876725549023232:0@lo:400: 00010000:00080000:0.0:1789785106.249245:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3d3b80 x1876725549023744/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785106.249252:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1876725549023744:0@lo:400: 00010000:00010000:2.0:1789785106.434746:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785107.164826:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785107.164895:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785107.164945:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530102144 00000100:00100000:2.0:1789785107.164958:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530102144 00000100:00100000:2.0:1789785107.165037:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530101888 00000100:00100000:2.0:1789785107.165040:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530101888 00000100:00100000:2.0:1789785107.165067:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00100000:2.0:1789785107.165082:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+6:0:x1876725530102144:12345-192.168.203.46@tcp:41: 00000004:00000024:2.0:1789785107.165131:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789785107.165206:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+6:0:x1876725530102144:12345-192.168.203.46@tcp:41: Request processed in 128us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785107.165214:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00100000:2.0:1789785107.165234:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:2.0:1789785107.165241:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf44a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+6:0:x1876725530101888:12345-192.168.203.46@tcp:41: 00000100:00080000:3.0:1789785107.165321:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789785107.165326:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789785107.165568:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000004:00000024:2.0:1789785107.165686:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789785107.165733:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf44a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+6:0:x1876725530101888:12345-192.168.203.46@tcp:41: Request processed in 491us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785107.165741:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:2.0:1789785107.165754:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530102272 00000100:00100000:2.0:1789785107.165757:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530102272 00000100:00100000:2.0:1789785107.165803:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:2.0:1789785107.165811:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+6:6155:x1876725530102272:12345-192.168.203.46@tcp:41: 00000004:00000024:2.0:1789785107.165823:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789785107.165855:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+6:6155:x1876725530102272:12345-192.168.203.46@tcp:41: Request processed in 45us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785107.165863:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:0.0:1789785107.168460:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785107.170413:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530102400 00000100:00100000:1.0:1789785107.170434:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530102400 00000100:00100000:1.0:1789785107.170527:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00100000:1.0:1789785107.170539:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+6:6155:x1876725530102400:12345-192.168.203.46@tcp:40: 00000100:00100000:1.0:1789785107.170661:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+6:6155:x1876725530102400:12345-192.168.203.46@tcp:40: Request processed in 122us (2403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785107.170686:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00100000:0.0:1789785107.173228:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785107.173508:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530102528 00000100:00100000:2.0:1789785107.173521:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530102528 00000100:00100000:2.0:1789785107.173578:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:2.0:1789785107.173589:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2396:x1876725530102528:12345-192.168.203.46@tcp:8: 00010000:00080000:2.0:1789785107.173664:0:8451:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:2.0:1789785107.173704:0:8451:0:(genops.c:1385:class_connect()) connect: client 026b2112-ee35-499c-8d01-18663664f08e, cookie 0x2f18ee3fd845c282 00002000:00100000:2.0:1789785107.173720:0:8451:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 026b2112-ee35-499c-8d01-18663664f08e/ffff9dae83735800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789785107.173743:0:8451:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789785107.173984:0:8451:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789785107.175652:0:8451:0:(import.c:65:import_set_state_nolock()) ffff9dae83733800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789785107.175834:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+6:2396:x1876725530102528:12345-192.168.203.46@tcp:8: Request processed in 2240us (2615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785107.175847:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:0.0:1789785107.181993:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785107.182218:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785107.182292:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530102912 00000100:00100000:2.0:1789785107.182305:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530102912 00000100:00100000:2.0:1789785107.182410:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 195 00000100:00100000:2.0:1789785107.182423:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2398:x1876725530102912:12345-192.168.203.46@tcp:400: 00000100:00100000:1.0:1789785107.182476:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530102784 00000100:00100000:1.0:1789785107.182483:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530102784 00000100:00100000:2.0:1789785107.182516:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2398:x1876725530102912:12345-192.168.203.46@tcp:400: Request processed in 95us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785107.182525:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 195 00000100:00100000:1.0:1789785107.182531:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 4 00000100:00100000:1.0:1789785107.182541:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:026b2112-ee35-499c-8d01-18663664f08e+6:6155:x1876725530102784:12345-192.168.203.46@tcp:900: 00000100:00100000:1.0:1789785107.182590:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:026b2112-ee35-499c-8d01-18663664f08e+6:6155:x1876725530102784:12345-192.168.203.46@tcp:900: Request processed in 51us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785107.182598:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 4 00000100:00100000:3.0:1789785107.184118:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785107.184468:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530102656 00000100:00100000:2.0:1789785107.184478:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530102656 00000100:00100000:2.0:1789785107.184535:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:2.0:1789785107.184562:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf44bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2396:x1876725530102656:12345-192.168.203.46@tcp:8: 00010000:00080000:2.0:1789785107.184602:0:8805:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:2.0:1789785107.184638:0:8805:0:(genops.c:1385:class_connect()) connect: client 026b2112-ee35-499c-8d01-18663664f08e, cookie 0x2f18ee3fd845c289 00002000:00100000:2.0:1789785107.184655:0:8805:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 026b2112-ee35-499c-8d01-18663664f08e/ffff9dae83732000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789785107.184670:0:8805:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789785107.185023:0:8805:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789785107.185064:0:8805:0:(import.c:65:import_set_state_nolock()) ffff9dae83737800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789785107.185196:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf44bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+6:2396:x1876725530102656:12345-192.168.203.46@tcp:8: Request processed in 634us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785107.185205:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:2.0:1789785107.191894:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785107.192034:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530103040 00000100:00100000:0.0:1789785107.192045:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530103040 00000100:00100000:0.0:1789785107.192115:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 0 00000100:00100000:0.0:1789785107.192126:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+6:6155:x1876725530103040:12345-192.168.203.46@tcp:33: 00000004:00080000:0.0:1789785107.219592:0:6536:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 27292us 00000004:00200000:0.0:1789785107.252089:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789785107.252194:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+6:6155:x1876725530103040:12345-192.168.203.46@tcp:33: Request processed in 60065us (60310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785107.252205:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 0 00000100:00100000:2.0:1789785107.425300:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785107.425580:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530103168 00000100:00100000:3.0:1789785107.425593:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530103168 00000100:00100000:3.0:1789785107.425660:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 13 00000100:00100000:3.0:1789785107.425671:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+6:6198:x1876725530103168:12345-192.168.203.46@tcp:101: 00010000:00010000:3.0:1789785107.425704:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785107.428962:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d3c00/0x2f18ee3fd845c290 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd854b expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785107.429046:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d2000/0x2f18ee3fd845c297 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785107.429060:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d2000/0x2f18ee3fd845c297 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785107.429075:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d2000/0x2f18ee3fd845c297 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785107.429123:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789785107.429126:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789785107.429141:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d2000/0x2f18ee3fd845c297 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785107.429168:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d3c00/0x2f18ee3fd845c290 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd854b expref: 8 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785107.429208:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d2000/0x2f18ee3fd845c297 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd854b expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785107.429217:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafac970e00) 00010000:00010000:3.0:1789785107.429220:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789785107.429223:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf829d2000, rc 0) 00000100:00100000:3.0:1789785107.429296:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+7:6198:x1876725530103168:12345-192.168.203.46@tcp:101: Request processed in 3626us (4009us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785107.429305:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 13 00010000:00010000:1.0:1789785107.458659:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785107.778575:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549024000:0@lo:13: 00000100:00100000:2.0:1789785107.778671:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785107.781661:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549024128:0@lo:13: 00000100:00100000:3.0:1789785107.781732:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785107.781845:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549024000 00000100:00100000:0.0:1789785107.781864:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549024000 00000100:00100000:0.0:1789785107.781902:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549024128 00000100:00100000:0.0:1789785107.781905:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549024128 00000100:00100000:0.0:1789785107.781921:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789785107.781929:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549024000:12345-0@lo:13: 00002000:00000024:0.0:1789785107.782165:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785107.782229:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549024000:12345-0@lo:13: Request processed in 300us (3557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785107.782237:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789785107.782255:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789785107.782261:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549024128:12345-0@lo:13: 00002000:00000024:0.0:1789785107.782283:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785107.782311:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549024128:12345-0@lo:13: Request processed in 50us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785107.782317:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789785107.782476:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb620ed80 x1876725549024128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785123 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785107.782495:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549024128:0@lo:13: 00010000:00080000:3.0:1789785107.782530:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb620c000 x1876725549024000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785123 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785107.782543:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549024000:0@lo:13: 00000100:00100000:2.0:1789785107.783099:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549024256:0@lo:41: 00000100:00100000:2.0:1789785107.783134:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785107.783242:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549024256 00000100:00100000:0.0:1789785107.783247:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549024256 00000100:00100000:0.0:1789785107.783447:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789785107.783455:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549024256:12345-0@lo:41: 00000004:00000024:0.0:1789785107.783482:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789785107.783530:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549024256:12345-0@lo:41: Request processed in 75us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785107.783536:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789785107.783638:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549024256:0@lo:41: 00010000:00010000:0.0:1789785108.485271:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785109.466192:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785109.466585:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530103296 00000100:00100000:1.0:1789785109.466595:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530103296 00000100:00100000:1.0:1789785109.466668:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 14 00000100:00100000:1.0:1789785109.466679:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+7:6251:x1876725530103296:12345-192.168.203.46@tcp:41: 00000004:00000024:1.0:1789785109.466714:0:7896:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789785109.466796:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+7:6251:x1876725530103296:12345-192.168.203.46@tcp:41: Request processed in 119us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785109.466804:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 14 00000100:00080000:3.0:1789785109.467071:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789785109.469378:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785109.469506:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530103424 00000100:00100000:2.0:1789785109.469516:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530103424 00000100:00100000:2.0:1789785109.469624:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 15 00000100:00100000:2.0:1789785109.469635:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+6:6251:x1876725530103424:12345-192.168.203.46@tcp:41: 00000004:00000024:2.0:1789785109.469669:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789785109.469733:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+6:6251:x1876725530103424:12345-192.168.203.46@tcp:41: Request processed in 99us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785109.469749:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 15 00000100:00080000:3.0:1789785109.471487:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789785109.473753:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785109.473900:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530103552 00000100:00100000:0.0:1789785109.473910:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530103552 00000100:00100000:0.0:1789785109.473978:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:0.0:1789785109.473989:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:026b2112-ee35-499c-8d01-18663664f08e+6:6251:x1876725530103552:12345-192.168.203.46@tcp:13: 00002000:00000024:0.0:1789785109.474019:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785109.474082:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:026b2112-ee35-499c-8d01-18663664f08e+6:6251:x1876725530103552:12345-192.168.203.46@tcp:13: Request processed in 95us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785109.474106:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00080000:3.0:1789785109.474725:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789785109.476316:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785109.476418:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530103680 00000100:00100000:0.0:1789785109.476425:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530103680 00000100:00100000:0.0:1789785109.476491:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:0.0:1789785109.476501:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:026b2112-ee35-499c-8d01-18663664f08e+6:6251:x1876725530103680:12345-192.168.203.46@tcp:13: 00002000:00000024:0.0:1789785109.476527:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785109.476582:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:026b2112-ee35-499c-8d01-18663664f08e+6:6251:x1876725530103680:12345-192.168.203.46@tcp:13: Request processed in 82us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785109.476590:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00080000:3.0:1789785109.477267:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789785109.506610:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785110.530490:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785111.362610:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789785111.362644:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549024384:0@lo:13: 00000100:00100000:2.0:1789785111.362719:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785111.362893:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549024384 00000100:00100000:0.0:1789785111.362901:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549024384 00000100:00080000:3.0:1789785111.362938:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789785111.362954:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789785111.362963:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549024384:12345-0@lo:13: 00002000:00000024:0.0:1789785111.362990:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785111.363038:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549024384:12345-0@lo:13: Request processed in 75us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785111.363044:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789785111.363082:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb620dc00 x1876725549024384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785111.363100:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549024384:0@lo:13: 00000100:00100000:3.0:1789785111.363225:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789785111.363235:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549024512:0@lo:400: 00000100:00100000:3.0:1789785111.363272:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785111.363298:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549024896:0@lo:13: 00000100:00100000:3.0:1789785111.363319:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785111.363367:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549024512 00000100:00100000:3.0:1789785111.363371:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549024512 00000100:00100000:2.0:1789785111.363386:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549024896 00000100:00100000:2.0:1789785111.363390:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549024896 00000100:00100000:3.0:1789785111.363397:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789785111.363402:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:3661:x1876725549024512:12345-0@lo:400: 00000100:00100000:3.0:1789785111.363436:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:3661:x1876725549024512:12345-0@lo:400: Request processed in 33us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785111.363443:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:3.0:1789785111.363477:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789785111.363492:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549024512:0@lo:400: 00000100:00100000:0.0:1789785111.364198:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549024640:0@lo:400: 00000100:00100000:0.0:1789785111.364237:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785111.364263:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876725549025152:0@lo:400: 00000100:00100000:0.0:1789785111.364282:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785111.364310:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549025664:0@lo:400: 00000100:00100000:0.0:1789785111.364332:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785111.364405:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789785111.364414:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549024896:12345-0@lo:13: 00002000:00000024:2.0:1789785111.364428:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785111.364458:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549024896:12345-0@lo:13: Request processed in 47us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785111.364464:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789785111.364492:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549024640 00000100:00100000:2.0:1789785111.364496:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549024640 00000100:00100000:2.0:1789785111.364520:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549025152 00000100:00100000:2.0:1789785111.364523:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549025152 00000100:00100000:2.0:1789785111.364539:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789785111.364545:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549024640:12345-0@lo:400: 00000100:00100000:2.0:1789785111.365005:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549024640:12345-0@lo:400: Request processed in 459us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785111.365005:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549024768:0@lo:41: 00000100:00100000:2.0:1789785111.365013:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789785111.365026:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789785111.365032:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876725549025152:12345-0@lo:400: 00000100:00100000:1.0:1789785111.365036:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785111.365057:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876725549025152:12345-0@lo:400: Request processed in 26us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785111.365057:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549025280:0@lo:400: 00000100:00100000:2.0:1789785111.365063:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789785111.365074:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785111.365090:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549025792:0@lo:400: 00000100:00100000:1.0:1789785111.365120:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785111.365242:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549024640:0@lo:400: 00000100:00100000:0.0:1789785111.365258:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876725549025152:0@lo:400: 00000100:00100000:0.0:1789785111.365286:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549024768 00000100:00100000:0.0:1789785111.365290:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549024768 00000100:00100000:0.0:1789785111.365313:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549025280 00000100:00100000:0.0:1789785111.365315:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549025280 00000100:00100000:0.0:1789785111.365327:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789785111.365333:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3660:x1876725549024768:12345-0@lo:41: 00000004:00000024:0.0:1789785111.365376:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789785111.365410:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3660:x1876725549024768:12345-0@lo:41: Request processed in 77us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785111.365416:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789785111.365430:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789785111.365435:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549025280:12345-0@lo:400: 00000100:00100000:0.0:1789785111.365463:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549025280:12345-0@lo:400: Request processed in 27us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785111.365468:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789785111.365491:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549025024:0@lo:400: 00000100:00100000:0.0:1789785111.365513:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785111.365530:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1876725549025536:0@lo:400: 00000100:00100000:0.0:1789785111.365549:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785111.365834:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1876725549026048:0@lo:400: 00000100:00100000:0.0:1789785111.365858:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785111.365889:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789785111.365896:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1876725549025408:0@lo:400: 00000100:00100000:0.0:1789785111.365932:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785111.365954:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1876725549025920:0@lo:400: 00000100:00100000:0.0:1789785111.365976:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785111.366069:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549025536 00000100:00100000:0.0:1789785111.366073:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549025536 00000100:00100000:0.0:1789785111.366097:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549026048 00000100:00100000:0.0:1789785111.366099:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549026048 00000100:00100000:0.0:1789785111.366110:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549025408 00000100:00100000:0.0:1789785111.366112:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549025408 00000100:00100000:0.0:1789785111.366122:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549025920 00000100:00100000:0.0:1789785111.366123:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549025920 00000100:00100000:0.0:1789785111.366214:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789785111.366221:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1876725549025536:12345-0@lo:400: 00000100:00100000:0.0:1789785111.366261:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1876725549025536:12345-0@lo:400: Request processed in 41us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785111.366267:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789785111.366279:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789785111.366285:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1876725549026048:12345-0@lo:400: 00000100:00100000:0.0:1789785111.366314:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1876725549026048:12345-0@lo:400: Request processed in 29us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785111.366319:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789785111.366329:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789785111.366330:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549024768:0@lo:41: 00000100:00100000:0.0:1789785111.366335:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb53b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1876725549025408:12345-0@lo:400: 00000100:00100000:1.0:1789785111.366354:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549025280:0@lo:400: 00000100:00100000:0.0:1789785111.366386:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb53b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1876725549025408:12345-0@lo:400: Request processed in 51us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785111.366393:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789785111.366402:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789785111.366410:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb53b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1876725549025920:12345-0@lo:400: 00000100:00100000:0.0:1789785111.366428:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1876725549025408:0@lo:400: 00000100:00100000:1.0:1789785111.366438:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb53b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1876725549025920:12345-0@lo:400: Request processed in 29us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785111.366438:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1876725549025920:0@lo:400: 00000100:00100000:1.0:1789785111.366444:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1789785111.366448:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb620c700 x1876725549025536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785111.366458:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1876725549025536:0@lo:400: 00000100:00100000:1.0:1789785111.366459:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549025024 00000100:00100000:1.0:1789785111.366462:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549025024 00010000:00080000:0.0:1789785111.366467:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb620d500 x1876725549026048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785111.366476:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1876725549026048:0@lo:400: 00000100:00100000:1.0:1789785111.366477:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789785111.366482:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549025024:12345-0@lo:400: 00000100:00100000:1.0:1789785111.366519:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549025024:12345-0@lo:400: Request processed in 37us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785111.366526:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789785111.366548:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549025024:0@lo:400: 00000100:00100000:2.0:1789785111.366638:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549025664 00000100:00100000:2.0:1789785111.366649:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549025664 00000100:00100000:2.0:1789785111.366674:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549025792 00000100:00100000:2.0:1789785111.366677:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549025792 00000100:00100000:2.0:1789785111.366697:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789785111.366702:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549025664:12345-0@lo:400: 00000100:00100000:2.0:1789785111.366740:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549025664:12345-0@lo:400: Request processed in 37us (2406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785111.366908:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789785111.366916:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549025792:12345-0@lo:400: 00000100:00100000:1.0:1789785111.366950:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549025792:12345-0@lo:400: Request processed in 36us (1829us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785111.366955:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1789785111.366981:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb620f480 x1876725549025792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785111.366992:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549025792:0@lo:400: 00010000:00080000:1.0:1789785111.367024:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb620c380 x1876725549025664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785111.367047:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549025664:0@lo:400: 00000100:00100000:2.0:1789785111.367966:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1789785111.369582:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789785111.369590:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789785111.369592:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789785111.369634:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3d3b80 x1876725549024896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785111.369657:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549024896:0@lo:13: 00010000:00010000:3.0:1789785111.555643:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789785111.849659:0:10200:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:0.0:1789785111.878618:0:7465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 026b2112-ee35-499c-8d01-18663664f08e 00000001:00100000:3.0:1789785111.882017:0:9529:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 026b2112-ee35-499c-8d01-18663664f08e 00000001:00100000:2.0:1789785111.884599:0:6512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 026b2112-ee35-499c-8d01-18663664f08e 00000100:00100000:2.0:1789785112.555931:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785112.555977:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785112.556019:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785112.556047:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530103936 00000100:00100000:2.0:1789785112.556058:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785112.556067:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530103936 00000100:00100000:2.0:1789785112.556088:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785112.556121:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530103808 00000100:00100000:2.0:1789785112.556130:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530103808 00000100:00100000:1.0:1789785112.556170:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530104064 00000100:00100000:1.0:1789785112.556177:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530104064 00000100:00100000:2.0:1789785112.556187:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 197 00000100:00100000:2.0:1789785112.556204:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2399:x1876725530103808:12345-192.168.203.46@tcp:400: 00000100:00100000:1.0:1789785112.556225:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 51 00000100:00100000:1.0:1789785112.556239:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+6:2399:x1876725530103936:12345-192.168.203.46@tcp:400: 00000100:00100000:2.0:1789785112.556278:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2399:x1876725530103808:12345-192.168.203.46@tcp:400: Request processed in 79us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785112.556288:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 197 00000100:00100000:1.0:1789785112.556314:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+6:2399:x1876725530103936:12345-192.168.203.46@tcp:400: Request processed in 77us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785112.556324:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 51 00000100:00100000:1.0:1789785112.556405:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 52 00000100:00100000:1.0:1789785112.556414:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+5:2399:x1876725530104064:12345-192.168.203.46@tcp:400: 00000100:00100000:1.0:1789785112.556455:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+5:2399:x1876725530104064:12345-192.168.203.46@tcp:400: Request processed in 43us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785112.556462:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 52 00000100:00100000:0.0:1789785112.556761:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530104192 00000100:00100000:0.0:1789785112.556767:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530104192 00000100:00100000:0.0:1789785112.556813:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530104320 00000100:00100000:0.0:1789785112.556816:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530104320 00000100:00100000:0.0:1789785112.556845:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:0.0:1789785112.556853:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+6:2399:x1876725530104192:12345-192.168.203.46@tcp:400: 00000100:00100000:0.0:1789785112.556893:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+6:2399:x1876725530104192:12345-192.168.203.46@tcp:400: Request processed in 41us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785112.556916:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:0.0:1789785112.556930:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00100000:0.0:1789785112.556936:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2399:x1876725530104320:12345-192.168.203.46@tcp:400: 00000100:00100000:0.0:1789785112.556960:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2399:x1876725530104320:12345-192.168.203.46@tcp:400: Request processed in 25us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785112.556967:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00080000:0.0:1789785112.556982:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789785112.556985:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789785112.556987:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789785112.556989:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789785112.579213:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785112.901839:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549026176:0@lo:41: 00000100:00100000:1.0:1789785112.901952:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785112.902056:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549026176 00000100:00100000:1.0:1789785112.902066:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549026176 00000100:00100000:1.0:1789785112.902125:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789785112.902135:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549026176:12345-0@lo:41: 00000004:00000024:1.0:1789785112.902179:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789785112.902228:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549026176:12345-0@lo:41: Request processed in 94us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785112.902236:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789785112.902313:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549026176:0@lo:41: 00000100:00100000:1.0:1789785112.902416:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549026304:0@lo:13: 00000100:00100000:1.0:1789785112.903314:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785112.903416:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549026304 00000100:00100000:1.0:1789785112.903434:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549026304 00000100:00100000:1.0:1789785112.904951:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789785112.904968:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549026304:12345-0@lo:13: 00002000:00000024:1.0:1789785112.905014:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785112.905119:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549026304:12345-0@lo:13: Request processed in 156us (1808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785112.905127:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789785112.905194:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83980700 x1876725549026304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785128 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785112.905220:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549026304:0@lo:13: 00000001:00100000:1.0:1789785112.912882:0:8445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 026b2112-ee35-499c-8d01-18663664f08e 00000100:00100000:0.0:1789785112.913550:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549026432:0@lo:13: 00000100:00100000:0.0:1789785112.913661:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785112.913770:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549026432 00000100:00100000:0.0:1789785112.913780:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549026432 00000100:00100000:0.0:1789785112.913843:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789785112.913855:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb539880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549026432:12345-0@lo:13: 00002000:00000024:0.0:1789785112.913886:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785112.913938:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb539880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549026432:12345-0@lo:13: Request processed in 85us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785112.913946:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1789785112.914008:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb620c380 x1876725549026432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785128 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785112.914042:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549026432:0@lo:13: 00010000:00010000:1.0:1789785113.604332:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785114.626605:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785115.657732:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789785116.472656:0:10347:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd8fca0390 20000000:00000080:1.0:1789785116.472682:0:10347:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dafbb418000 uarg=0000000000000000 20000000:01000000:1.0:1789785116.472876:0:10347:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1789785116.472879:0:10347:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1789785116.472882:0:10347:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789785116.472889:0:10347:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789785116.472895:0:10347:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1789785116.472975:0:10347:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789785116.472979:0:10347:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789785116.478809:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1789785116.480085:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1789785116.480199:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1789785116.480221:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:3.0:1789785116.480235:0:10347:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789785116.480238:0:10347:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789785116.480931:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1789785116.481231:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1789785116.481255:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1789785116.481271:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:3.0:1789785116.481281:0:10347:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789785116.481283:0:10347:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000100:00100000:0.0:1789785116.487969:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549026560:0@lo:400: 00000100:00100000:0.0:1789785116.488074:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785116.488301:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb53a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549027072:0@lo:400: 00000100:00100000:0.0:1789785116.488331:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785116.488377:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549027584:0@lo:400: 00000100:00100000:0.0:1789785116.490042:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785116.490123:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb538e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549028096:0@lo:400: 00000100:00100000:0.0:1789785116.490180:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785116.490219:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789785116.490226:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725549026944:0@lo:400: 00000100:00100000:0.0:1789785116.490254:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785116.490278:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549027456:0@lo:400: 00000100:00100000:0.0:1789785116.490298:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785116.490315:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb53b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549027968:0@lo:400: 00000100:00100000:0.0:1789785116.490334:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785116.490406:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb53ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549026688:0@lo:400: 00000100:00100000:0.0:1789785116.490564:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785116.490589:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb53bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549027200:0@lo:400: 00000100:00100000:0.0:1789785116.490611:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785116.490630:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb538700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549027712:0@lo:400: 00000100:00100000:0.0:1789785116.490651:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785116.490668:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549028224:0@lo:13: 00000100:00100000:0.0:1789785116.490925:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785116.490960:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1789785116.490967:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb53aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549026816:0@lo:400: 00000100:00100000:0.0:1789785116.490993:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785116.491019:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb538a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549027328:0@lo:400: 00000100:00100000:0.0:1789785116.491059:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785116.491073:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1876725549027840:0@lo:400: 00000100:00100000:3.0:1789785116.491261:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549028224 00000100:00100000:3.0:1789785116.491271:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549028224 00000100:00100000:3.0:1789785116.491368:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789785116.491387:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549028224:12345-0@lo:13: 00002000:00000024:3.0:1789785116.491499:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785116.491549:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549028224:12345-0@lo:13: Request processed in 165us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785116.491557:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789785116.491640:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785116.491658:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549028352:0@lo:13: 00000100:00100000:0.0:1789785116.492579:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789785116.492637:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb539500 x1876725549028224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785116.492664:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549028224:0@lo:13: 00000100:00100000:3.0:1789785116.493221:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549028352 00000100:00100000:3.0:1789785116.493232:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549028352 00000100:00100000:3.0:1789785116.493279:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789785116.493288:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549028352:12345-0@lo:13: 00002000:00000024:3.0:1789785116.493313:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785116.493555:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549026560 00000100:00100000:0.0:1789785116.493561:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549026560 00000100:00100000:0.0:1789785116.493602:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789785116.493610:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:3662:x1876725549026560:12345-0@lo:400: 00000100:00100000:2.0:1789785116.493809:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549026944 00000100:00100000:2.0:1789785116.493816:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549026944 00000100:00100000:2.0:1789785116.493848:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549026688 00000100:00100000:2.0:1789785116.493851:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549026688 00000100:00100000:2.0:1789785116.493863:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549027200 00000100:00100000:2.0:1789785116.493865:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549027200 00000100:00100000:2.0:1789785116.493903:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549027712 00000100:00100000:2.0:1789785116.493907:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549027712 00000100:00100000:2.0:1789785116.493921:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549027328 00000100:00100000:2.0:1789785116.493924:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549027328 00000100:00100000:2.0:1789785116.493944:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549027840 00000100:00100000:2.0:1789785116.493948:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549027840 00000100:00100000:2.0:1789785116.493965:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789785116.493972:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725549026944:12345-0@lo:400: 00000100:00100000:0.0:1789785116.494067:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:3662:x1876725549026560:12345-0@lo:400: Request processed in 457us (5992us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785116.494075:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789785116.494142:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549027072 00000100:00100000:0.0:1789785116.494146:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549027072 00000100:00100000:0.0:1789785116.494174:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549026816 00000100:00100000:0.0:1789785116.494177:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549026816 00000100:00100000:0.0:1789785116.494191:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789785116.494197:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb53a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549027072:12345-0@lo:400: 00000100:00100000:0.0:1789785116.494235:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb53a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549027072:12345-0@lo:400: Request processed in 37us (5902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785116.494241:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789785116.494253:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789785116.494258:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549026816:12345-0@lo:400: 00000100:00100000:0.0:1789785116.494304:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549026816:12345-0@lo:400: Request processed in 46us (3310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785116.494312:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789785116.494335:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549027584 00000100:00100000:0.0:1789785116.494361:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549027584 00000100:00100000:0.0:1789785116.494384:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549028096 00000100:00100000:0.0:1789785116.494387:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549028096 00000100:00100000:0.0:1789785116.494399:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549027456 00000100:00100000:0.0:1789785116.494402:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549027456 00000100:00100000:0.0:1789785116.494415:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549027968 00000100:00100000:0.0:1789785116.494418:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549027968 00000100:00100000:0.0:1789785116.494450:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789785116.494458:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549027584:12345-0@lo:400: 00000100:00100000:0.0:1789785116.494491:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549027584:12345-0@lo:400: Request processed in 34us (4458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785116.494498:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789785116.494509:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789785116.494515:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549028096:12345-0@lo:400: 00000100:00100000:0.0:1789785116.494547:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549028096:12345-0@lo:400: Request processed in 31us (4365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785116.494554:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789785116.494566:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789785116.494572:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549027456:12345-0@lo:400: 00000100:00100000:0.0:1789785116.494600:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549027456:12345-0@lo:400: Request processed in 29us (4301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785116.494606:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789785116.494616:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789785116.494622:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3662:x1876725549027968:12345-0@lo:400: 00000100:00100000:0.0:1789785116.494659:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3662:x1876725549027968:12345-0@lo:400: Request processed in 37us (4323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785116.494666:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789785116.494716:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789785116.494726:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549026688:12345-0@lo:400: 00000100:00100000:0.0:1789785116.494759:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549026688:12345-0@lo:400: Request processed in 35us (4196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785116.494766:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789785116.494780:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789785116.494785:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549027200:12345-0@lo:400: 00000100:00100000:0.0:1789785116.494813:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549027200:12345-0@lo:400: Request processed in 27us (4201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785116.494819:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789785116.494829:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789785116.494836:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549027712:12345-0@lo:400: 00000100:00100000:0.0:1789785116.494867:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549027712:12345-0@lo:400: Request processed in 31us (4214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785116.494874:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789785116.494885:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789785116.494892:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549027328:12345-0@lo:400: 00000100:00100000:0.0:1789785116.494920:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549027328:12345-0@lo:400: Request processed in 29us (3860us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785116.494926:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789785116.494936:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789785116.494942:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876725549027840:12345-0@lo:400: 00000100:00100000:0.0:1789785116.494982:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876725549027840:12345-0@lo:400: Request processed in 41us (3890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785116.494989:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1789785116.495020:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789785116.495027:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789785116.495030:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789785116.495032:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789785116.495064:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549028480:0@lo:41: 00000100:00100000:0.0:1789785116.495120:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789785116.495193:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb539f80 x1876725549027456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785116.495210:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549027456:0@lo:400: 00010000:00080000:0.0:1789785116.495224:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb53b480 x1876725549027968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785116.495234:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb53b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549027968:0@lo:400: 00000100:00100000:0.0:1789785116.495247:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549026560:0@lo:400: 00000100:00100000:0.0:1789785116.495259:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb53a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549027072:0@lo:400: 00010000:00080000:0.0:1789785116.495272:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb539180 x1876725549027584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785116.495280:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549027584:0@lo:400: 00010000:00080000:0.0:1789785116.495293:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb538e00 x1876725549028096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785116.495301:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb538e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549028096:0@lo:400: 00000100:00100000:0.0:1789785116.495333:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549028480 00000100:00100000:0.0:1789785116.495369:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549028480 00000100:00100000:0.0:1789785116.495400:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789785116.495407:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549028480:12345-0@lo:41: 00000004:00000024:0.0:1789785116.495435:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789785116.495471:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549028480:12345-0@lo:41: Request processed in 65us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785116.495477:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789785116.495507:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb53aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549026816:0@lo:400: 00010000:00080000:0.0:1789785116.495521:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb538a80 x1876725549027328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785116.495531:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb538a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549027328:0@lo:400: 00010000:00080000:0.0:1789785116.495545:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb538380 x1876725549027840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785116.495554:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1876725549027840:0@lo:400: 00000100:00100000:0.0:1789785116.495566:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb53ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549026688:0@lo:400: 00000100:00100000:0.0:1789785116.495578:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb53bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549027200:0@lo:400: 00000100:00100000:0.0:1789785116.495588:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb538700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549027712:0@lo:400: 00000100:00100000:0.0:1789785116.495625:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549028480:0@lo:41: 00000100:00100000:3.0:1789785116.497044:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549028352:12345-0@lo:13: Request processed in 3745us (5349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785116.497058:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1789785116.497244:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf448700 x1876725549028352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785116.497266:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549028352:0@lo:13: 00000100:00100000:2.0:1789785116.497559:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725549026944:12345-0@lo:400: Request processed in 3583us (7300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785116.497570:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789785116.497802:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725549026944:0@lo:400: 00000040:00080000:1.0:1789785116.498282:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1789785116.498990:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1789785116.499030:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1789785116.499048:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:3.0:1789785116.499060:0:10347:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789785116.499063:0:10347:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789785116.499954:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1789785116.500281:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1789785116.500308:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1789785116.500323:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:3.0:1789785116.500333:0:10347:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789785116.501619:0:10347:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789785116.502370:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1789785116.503032:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1789785116.503069:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1789785116.503085:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 10000000:01000000:1.0:1789785116.503216:0:10347:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789785116.503245:0:10347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dafc1a64400/0x2f18ee3fd845c29e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785116.503268:0:10347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc2050400/0x2f18ee3fd845c139 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c132 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785116.503277:0:10347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc21caa00/0x2f18ee3fd845c163 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c15c expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785116.503285:0:10347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc1b08400/0x2f18ee3fd845c1a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c19b expref: 23 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785116.503293:0:10347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc1b08000/0x2f18ee3fd845c1b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c1a9 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785116.503300:0:10347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc21ca600/0x2f18ee3fd845c1be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c1b7 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785116.503307:0:10347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9daf829d2a00/0x2f18ee3fd845c1da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c1d3 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785116.503314:0:10347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9daf829d3000/0x2f18ee3fd845c204 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c1fd expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785116.503323:0:10347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845c220 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c219 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785116.503575:0:10347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc2050200/0x2f18ee3fd845c24a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c243 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785116.503586:0:10347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc2050e00/0x2f18ee3fd845c258 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd84db expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785116.503594:0:10347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9daf829d3800/0x2f18ee3fd845c25f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd84e2 expref: 9 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785116.503604:0:10347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dafc1a64400/0x2f18ee3fd845c29e lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785116.503659:0:10347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9daf829d3800/0x2f18ee3fd845c25f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd84e2 expref: 9 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785116.503677:0:10347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9daf829d3800/0x2f18ee3fd845c25f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd84e2 expref: 9 pid: 6527 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785116.503778:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1876725549028608:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789785116.504041:0:10347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc2050e00/0x2f18ee3fd845c258 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd84db expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785116.504051:0:10347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dafc2050e00/0x2f18ee3fd845c258 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd84db expref: 9 pid: 6526 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785116.504060:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1876725549028736:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789785116.504091:0:10347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc2050200/0x2f18ee3fd845c24a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c243 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785116.505621:0:10347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dafc2050200/0x2f18ee3fd845c24a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c243 expref: 23 pid: 6528 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785116.505639:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1876725549028864:0@lo:104: 00000100:00100000:1.0:1789785116.505779:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789785116.505854:0:10347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845c220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c219 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785116.505863:0:10347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845c220 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c219 expref: 23 pid: 6526 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785116.505872:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1876725549028992:0@lo:104: 00000100:00100000:1.0:1789785116.505895:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789785116.505929:0:10347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9daf829d3000/0x2f18ee3fd845c204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c1fd expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785116.505938:0:10347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9daf829d3000/0x2f18ee3fd845c204 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c1fd expref: 23 pid: 6528 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785116.505946:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1876725549029120:0@lo:104: 00000100:00100000:1.0:1789785116.505969:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789785116.505993:0:10347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9daf829d2a00/0x2f18ee3fd845c1da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c1d3 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785116.506002:0:10347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9daf829d2a00/0x2f18ee3fd845c1da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c1d3 expref: 23 pid: 6528 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785116.506011:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1876725549029248:0@lo:104: 00000100:00100000:1.0:1789785116.506044:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789785116.506064:0:10347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc21ca600/0x2f18ee3fd845c1be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c1b7 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785116.506073:0:10347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dafc21ca600/0x2f18ee3fd845c1be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c1b7 expref: 23 pid: 6526 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785116.506081:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b39180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1876725549029376:0@lo:104: 00010000:00010000:1.0:1789785116.506263:0:10347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc1b08000/0x2f18ee3fd845c1b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c1a9 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785116.506272:0:10347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dafc1b08000/0x2f18ee3fd845c1b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c1a9 expref: 23 pid: 6528 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785116.506281:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83877480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1876725549029504:0@lo:104: 00010000:00010000:1.0:1789785116.506305:0:10347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc1b08400/0x2f18ee3fd845c1a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c19b expref: 23 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785116.506314:0:10347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dafc1b08400/0x2f18ee3fd845c1a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c19b expref: 23 pid: 6527 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785116.506323:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83875f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1876725549029632:0@lo:104: 00010000:00010000:1.0:1789785116.506380:0:10347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc21caa00/0x2f18ee3fd845c163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c15c expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785116.506388:0:10347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dafc21caa00/0x2f18ee3fd845c163 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c15c expref: 23 pid: 6526 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785116.506395:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83875c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1876725549029760:0@lo:104: 00010000:00010000:1.0:1789785116.506418:0:10347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc2050400/0x2f18ee3fd845c139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c132 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785116.506571:0:8466:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789785116.506594:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785116.506609:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785116.506621:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785116.506631:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785116.506642:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549028864 00000100:00100000:2.0:1789785116.506651:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549028864 00000100:00100000:2.0:1789785116.506719:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549028992 00000100:00100000:2.0:1789785116.506723:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549028992 00000100:00100000:2.0:1789785116.506735:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549029120 00000100:00100000:2.0:1789785116.506737:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549029120 00000100:00100000:2.0:1789785116.506747:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549029248 00000100:00100000:2.0:1789785116.506750:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549029248 00000100:00100000:2.0:1789785116.506760:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549029376 00000100:00100000:2.0:1789785116.506763:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549029376 00000100:00100000:2.0:1789785116.506772:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549029504 00000100:00100000:2.0:1789785116.506775:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549029504 00000100:00100000:2.0:1789785116.506787:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549029632 00000100:00100000:2.0:1789785116.506790:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549029632 00000100:00100000:2.0:1789785116.506799:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549029760 00000100:00100000:2.0:1789785116.506802:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549029760 00000100:00100000:2.0:1789785116.506816:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789785116.506848:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e00759f-51ad-47f9-8892-382c83919083+10:10347:x1876725549028864:12345-0@lo:104: 00010000:00010000:2.0:1789785116.506862:0:8466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c24a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785116.506934:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789785116.506941:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e00759f-51ad-47f9-8892-382c83919083+10:10347:x1876725549028864:12345-0@lo:104: Request processed in 97us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785116.506949:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789785116.506970:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789785116.506976:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e00759f-51ad-47f9-8892-382c83919083+9:10347:x1876725549028992:12345-0@lo:104: 00010000:00010000:2.0:1789785116.506984:0:8466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc2050000/0x2f18ee3fd845c219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c220 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785116.507018:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789785116.507023:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e00759f-51ad-47f9-8892-382c83919083+9:10347:x1876725549028992:12345-0@lo:104: Request processed in 48us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785116.507029:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789785116.507041:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789785116.507046:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83980700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e00759f-51ad-47f9-8892-382c83919083+8:10347:x1876725549029120:12345-0@lo:104: 00010000:00010000:2.0:1789785116.507054:0:8466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c1fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c204 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785116.507085:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789785116.507090:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83980700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e00759f-51ad-47f9-8892-382c83919083+8:10347:x1876725549029120:12345-0@lo:104: Request processed in 44us (1121us total) trans 0 rc 0/0 00010000:00010000:0.0:1789785116.507288:0:9538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789785116.507298:0:9538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c24a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.507316:0:9538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b08a00 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:0.0:1789785116.507321:0:9538:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c24a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.507331:0:9538:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c243 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c24a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789785116.507360:0:9538:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c243 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c24a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785116.507367:0:9538:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789785116.507407:0:9538:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c243 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c24a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.507414:0:9538:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789785116.507448:0:9538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c243 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c24a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.507457:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c243 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c24a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.507472:0:9538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789785116.507476:0:9538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc2050000/0x2f18ee3fd845c219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c220 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.507481:0:9538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc2050000 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:0.0:1789785116.507483:0:9538:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc2050000/0x2f18ee3fd845c219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c220 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.507501:0:9538:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc2050000/0x2f18ee3fd845c219 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c220 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789785116.507508:0:9538:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc2050000/0x2f18ee3fd845c219 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c220 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785116.507513:0:9538:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789785116.507528:0:9538:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc2050000/0x2f18ee3fd845c219 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c220 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.507534:0:9538:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789785116.507549:0:9538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc2050000/0x2f18ee3fd845c219 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c220 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.507557:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc2050000/0x2f18ee3fd845c219 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c220 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.507569:0:9538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789785116.507573:0:9538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c1fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c204 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.507579:0:9538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc2051600 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:0.0:1789785116.507582:0:9538:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c1fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c204 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.507588:0:9538:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c1fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c204 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789785116.507595:0:9538:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c1fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c204 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785116.507607:0:9538:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789785116.507620:0:9538:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c1fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c204 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.507639:0:9538:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789785116.507645:0:9538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c1fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c204 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.507652:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc2051600/0x2f18ee3fd845c1fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c204 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.507662:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785116.507664:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785116.507666:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785116.507768:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83a22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549030016:0@lo:103: 00000100:00100000:0.0:1789785116.507811:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785116.507873:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83a23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549030144:0@lo:103: 00000100:00100000:0.0:1789785116.507899:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785116.507923:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789785116.507930:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83a23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549030272:0@lo:103: 00000100:00100000:0.0:1789785116.507951:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789785116.508217:0:10347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dafc2050400/0x2f18ee3fd845c139 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c132 expref: 23 pid: 6528 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785116.508230:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83875180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1876725549029888:0@lo:104: 00000100:00100000:1.0:1789785116.508258:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785116.508280:0:10347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1ae3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789785116.508303:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1876725549028864:0@lo:104: 00000100:00100000:1.0:1789785116.508313:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1876725549028992:0@lo:104: 00000100:00100000:1.0:1789785116.508322:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1876725549029120:0@lo:104: 00000100:00100000:3.0:1789785116.509213:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549029888 00000100:00100000:3.0:1789785116.509224:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549029888 00000100:00100000:3.0:1789785116.509390:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789785116.509401:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae82508050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+9:10347:x1876725549029248:12345-0@lo:104: 00010000:00010000:3.0:1789785116.509428:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c1d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c1da expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785116.509544:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789785116.509569:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789785116.509586:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e00759f-51ad-47f9-8892-382c83919083+8:10347:x1876725549029376:12345-0@lo:104: 00010000:00010000:2.0:1789785116.509595:0:8466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c1b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c1be expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.510749:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789785116.510765:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae82508050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+8:10347:x1876725549029248:12345-0@lo:104: Request processed in 1362us (4717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785116.510777:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789785116.510838:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789785116.510848:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+7:10347:x1876725549029504:12345-0@lo:104: 00010000:00010000:3.0:1789785116.510861:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09600/0x2f18ee3fd845c1a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c1b0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.510906:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789785116.510912:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+7:10347:x1876725549029504:12345-0@lo:104: Request processed in 67us (4303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785116.510919:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789785116.510932:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789785116.510938:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+6:10347:x1876725549029632:12345-0@lo:104: 00010000:00010000:3.0:1789785116.510947:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c19b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c1a2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.510978:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789785116.510983:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+6:10347:x1876725549029632:12345-0@lo:104: Request processed in 46us (4363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785116.510989:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789785116.511001:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789785116.511007:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+5:10347:x1876725549029760:12345-0@lo:104: 00010000:00010000:3.0:1789785116.511027:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc21cbc00/0x2f18ee3fd845c15c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c163 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.511057:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789785116.511062:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+5:10347:x1876725549029760:12345-0@lo:104: Request processed in 55us (4430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785116.511069:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789785116.511082:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789785116.511089:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83876300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+4:10347:x1876725549029888:12345-0@lo:104: 00010000:00010000:3.0:1789785116.511112:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c139 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.511140:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789785116.511145:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83876300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+4:10347:x1876725549029888:12345-0@lo:104: Request processed in 58us (2887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785116.511151:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789785116.511437:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785116.511470:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00010000:00010000:0.0:1789785116.511489:0:9538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789785116.511498:0:9538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c1d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c1da expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.511507:0:9538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc21ca200 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:0.0:1789785116.511519:0:9538:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c1d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c1da expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.511530:0:9538:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c1d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c1da expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789785116.511538:0:9538:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c1d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c1da expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785116.511545:0:9538:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789785116.511592:0:9538:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c1d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c1da expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.511600:0:9538:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789785116.511621:0:9538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c1d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c1da expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.511629:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c1d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c1da expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.511651:0:9538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789785116.511655:0:9538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09600/0x2f18ee3fd845c1a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c1b0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.511661:0:9538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09600 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:0.0:1789785116.511664:0:9538:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09600/0x2f18ee3fd845c1a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c1b0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.511672:0:9538:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09600/0x2f18ee3fd845c1a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c1b0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789785116.511703:0:9538:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09600/0x2f18ee3fd845c1a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c1b0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785116.511717:0:9538:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789785116.511734:0:9538:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09600/0x2f18ee3fd845c1a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c1b0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.511740:0:9538:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789785116.511747:0:9538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09600/0x2f18ee3fd845c1a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c1b0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.511754:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09600/0x2f18ee3fd845c1a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c1b0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.511766:0:9538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789785116.511769:0:9538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c19b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c1a2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.511775:0:9538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eaca00 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:0.0:1789785116.511778:0:9538:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c19b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c1a2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.511785:0:9538:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c19b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c1a2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789785116.511792:0:9538:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c19b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c1a2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785116.511798:0:9538:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789785116.511819:0:9538:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c19b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c1a2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.511825:0:9538:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789785116.511840:0:9538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c19b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c1a2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.511847:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c19b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c1a2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.511857:0:9538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789785116.511860:0:9538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc21cbc00/0x2f18ee3fd845c15c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c163 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.511867:0:9538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc21cbc00 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:0.0:1789785116.511870:0:9538:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc21cbc00/0x2f18ee3fd845c15c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c163 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.511877:0:9538:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc21cbc00/0x2f18ee3fd845c15c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c163 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789785116.511884:0:9538:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc21cbc00/0x2f18ee3fd845c15c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c163 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785116.511890:0:9538:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789785116.511904:0:9538:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc21cbc00/0x2f18ee3fd845c15c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c163 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.511910:0:9538:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789785116.511915:0:9538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc21cbc00/0x2f18ee3fd845c15c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c163 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.511932:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc21cbc00/0x2f18ee3fd845c15c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c163 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.511944:0:9538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789785116.511947:0:9538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c139 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.511953:0:9538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09000 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:0.0:1789785116.511957:0:9538:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c139 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.511964:0:9538:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c132 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c139 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789785116.511971:0:9538:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c132 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c139 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785116.511976:0:9538:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789785116.511990:0:9538:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c132 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c139 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.511996:0:9538:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789785116.512001:0:9538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c132 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c139 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.512007:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c132 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c139 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.512017:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785116.512024:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785116.512026:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785116.512044:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb53aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549030784:0@lo:103: 00000100:00100000:0.0:1789785116.512103:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785116.512154:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789785116.512161:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb538a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549030656:0@lo:103: 00000100:00100000:0.0:1789785116.512182:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785116.512204:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb53ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549030400:0@lo:103: 00000100:00100000:0.0:1789785116.512229:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785116.512243:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb538e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549030912:0@lo:103: 00000100:00100000:0.0:1789785116.512264:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785116.512277:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789785116.512282:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549030528:0@lo:103: 00000100:00100000:0.0:1789785116.512301:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785116.513007:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549030016 00000100:00100000:3.0:1789785116.513018:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549030016 00010000:00010000:3.0:1789785116.513062:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc2050200/0x2f18ee3fd845c24a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c243 expref: 24 pid: 6528 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785116.513087:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549030144 00000100:00100000:3.0:1789785116.513101:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549030144 00010000:00010000:3.0:1789785116.513115:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845c220 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c219 expref: 25 pid: 6526 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785116.513127:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549030272 00000100:00100000:3.0:1789785116.513131:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549030272 00010000:00010000:3.0:1789785116.513146:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9daf829d3000/0x2f18ee3fd845c204 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c1fd expref: 26 pid: 6528 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785116.513171:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530104448 00000100:00100000:3.0:1789785116.513175:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530104448 00010000:00010000:3.0:1789785116.513190:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9daf829d3800/0x2f18ee3fd845c25f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd84e2 expref: 10 pid: 6527 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785116.513201:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530104576 00000100:00100000:3.0:1789785116.513204:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530104576 00010000:00010000:3.0:1789785116.513214:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc2050e00/0x2f18ee3fd845c258 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd84db expref: 11 pid: 6526 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785116.513224:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549030784 00000100:00100000:3.0:1789785116.513227:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549030784 00010000:00010000:3.0:1789785116.513240:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc21caa00/0x2f18ee3fd845c163 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c15c expref: 27 pid: 6526 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785116.513253:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549030656 00000100:00100000:3.0:1789785116.513256:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549030656 00010000:00010000:3.0:1789785116.513268:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc1b08400/0x2f18ee3fd845c1a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c19b expref: 28 pid: 6527 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785116.513280:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549030400 00000100:00100000:3.0:1789785116.513283:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549030400 00010000:00010000:3.0:1789785116.513292:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9daf829d2a00/0x2f18ee3fd845c1da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c1d3 expref: 29 pid: 6528 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785116.513301:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549030912 00000100:00100000:3.0:1789785116.513304:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549030912 00010000:00010000:3.0:1789785116.513313:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc2050400/0x2f18ee3fd845c139 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c132 expref: 30 pid: 6528 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785116.513322:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549030528 00000100:00100000:3.0:1789785116.513330:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549030528 00010000:00010000:3.0:1789785116.513372:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc1b08000/0x2f18ee3fd845c1b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c1a9 expref: 31 pid: 6528 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785116.513391:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789785116.513403:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+31:3662:x1876725549030016:12345-0@lo:103: 00010000:00010000:3.0:1789785116.513419:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785116.513437:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc2050200/0x2f18ee3fd845c24a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c243 expref: 31 pid: 6528 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.513450:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc2050200/0x2f18ee3fd845c24a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c243 expref: 31 pid: 6528 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.513470:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc2050200/0x2f18ee3fd845c24a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c243 expref: 31 pid: 6528 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.513489:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785116.513560:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+30:3662:x1876725549030016:12345-0@lo:103: Request processed in 160us (5748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785116.513568:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789785116.513621:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789785116.513627:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+29:3659:x1876725549030144:12345-0@lo:103: 00010000:00010000:3.0:1789785116.513634:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785116.513639:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845c220 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c219 expref: 29 pid: 6526 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.513648:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845c220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c219 expref: 29 pid: 6526 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.513658:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845c220 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c219 expref: 29 pid: 6526 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.513674:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785116.513961:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1876725549029248:0@lo:104: 00000100:00100000:3.0:1789785116.514011:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+28:3659:x1876725549030144:12345-0@lo:103: Request processed in 383us (6110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785116.514018:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789785116.514033:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789785116.514041:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb539c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+27:3659:x1876725549030272:12345-0@lo:103: 00010000:00010000:3.0:1789785116.514050:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785116.514055:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9daf829d3000/0x2f18ee3fd845c204 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c1fd expref: 27 pid: 6528 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.514064:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9daf829d3000/0x2f18ee3fd845c204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c1fd expref: 27 pid: 6528 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.514075:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9daf829d3000/0x2f18ee3fd845c204 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c1fd expref: 27 pid: 6528 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.514086:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785116.514121:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb539c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+26:3659:x1876725549030272:12345-0@lo:103: Request processed in 82us (6169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785116.514128:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789785116.514142:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 27 00000100:00100000:3.0:1789785116.514148:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb538700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dddf7d7-41ac-477b-b9db-b5e699635211+11:2397:x1876725530104448:12345-192.168.203.46@tcp:103: 00010000:00010000:3.0:1789785116.514158:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785116.514162:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9daf829d3800/0x2f18ee3fd845c25f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd84e2 expref: 11 pid: 6527 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.514174:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9daf829d3800/0x2f18ee3fd845c25f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd84e2 expref: 11 pid: 6527 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.514195:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785116.514248:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb538700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dddf7d7-41ac-477b-b9db-b5e699635211+11:2397:x1876725530104448:12345-192.168.203.46@tcp:103: Request processed in 99us (2824us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785116.514255:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 27 00000100:00100000:3.0:1789785116.514268:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 28 00000100:00100000:3.0:1789785116.514275:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb53bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2398:x1876725530104576:12345-192.168.203.46@tcp:103: 00010000:00010000:3.0:1789785116.514282:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785116.514287:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc2050e00/0x2f18ee3fd845c258 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd84db expref: 10 pid: 6526 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.514296:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc2050e00/0x2f18ee3fd845c258 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd84db expref: 10 pid: 6526 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.514307:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785116.514324:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb53bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2398:x1876725530104576:12345-192.168.203.46@tcp:103: Request processed in 50us (2854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785116.514331:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 28 00000100:00100000:3.0:1789785116.514366:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789785116.514372:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb539180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+25:3660:x1876725549030784:12345-0@lo:103: 00010000:00010000:3.0:1789785116.514380:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785116.514385:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc21caa00/0x2f18ee3fd845c163 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c15c expref: 25 pid: 6526 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.514394:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc21caa00/0x2f18ee3fd845c163 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c15c expref: 25 pid: 6526 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.514403:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785116.514557:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb539180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+25:3660:x1876725549030784:12345-0@lo:103: Request processed in 184us (2464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785116.514564:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789785116.514578:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789785116.514585:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb53a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+24:3660:x1876725549030656:12345-0@lo:103: 00010000:00010000:3.0:1789785116.514593:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785116.514598:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc1b08400/0x2f18ee3fd845c1a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c19b expref: 24 pid: 6527 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.514607:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc1b08400/0x2f18ee3fd845c1a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c19b expref: 24 pid: 6527 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.514617:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785116.514637:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb53a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+24:3660:x1876725549030656:12345-0@lo:103: Request processed in 54us (2454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785116.514643:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789785116.514655:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789785116.514661:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+23:3661:x1876725549030400:12345-0@lo:103: 00010000:00010000:3.0:1789785116.514668:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785116.514672:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9daf829d2a00/0x2f18ee3fd845c1da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c1d3 expref: 23 pid: 6528 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.514681:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9daf829d2a00/0x2f18ee3fd845c1da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c1d3 expref: 23 pid: 6528 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.514921:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9daf829d2a00/0x2f18ee3fd845c1da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c1d3 expref: 23 pid: 6528 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.514935:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785116.514974:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+22:3661:x1876725549030400:12345-0@lo:103: Request processed in 312us (2743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785116.514981:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789785116.515018:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789785116.515026:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb538000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+21:3661:x1876725549030912:12345-0@lo:103: 00010000:00010000:3.0:1789785116.515034:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785116.515039:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc2050400/0x2f18ee3fd845c139 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c132 expref: 21 pid: 6528 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.515046:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc2050400/0x2f18ee3fd845c139 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c132 expref: 21 pid: 6528 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.515056:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785116.515078:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb538000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+21:3661:x1876725549030912:12345-0@lo:103: Request processed in 53us (2813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785116.515083:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789785116.515167:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789785116.515174:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb53b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+20:3661:x1876725549030528:12345-0@lo:103: 00010000:00010000:3.0:1789785116.515182:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785116.515187:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc1b08000/0x2f18ee3fd845c1b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c1a9 expref: 20 pid: 6528 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.515195:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc1b08000/0x2f18ee3fd845c1b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c1a9 expref: 20 pid: 6528 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785116.515204:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785116.515226:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb53b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+20:3661:x1876725549030528:12345-0@lo:103: Request processed in 53us (2924us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785116.515232:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789785116.515763:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83a23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549030272:0@lo:103: 00000100:00100000:0.0:1789785116.515777:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83a23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549030144:0@lo:103: 00000100:00100000:0.0:1789785116.515821:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549030528:0@lo:103: 00000100:00100000:0.0:1789785116.515830:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb53ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549030400:0@lo:103: 00000100:00100000:0.0:1789785116.515838:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb538e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549030912:0@lo:103: 00000100:00100000:0.0:1789785116.515863:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83a22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549030016:0@lo:103: 00000100:00100000:0.0:1789785116.515885:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb538a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549030656:0@lo:103: 00000100:00100000:0.0:1789785116.515895:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb53aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549030784:0@lo:103: 00010000:00010000:2.0:1789785116.517286:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789785116.517301:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e00759f-51ad-47f9-8892-382c83919083+3:10347:x1876725549029376:12345-0@lo:104: Request processed in 7714us (10703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785116.517314:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1789785116.517392:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789785116.517402:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c1b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c1be expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785116.517413:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09800 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:2.0:1789785116.517418:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c1b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c1be expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785116.517504:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c1b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c1be expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789785116.517513:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c1b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c1be expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785116.517520:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789785116.517579:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c1b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c1be expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785116.517587:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789785116.517612:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c1b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c1be expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785116.517640:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c1b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c1be expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785116.517664:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785116.517666:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785116.517668:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785116.517677:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785116.517793:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785116.517854:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549031040:0@lo:103: 00000100:00100000:2.0:1789785116.517926:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785116.519136:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b39180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1876725549029376:0@lo:104: 00010000:00010000:1.0:1789785116.519366:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1b08000/0x2f18ee3fd845c1b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c1a9 expref: 19 pid: 6528 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785116.519387:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83877480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1876725549029504:0@lo:104: 00010000:00010000:1.0:1789785116.519402:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1b08400/0x2f18ee3fd845c1a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c19b expref: 18 pid: 6527 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785116.519411:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83875f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1876725549029632:0@lo:104: 00010000:00010000:1.0:1789785116.519421:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc21caa00/0x2f18ee3fd845c163 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c15c expref: 17 pid: 6526 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785116.519431:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83875c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1876725549029760:0@lo:104: 00010000:00010000:1.0:1789785116.519442:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc2050400/0x2f18ee3fd845c139 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c132 expref: 16 pid: 6528 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785116.519476:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83875180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1876725549029888:0@lo:104: 00010000:00010000:1.0:1789785116.519496:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9daf829d3800/0x2f18ee3fd845c25f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd84e2 expref: 9 pid: 6527 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785116.519508:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1876725549028608:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789785116.519518:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc2050e00/0x2f18ee3fd845c258 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd84db expref: 8 pid: 6526 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785116.519603:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1876725549028736:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789785116.519662:0:10347:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dafc1a64400/0x2f18ee3fd845c29e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785116.525947:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549031040 00000100:00100000:0.0:1789785116.525970:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549031040 00010000:00010000:1.0:1789785116.526130:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc21ca600/0x2f18ee3fd845c1be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c1b7 expref: 16 pid: 6526 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785116.526553:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789785116.526644:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+16:3662:x1876725549031040:12345-0@lo:103: 00010000:00010000:0.0:1789785116.526666:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785116.526674:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc21ca600/0x2f18ee3fd845c1be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c1b7 expref: 16 pid: 6526 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.526836:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc21ca600/0x2f18ee3fd845c1be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c1b7 expref: 16 pid: 6526 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.526863:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc21ca600/0x2f18ee3fd845c1be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c1b7 expref: 16 pid: 6526 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.526882:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dafc1a64400/0x2f18ee3fd845c29e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.526893:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1a64400/0x2f18ee3fd845c29e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.526917:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dafc1a64400/0x2f18ee3fd845c29e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.526925:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dafc1a64400/0x2f18ee3fd845c29e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.526933:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dafc1a64400/0x2f18ee3fd845c29e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.526941:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dafc1a64400/0x2f18ee3fd845c29e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.526947:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a64400 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:0.0:1789785116.526966:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dafc1a64400/0x2f18ee3fd845c29e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.526977:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dafc1a64400/0x2f18ee3fd845c29e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.527271:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dafc1a64400/0x2f18ee3fd845c29e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785116.527272:0:10347:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dafc1a64400/0x2f18ee3fd845c29e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785116.527294:0:10347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dafc1a64400/0x2f18ee3fd845c29e lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785116.527299:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789785116.527305:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1a64400/0x2f18ee3fd845c29e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785116.527806:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+15:3662:x1876725549031040:12345-0@lo:103: Request processed in 1238us (9876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785116.527818:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789785116.527900:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549031040:0@lo:103: 00010000:00010000:3.0:1789785116.676851:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785117.685126:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785117.685309:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785117.685313:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530104832 00000100:00100000:2.0:1789785117.685324:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530104832 00000100:00100000:2.0:1789785117.685450:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 59 00000100:00100000:2.0:1789785117.685462:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb53aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+6:2400:x1876725530104832:12345-192.168.203.46@tcp:400: 00000100:00100000:0.0:1789785117.685473:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785117.685502:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785117.685547:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb53aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+6:2400:x1876725530104832:12345-192.168.203.46@tcp:400: Request processed in 88us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785117.685555:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 59 00000100:00100000:2.0:1789785117.685573:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530104960 00000100:00100000:1.0:1789785117.685574:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530105088 00000100:00100000:2.0:1789785117.685577:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530104960 00000100:00100000:1.0:1789785117.685582:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530105088 00000100:00100000:2.0:1789785117.685605:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 60 00000100:00100000:2.0:1789785117.685614:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb538e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530104960:12345-192.168.203.46@tcp:400: 00000100:00100000:1.0:1789785117.685629:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:1.0:1789785117.685639:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb538a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530105088:12345-192.168.203.46@tcp:400: 00000100:00100000:3.0:1789785117.685827:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530104704 00000100:00100000:3.0:1789785117.685832:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530104704 00000100:00100000:3.0:1789785117.685858:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 199 00000100:00100000:3.0:1789785117.685865:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+8:2400:x1876725530104704:12345-192.168.203.46@tcp:400: 00000100:00100000:2.0:1789785117.686062:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb538e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530104960:12345-192.168.203.46@tcp:400: Request processed in 448us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785117.686069:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 60 00000100:00100000:0.0:1789785117.686075:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00080000:2.0:1789785117.686112:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789785117.686119:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789785117.686121:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789785117.686142:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530105216 00000100:00100000:2.0:1789785117.686147:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530105216 00000100:00100000:2.0:1789785117.686177:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 18 00000100:00100000:2.0:1789785117.686184:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb53ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530105216:12345-192.168.203.46@tcp:400: 00000100:00100000:2.0:1789785117.686226:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb53ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530105216:12345-192.168.203.46@tcp:400: Request processed in 42us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785117.686233:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 18 00000100:00080000:2.0:1789785117.686252:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789785117.689897:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb538a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530105088:12345-192.168.203.46@tcp:400: Request processed in 4240us (4570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785117.689913:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:3.0:1789785117.691473:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+8:2400:x1876725530104704:12345-192.168.203.46@tcp:400: Request processed in 5600us (5993us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785117.691494:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 199 00010000:00010000:2.0:1789785117.698607:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789785117.762824:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789785117.762834:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dae829a7000 from 48 10000000:01000000:3.0:1789785117.762840:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789785117.762909:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf829d3c00/0x2f18ee3fd845c2a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785117.762922:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9daf829d3c00/0x2f18ee3fd845c2a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785117.762933:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9daf829d3c00/0x2f18ee3fd845c2a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785117.762962:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf448380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549031168:0@lo:101: 00000100:00100000:3.0:1789785117.763805:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785117.763952:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789785117.768941:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549031168 00000100:00100000:0.0:1789785117.768962:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549031168 00000100:00100000:0.0:1789785117.769060:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789785117.769074:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+15:6531:x1876725549031168:12345-0@lo:101: 00010000:00010000:0.0:1789785117.769107:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785117.769142:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dae81eac000/0x2f18ee3fd845c2ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c2a5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.769190:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dae81eac000/0x2f18ee3fd845c2ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c2a5 expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.769206:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dae81eac000/0x2f18ee3fd845c2ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c2a5 expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.769241:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eac000, rc 0) 00000100:00100000:0.0:1789785117.769381:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+16:6531:x1876725549031168:12345-0@lo:101: Request processed in 310us (6297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785117.769389:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789785117.769752:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf448380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549031168:0@lo:101: 00010000:00010000:3.0:1789785117.769774:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9daf829d3c00/0x2f18ee3fd845c2a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c2ac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785117.769784:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9daf829d3c00/0x2f18ee3fd845c2a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c2ac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785117.769888:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf448380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549031296:0@lo:501: 00000100:00100000:3.0:1789785117.769927:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785117.769977:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789785117.770060:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549031296 00000100:00100000:1.0:1789785117.770066:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549031296 00000100:00100000:1.0:1789785117.775290:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789785117.775327:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+16:6531:x1876725549031296:12345-0@lo:501: 00000100:00100000:1.0:1789785117.775620:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+16:6531:x1876725549031296:12345-0@lo:501: Request processed in 313us (5691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785117.775630:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789785117.775786:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf448380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549031296:0@lo:501: 00000100:00100000:3.0:1789785117.775853:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf448380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549031424:0@lo:503: 00000100:00100000:3.0:1789785117.775923:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785117.780792:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789785117.797860:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549031424 00000100:00100000:2.0:1789785117.797884:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549031424 00000100:00100000:2.0:1789785117.798041:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789785117.798054:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+16:6531:x1876725549031424:12345-0@lo:503: 00000100:00100000:2.0:1789785117.798571:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+16:6531:x1876725549031424:12345-0@lo:503: Request processed in 518us (22645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785117.798581:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789785117.802836:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf448380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549031424:0@lo:503: 00000100:00100000:0.0:1789785117.808468:0:10364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb538380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10364:1876725549031552:0@lo:502: 00000100:00100000:3.0:1789785117.808812:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785117.808872:0:10364:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf92353180 going to sleep for 11 seconds 00000100:00100000:0.0:1789785117.810131:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549031552 00000100:00100000:0.0:1789785117.810146:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549031552 00000100:00100000:0.0:1789785117.810335:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789785117.810372:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+16:10364:x1876725549031552:12345-0@lo:502: 00000100:00100000:0.0:1789785117.810737:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+16:10364:x1876725549031552:12345-0@lo:502: Request processed in 367us (1925us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785117.810745:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789785117.815284:0:10364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb538380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10364:1876725549031552:0@lo:502: 00000100:00100000:3.0:1789785117.815568:0:10364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf448380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10364:1876725549031680:0@lo:502: 00000100:00100000:3.0:1789785117.815672:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785117.815736:0:10364:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6000 going to sleep for 11 seconds 00000100:00100000:0.0:1789785117.815849:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549031680 00000100:00100000:0.0:1789785117.815858:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549031680 00000100:00100000:0.0:1789785117.815931:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789785117.815941:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+16:10364:x1876725549031680:12345-0@lo:502: 00000100:00100000:0.0:1789785117.816278:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+16:10364:x1876725549031680:12345-0@lo:502: Request processed in 337us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785117.816287:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789785117.816395:0:10364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf448380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10364:1876725549031680:0@lo:502: 00000040:00080000:3.0:1789785117.816495:0:10364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789785117.816711:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789785117.816739:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789785117.816751:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf829d3c00/0x2f18ee3fd845c2a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c2ac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.816763:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9daf829d3c00/0x2f18ee3fd845c2a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c2ac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785117.816783:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789785117.816786:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1789785117.816789:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789785117.816820:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c2b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.816828:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c2b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.816838:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c2b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785117.816857:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549031808:0@lo:101: 00000100:00100000:0.0:1789785117.816894:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785117.816930:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf987f5000 going to sleep for 11 seconds 00000100:00100000:2.0:1789785117.816996:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549031808 00000100:00100000:2.0:1789785117.817002:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549031808 00000100:00100000:2.0:1789785117.817045:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789785117.817054:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+16:6531:x1876725549031808:12345-0@lo:101: 00010000:00010000:2.0:1789785117.817065:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785117.817080:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1b08c00/0x2f18ee3fd845c2ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c2b3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785117.817173:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1b08c00/0x2f18ee3fd845c2ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c2b3 expref: 17 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785117.817262:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1b08c00/0x2f18ee3fd845c2ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c2b3 expref: 17 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785117.817273:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b08c00, rc 0) 00000100:00100000:2.0:1789785117.817318:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725549031808:12345-0@lo:101: Request processed in 266us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785117.817324:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789785117.817618:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549031808:0@lo:101: 00010000:00010000:0.0:1789785117.817633:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c2b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c2ba expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.817644:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c2b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c2ba expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785117.817720:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549031936:0@lo:501: 00000100:00100000:0.0:1789785117.817748:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785117.817781:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf987f5000 going to sleep for 11 seconds 00000100:00100000:1.0:1789785117.817832:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549031936 00000100:00100000:1.0:1789785117.817838:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549031936 00000100:00100000:1.0:1789785117.817878:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789785117.817886:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725549031936:12345-0@lo:501: 00000100:00100000:1.0:1789785117.818041:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725549031936:12345-0@lo:501: Request processed in 155us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785117.818047:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789785117.818251:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549031936:0@lo:501: 00000100:00100000:3.0:1789785117.818289:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf448380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549032064:0@lo:503: 00000100:00100000:3.0:1789785117.818361:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785117.818392:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6000 going to sleep for 11 seconds 00000100:00100000:0.0:1789785117.818560:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549032064 00000100:00100000:0.0:1789785117.818565:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549032064 00000100:00100000:0.0:1789785117.818598:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789785117.818611:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725549032064:12345-0@lo:503: 00000100:00100000:0.0:1789785117.818924:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725549032064:12345-0@lo:503: Request processed in 312us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785117.818930:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789785117.819046:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf448380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549032064:0@lo:503: 00000100:00100000:0.0:1789785117.820899:0:10365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10365:1876725549032192:0@lo:502: 00000100:00100000:0.0:1789785117.820992:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785117.821093:0:10365:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf987f59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789785117.823261:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549032192 00000100:00100000:2.0:1789785117.823278:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549032192 00000100:00100000:3.0:1789785117.823763:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789785117.823795:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+17:10365:x1876725549032192:12345-0@lo:502: 00000100:00100000:3.0:1789785117.824029:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+17:10365:x1876725549032192:12345-0@lo:502: Request processed in 236us (3035us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785117.824037:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789785117.824151:0:10365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10365:1876725549032192:0@lo:502: 00000020:01000000:0.0:1789785117.824203:0:10365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789785117.824214:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785117.824217:0:10365:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789785117.824222:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789785117.824260:0:10365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10365:1876725549032320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789785117.824304:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785117.824818:0:10365:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf987f59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789785117.824886:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549032320 00000100:00100000:2.0:1789785117.824893:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549032320 00000100:00100000:2.0:1789785117.824928:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789785117.824936:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+17:10365:x1876725549032320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789785117.825052:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+17:10365:x1876725549032320:12345-0@lo:502:llog_process_th.0 Request processed in 116us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785117.825063:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789785117.825187:0:10365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10365:1876725549032320:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789785117.825212:0:10365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785117.825219:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785117.825220:0:10365:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789785117.825224:0:10365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1789785117.825688:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1789785117.825723:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789785117.825737:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c2b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c2ba expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785117.825751:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c2b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c2ba expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785117.825763:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789785117.825767:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dafb5cd8800 from 48 10000000:01000000:2.0:1789785117.825770:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789785117.825810:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09200/0x2f18ee3fd845c2c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785117.825829:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09200/0x2f18ee3fd845c2c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785117.825840:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09200/0x2f18ee3fd845c2c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785117.825863:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549032448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789785117.825903:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785117.825934:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb41e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785117.826014:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549032448 00000100:00100000:3.0:1789785117.826020:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549032448 00000100:00100000:3.0:1789785117.826054:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789785117.826063:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+17:6531:x1876725549032448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789785117.826074:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785117.826247:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9daf829d2a00/0x2f18ee3fd845c2c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c2c1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785117.826274:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9daf829d2a00/0x2f18ee3fd845c2c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c2c1 expref: 18 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785117.826287:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9daf829d2a00/0x2f18ee3fd845c2c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c2c1 expref: 18 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785117.826297:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf829d2a00, rc 0) 00000100:00100000:3.0:1789785117.826364:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+18:6531:x1876725549032448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 303us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785117.826371:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789785117.826583:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549032448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789785117.826600:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09200/0x2f18ee3fd845c2c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c2c8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785117.826611:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09200/0x2f18ee3fd845c2c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c2c8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785117.826678:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549032576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789785117.826728:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785117.826759:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb41e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789785117.826826:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549032576 00000100:00100000:0.0:1789785117.826831:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549032576 00000100:00100000:0.0:1789785117.826856:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789785117.826863:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+18:6531:x1876725549032576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789785117.827408:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+18:6531:x1876725549032576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 543us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785117.827425:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789785117.827947:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549032576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789785117.827998:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549032704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789785117.828053:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785117.828162:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549032704 00000100:00100000:3.0:1789785117.828168:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549032704 00000100:00100000:3.0:1789785117.828268:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789785117.828277:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+18:6531:x1876725549032704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789785117.828402:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+18:6531:x1876725549032704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785117.828622:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789785117.828702:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb41e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789785117.828717:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549032704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789785117.829147:0:10366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10366:1876725549032832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789785117.829257:0:10366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785117.829283:0:10366:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb41e180 going to sleep for 11 seconds 00000100:00100000:3.0:1789785117.829327:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549032832 00000100:00100000:3.0:1789785117.829333:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549032832 00000100:00100000:3.0:1789785117.829391:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789785117.829399:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+18:10366:x1876725549032832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789785117.829676:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+18:10366:x1876725549032832:12345-0@lo:502:llog_process_th.0 Request processed in 276us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785117.829683:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789785117.829766:0:10366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10366:1876725549032832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789785117.829808:0:10366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10366:1876725549032960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789785117.829837:0:10366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785117.829862:0:10366:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb41e180 going to sleep for 11 seconds 00000100:00100000:3.0:1789785117.829901:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549032960 00000100:00100000:3.0:1789785117.829905:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549032960 00000100:00100000:3.0:1789785117.829956:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789785117.829962:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+18:10366:x1876725549032960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789785117.830032:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+18:10366:x1876725549032960:12345-0@lo:502:llog_process_th.0 Request processed in 69us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785117.830039:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789785117.830277:0:10366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10366:1876725549032960:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789785117.830296:0:10366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789785117.830622:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789785117.830650:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789785117.830664:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09200/0x2f18ee3fd845c2c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c2c8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785117.830678:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09200/0x2f18ee3fd845c2c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c2c8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785117.830688:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789785117.830691:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1789785117.830712:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789785117.830744:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65e00/0x2f18ee3fd845c2cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785117.830752:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65e00/0x2f18ee3fd845c2cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785117.830761:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65e00/0x2f18ee3fd845c2cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785117.830777:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549033088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789785117.830813:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785117.830997:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1ae3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789785117.831062:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549033088 00000100:00100000:0.0:1789785117.831067:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549033088 00000100:00100000:0.0:1789785117.831106:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789785117.831115:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+18:6531:x1876725549033088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789785117.831126:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785117.831142:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845c2d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c2cf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.831169:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845c2d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c2cf expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.831299:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845c2d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c2cf expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.831309:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eadc00, rc 0) 00000100:00100000:0.0:1789785117.831367:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+19:6531:x1876725549033088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 253us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785117.831373:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789785117.831463:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549033088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789785117.831479:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65e00/0x2f18ee3fd845c2cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c2d6 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785117.831490:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65e00/0x2f18ee3fd845c2cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c2d6 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785117.831549:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549033216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789785117.831577:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785117.831604:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1ae3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789785117.832380:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549033216 00000100:00100000:0.0:1789785117.832388:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549033216 00000100:00100000:0.0:1789785117.832437:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789785117.832447:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+19:6531:x1876725549033216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789785117.832639:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+19:6531:x1876725549033216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 193us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785117.832647:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789785117.832919:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549033216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789785117.832966:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549033344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789785117.833020:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785117.833055:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1ae3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789785117.833172:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549033344 00000100:00100000:0.0:1789785117.833177:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549033344 00000100:00100000:0.0:1789785117.833273:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789785117.833278:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+19:6531:x1876725549033344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789785117.833574:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549033344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789785117.833646:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+19:6531:x1876725549033344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785117.833655:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789785117.834019:0:10367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10367:1876725549033472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789785117.834063:0:10367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785117.834262:0:10367:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae82a44b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789785117.834328:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549033472 00000100:00100000:2.0:1789785117.834334:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549033472 00000100:00100000:3.0:1789785117.834568:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789785117.834581:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+19:10367:x1876725549033472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789785117.834785:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+19:10367:x1876725549033472:12345-0@lo:502:llog_process_th.0 Request processed in 206us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785117.834791:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789785117.834925:0:10367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10367:1876725549033472:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789785117.835027:0:10367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789785117.835040:0:10367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785117.835043:0:10367:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789785117.835049:0:10367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789785117.835080:0:10367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83875180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10367:1876725549033600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789785117.835245:0:10367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785117.835301:0:10367:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1ae3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789785117.835588:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549033600 00000100:00100000:3.0:1789785117.835594:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549033600 00000100:00100000:3.0:1789785117.835661:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789785117.835670:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+19:10367:x1876725549033600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789785117.835773:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+19:10367:x1876725549033600:12345-0@lo:502:llog_process_th.0 Request processed in 105us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785117.835786:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789785117.835851:0:10367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83875180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10367:1876725549033600:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789785117.835873:0:10367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785117.835878:0:10367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785117.835880:0:10367:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789785117.835883:0:10367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1789785117.836077:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1789785117.836108:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789785117.836121:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65e00/0x2f18ee3fd845c2cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c2d6 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.836134:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65e00/0x2f18ee3fd845c2cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c2d6 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785117.836146:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789785117.836149:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dafc189c800 from 48 10000000:01000000:0.0:1789785117.836152:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789785117.836190:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c2dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.836198:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c2dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.836207:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c2dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785117.836222:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549033728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789785117.836260:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785117.836852:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789785117.836912:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549033728 00000100:00100000:2.0:1789785117.836918:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549033728 00000100:00100000:2.0:1789785117.836950:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789785117.836958:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+19:6531:x1876725549033728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789785117.836971:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785117.836986:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1b08600/0x2f18ee3fd845c2e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c2dd expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785117.837014:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1b08600/0x2f18ee3fd845c2e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c2dd expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785117.837028:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1b08600/0x2f18ee3fd845c2e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c2dd expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785117.837037:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b08600, rc 0) 00000100:00100000:0.0:1789785117.837169:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549033728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789785117.837247:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c2dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c2e4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.837258:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c2dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c2e4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785117.837328:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549033856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789785117.837377:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785117.837392:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789785117.837541:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+20:6531:x1876725549033728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 581us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785117.837565:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789785117.837592:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549033856 00000100:00100000:2.0:1789785117.837596:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549033856 00000100:00100000:2.0:1789785117.837610:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789785117.837614:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+20:6531:x1876725549033856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789785117.837759:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+20:6531:x1876725549033856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785117.837767:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789785117.837830:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549033856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789785117.837860:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549033984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789785117.837897:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785117.837916:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789785117.837950:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549033984 00000100:00100000:2.0:1789785117.837954:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549033984 00000100:00100000:2.0:1789785117.837970:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789785117.837975:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+20:6531:x1876725549033984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789785117.838060:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+20:6531:x1876725549033984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785117.838068:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789785117.838540:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549033984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789785117.838910:0:10368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10368:1876725549034112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789785117.838954:0:10368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785117.839017:0:10368:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb41e900 going to sleep for 11 seconds 00000100:00100000:1.0:1789785117.839096:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549034112 00000100:00100000:1.0:1789785117.839102:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549034112 00000100:00100000:3.0:1789785117.839302:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789785117.839314:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+20:10368:x1876725549034112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789785117.839741:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+20:10368:x1876725549034112:12345-0@lo:502:llog_process_th.0 Request processed in 428us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785117.839749:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789785117.839896:0:10368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10368:1876725549034112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789785117.839943:0:10368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10368:1876725549034240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789785117.839975:0:10368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785117.840027:0:10368:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb41e900 going to sleep for 11 seconds 00000100:00100000:3.0:1789785117.840054:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549034240 00000100:00100000:3.0:1789785117.840058:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549034240 00000100:00100000:3.0:1789785117.840169:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789785117.840177:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+20:10368:x1876725549034240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789785117.840321:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+20:10368:x1876725549034240:12345-0@lo:502:llog_process_th.0 Request processed in 144us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785117.840329:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789785117.840438:0:10368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10368:1876725549034240:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789785117.840472:0:10368:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789785117.840776:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789785117.840803:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789785117.840816:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c2dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c2e4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.840829:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c2dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c2e4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785117.840841:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789785117.840852:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1789785117.840855:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789785117.840886:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81ead000/0x2f18ee3fd845c2eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.840896:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dae81ead000/0x2f18ee3fd845c2eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.840906:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dae81ead000/0x2f18ee3fd845c2eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785117.840923:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549034368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789785117.840956:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785117.841410:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789785117.841671:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549034368 00000100:00100000:1.0:1789785117.841677:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549034368 00000100:00100000:1.0:1789785117.841728:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789785117.841736:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+20:6531:x1876725549034368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789785117.841748:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785117.841764:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1a64800/0x2f18ee3fd845c2f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c2eb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785117.841792:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1a64800/0x2f18ee3fd845c2f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c2eb expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785117.841805:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1a64800/0x2f18ee3fd845c2f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c2eb expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785117.841829:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64800, rc 0) 00000100:00100000:1.0:1789785117.841876:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549034368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785117.841883:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789785117.841988:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549034368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789785117.842003:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dae81ead000/0x2f18ee3fd845c2eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c2f2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.842014:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dae81ead000/0x2f18ee3fd845c2eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c2f2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785117.842080:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549034496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789785117.842117:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785117.842132:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789785117.842291:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549034496 00000100:00100000:3.0:1789785117.842296:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549034496 00000100:00100000:3.0:1789785117.842334:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789785117.842354:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549034496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789785117.842622:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549034496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 268us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785117.842629:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789785117.842712:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549034496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789785117.842739:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549034624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789785117.842778:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785117.842806:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789785117.842854:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549034624 00000100:00100000:3.0:1789785117.842859:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549034624 00000100:00100000:3.0:1789785117.842873:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789785117.842878:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549034624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789785117.842965:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549034624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785117.842978:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789785117.843049:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549034624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789785117.843581:0:10369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10369:1876725549034752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789785117.843613:0:10369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785117.843639:0:10369:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785117.843682:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549034752 00000100:00100000:3.0:1789785117.843686:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549034752 00000100:00100000:3.0:1789785117.843713:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789785117.843719:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+21:10369:x1876725549034752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789785117.843796:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+21:10369:x1876725549034752:12345-0@lo:502:llog_process_th.0 Request processed in 77us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785117.843803:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789785117.843930:0:10369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10369:1876725549034752:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789785117.843953:0:10369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789785117.843963:0:10369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785117.843965:0:10369:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789785117.843970:0:10369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789785117.843989:0:10369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10369:1876725549034880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789785117.844018:0:10369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785117.844028:0:10369:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785117.844073:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549034880 00000100:00100000:3.0:1789785117.844076:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549034880 00000100:00100000:3.0:1789785117.844161:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789785117.844167:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+21:10369:x1876725549034880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789785117.844290:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+21:10369:x1876725549034880:12345-0@lo:502:llog_process_th.0 Request processed in 122us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785117.844297:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789785117.844368:0:10369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10369:1876725549034880:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789785117.844384:0:10369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785117.844388:0:10369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785117.844390:0:10369:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789785117.844393:0:10369:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1789785117.844749:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1789785117.844773:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789785117.844785:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81ead000/0x2f18ee3fd845c2eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c2f2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785117.844797:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dae81ead000/0x2f18ee3fd845c2eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c2f2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785117.844809:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789785117.844812:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9daf89061800 from 48 10000000:01000000:3.0:1789785117.844816:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789785117.844845:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf829d3000/0x2f18ee3fd845c2f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785117.844861:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9daf829d3000/0x2f18ee3fd845c2f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785117.844872:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9daf829d3000/0x2f18ee3fd845c2f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785117.844887:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf448380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549035008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789785117.844919:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785117.844951:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789785117.845000:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549035008 00000100:00100000:0.0:1789785117.845005:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549035008 00000100:00100000:0.0:1789785117.845037:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789785117.845045:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549035008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789785117.845055:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785117.845070:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dae81eade00/0x2f18ee3fd845c300 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c2f9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.845243:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dae81eade00/0x2f18ee3fd845c300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c2f9 expref: 22 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.845271:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dae81eade00/0x2f18ee3fd845c300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c2f9 expref: 22 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.845281:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eade00, rc 0) 00000100:00100000:0.0:1789785117.845322:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549035008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 278us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785117.845328:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789785117.845611:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf448380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549035008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789785117.845625:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9daf829d3000/0x2f18ee3fd845c2f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c300 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785117.845635:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9daf829d3000/0x2f18ee3fd845c2f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c300 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785117.845690:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf448380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549035136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789785117.845730:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785117.845757:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789785117.845796:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549035136 00000100:00100000:2.0:1789785117.845801:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549035136 00000100:00100000:2.0:1789785117.845833:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789785117.845840:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549035136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789785117.845956:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549035136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785117.845963:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789785117.846023:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf448380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549035136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789785117.846051:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf448380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549035264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789785117.846150:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785117.846170:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789785117.846282:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549035264 00000100:00100000:0.0:1789785117.846286:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549035264 00000100:00100000:0.0:1789785117.846302:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789785117.846307:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549035264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789785117.846598:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549035264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 289us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785117.846604:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789785117.846673:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf448380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549035264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789785117.847278:0:10370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf448380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10370:1876725549035392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789785117.847324:0:10370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785117.847537:0:10370:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789785117.847607:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549035392 00000100:00100000:2.0:1789785117.847613:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549035392 00000100:00100000:2.0:1789785117.848749:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789785117.848769:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+22:10370:x1876725549035392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789785117.848953:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+22:10370:x1876725549035392:12345-0@lo:502:llog_process_th.0 Request processed in 193us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785117.848961:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789785117.849077:0:10370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf448380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10370:1876725549035392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789785117.849163:0:10370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf448380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10370:1876725549035520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789785117.849300:0:10370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785117.849601:0:10370:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789785117.849747:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549035520 00000100:00100000:0.0:1789785117.849755:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549035520 00000100:00100000:0.0:1789785117.849789:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789785117.849796:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+22:10370:x1876725549035520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789785117.849898:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+22:10370:x1876725549035520:12345-0@lo:502:llog_process_th.0 Request processed in 101us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785117.849904:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789785117.849992:0:10370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf448380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10370:1876725549035520:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789785117.850018:0:10370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789785117.850321:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789785117.850374:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789785117.850386:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf829d3000/0x2f18ee3fd845c2f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c300 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.850529:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9daf829d3000/0x2f18ee3fd845c2f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c300 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785117.850543:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789785117.850546:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1789785117.850550:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789785117.850584:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eac200/0x2f18ee3fd845c307 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.850593:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dae81eac200/0x2f18ee3fd845c307 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.850604:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dae81eac200/0x2f18ee3fd845c307 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785117.850625:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549035648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789785117.850663:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785117.850692:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab2000 going to sleep for 11 seconds 00000100:00100000:3.0:1789785117.850740:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549035648 00000100:00100000:3.0:1789785117.850745:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549035648 00000100:00100000:3.0:1789785117.850769:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789785117.850775:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549035648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789785117.850785:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785117.850798:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9daf829d2400/0x2f18ee3fd845c30e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c307 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785117.850823:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9daf829d2400/0x2f18ee3fd845c30e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c307 expref: 23 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785117.850834:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9daf829d2400/0x2f18ee3fd845c30e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c307 expref: 23 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785117.850842:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf829d2400, rc 0) 00000100:00100000:3.0:1789785117.850878:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549035648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785117.850884:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789785117.850952:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549035648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789785117.850965:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dae81eac200/0x2f18ee3fd845c307 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c30e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.850974:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dae81eac200/0x2f18ee3fd845c307 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c30e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785117.851034:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549035776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789785117.851061:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785117.851155:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549035776 00000100:00100000:3.0:1789785117.851159:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549035776 00000100:00100000:3.0:1789785117.851176:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789785117.851245:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549035776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789785117.851516:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab2000 going to sleep for 11 seconds 00000100:00100000:3.0:1789785117.851775:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549035776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 531us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785117.851783:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789785117.851829:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549035776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789785117.851861:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549035904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789785117.851900:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785117.851951:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab2000 going to sleep for 11 seconds 00000100:00100000:1.0:1789785117.851978:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549035904 00000100:00100000:1.0:1789785117.851984:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549035904 00000100:00100000:1.0:1789785117.852045:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789785117.852053:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549035904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789785117.852163:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549035904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785117.852170:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789785117.852311:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549035904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789785117.853058:0:10371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10371:1876725549036032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789785117.853179:0:10371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785117.854745:0:10371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb41e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785117.854898:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549036032 00000100:00100000:3.0:1789785117.854909:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549036032 00000100:00100000:3.0:1789785117.855323:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789785117.855334:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+23:10371:x1876725549036032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789785117.856001:0:10371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10371:1876725549036032:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789785117.856066:0:10371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789785117.856080:0:10371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785117.856083:0:10371:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789785117.856090:0:10371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789785117.856141:0:10371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10371:1876725549036160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789785117.856218:0:10371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785117.857461:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+23:10371:x1876725549036032:12345-0@lo:502:llog_process_th.0 Request processed in 2122us (4275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785117.857476:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789785117.858688:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549036160 00000100:00100000:0.0:1789785117.858707:0:10371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab2000 going to sleep for 11 seconds 00000100:00100000:3.0:1789785117.858708:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549036160 00000100:00100000:3.0:1789785117.858861:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789785117.858873:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+23:10371:x1876725549036160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789785117.859085:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+23:10371:x1876725549036160:12345-0@lo:502:llog_process_th.0 Request processed in 214us (2866us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785117.859093:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789785117.859217:0:10371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10371:1876725549036160:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789785117.859250:0:10371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789785117.859257:0:10371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785117.859260:0:10371:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789785117.859263:0:10371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1789785117.859619:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1789785117.859645:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789785117.859655:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eac200/0x2f18ee3fd845c307 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c30e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.859667:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dae81eac200/0x2f18ee3fd845c307 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c30e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785117.859677:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789785117.859680:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9daf983fcd28 from 1 10000000:01000000:0.0:1789785117.859683:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789785117.859720:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81ead200/0x2f18ee3fd845c315 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.859736:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dae81ead200/0x2f18ee3fd845c315 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.859746:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dae81ead200/0x2f18ee3fd845c315 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785117.859765:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549036288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789785117.859803:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785117.859835:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab2240 going to sleep for 11 seconds 00000100:00100000:1.0:1789785117.860310:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549036288 00000100:00100000:1.0:1789785117.860323:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549036288 00000100:00100000:1.0:1789785117.860406:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789785117.860485:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549036288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789785117.860504:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785117.860526:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1a65600/0x2f18ee3fd845c31c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c315 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785117.860560:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1a65600/0x2f18ee3fd845c31c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c315 expref: 24 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785117.860572:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1a65600/0x2f18ee3fd845c31c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c315 expref: 24 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785117.860582:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a65600, rc 0) 00000100:00100000:1.0:1789785117.860744:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:6531:x1876725549036288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 328us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785117.860751:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789785117.862739:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549036288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789785117.862778:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dae81ead200/0x2f18ee3fd845c315 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c31c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.862794:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dae81ead200/0x2f18ee3fd845c315 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c31c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785117.862908:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549036416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789785117.862980:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785117.863034:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab2240 going to sleep for 11 seconds 00000100:00100000:1.0:1789785117.863122:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549036416 00000100:00100000:1.0:1789785117.863130:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549036416 00000100:00100000:1.0:1789785117.863192:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789785117.863205:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:6531:x1876725549036416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789785117.863321:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:6531:x1876725549036416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (341us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789785117.863329:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789785117.864108:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549036416:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789785117.864156:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789785117.864167:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81ead200/0x2f18ee3fd845c315 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c31c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785117.864178:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dae81ead200/0x2f18ee3fd845c315 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c31c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785117.934950:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785117.935622:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530105344 00000100:00100000:1.0:1789785117.935638:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530105344 00000100:00100000:1.0:1789785117.935721:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 242 00000100:00100000:1.0:1789785117.935733:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+8:6169:x1876725530105344:12345-192.168.203.46@tcp:101: 00010000:00010000:1.0:1789785117.935755:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785117.935778:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1a64e00/0x2f18ee3fd845c323 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8552 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785117.935813:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1a64e00/0x2f18ee3fd845c323 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8552 expref: 9 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785117.935826:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1a64e00/0x2f18ee3fd845c323 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8552 expref: 9 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785117.935837:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64e00, rc 0) 00000100:00100000:1.0:1789785117.935918:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+9:6169:x1876725530105344:12345-192.168.203.46@tcp:101: Request processed in 187us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785117.935925:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 242 00000100:00100000:2.0:1789785117.944665:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785117.945281:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530105472 00000100:00100000:1.0:1789785117.945296:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530105472 00000100:00100000:1.0:1789785117.945640:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 243 00000100:00100000:1.0:1789785117.945653:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+9:6169:x1876725530105472:12345-192.168.203.46@tcp:501: 00000100:00100000:1.0:1789785117.945878:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+9:6169:x1876725530105472:12345-192.168.203.46@tcp:501: Request processed in 227us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785117.945887:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 243 00000100:00100000:2.0:1789785117.955049:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785117.955256:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530105600 00000100:00100000:3.0:1789785117.955269:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530105600 00000100:00100000:3.0:1789785117.955378:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 244 00000100:00100000:3.0:1789785117.955391:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+9:6169:x1876725530105600:12345-192.168.203.46@tcp:503: 00000100:00100000:3.0:1789785117.955815:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+9:6169:x1876725530105600:12345-192.168.203.46@tcp:503: Request processed in 426us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785117.955831:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 244 00000100:00100000:2.0:1789785117.973637:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785117.973811:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530105728 00000100:00100000:1.0:1789785117.973824:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530105728 00000100:00100000:1.0:1789785117.973896:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 245 00000100:00100000:1.0:1789785117.973980:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+9:6652:x1876725530105728:12345-192.168.203.46@tcp:502: 00000100:00100000:1.0:1789785117.974426:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+9:6652:x1876725530105728:12345-192.168.203.46@tcp:502: Request processed in 444us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785117.978933:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 245 00000100:00100000:2.0:1789785117.989576:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785117.990020:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530105856 00000100:00100000:3.0:1789785117.990035:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530105856 00000100:00100000:3.0:1789785117.990111:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 246 00000100:00100000:3.0:1789785117.990122:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+9:6652:x1876725530105856:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789785117.990326:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+9:6652:x1876725530105856:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 204us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785117.990387:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 246 00000100:00100000:2.0:1789785117.996214:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785117.996321:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530105984 00000100:00100000:1.0:1789785117.996334:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530105984 00000100:00100000:1.0:1789785117.996446:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 247 00000100:00100000:1.0:1789785117.996458:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+9:6169:x1876725530105984:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789785117.996480:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785117.996502:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1a65a00/0x2f18ee3fd845c32a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8559 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785117.996537:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1a65a00/0x2f18ee3fd845c32a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8559 expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785117.996550:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1a65a00/0x2f18ee3fd845c32a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8559 expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785117.996585:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a65a00, rc 0) 00000100:00100000:1.0:1789785117.996813:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+10:6169:x1876725530105984:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 Request processed in 356us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785117.996822:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 247 00000100:00100000:2.0:1789785118.003448:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785118.003627:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530106112 00000100:00100000:0.0:1789785118.003641:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530106112 00000100:00100000:0.0:1789785118.003721:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 248 00000100:00100000:0.0:1789785118.003733:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+10:6169:x1876725530106112:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789785118.003871:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+10:6169:x1876725530106112:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 Request processed in 140us (436us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789785118.003879:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 248 00000100:00100000:0.0:1789785118.019248:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549036544:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789785118.019381:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785118.019835:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549036672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789785118.019875:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785118.019950:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549036672 00000100:00100000:0.0:1789785118.019960:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549036672 00000100:00100000:0.0:1789785118.020017:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789785118.020027:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549036672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789785118.020070:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789785118.020132:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549036672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785118.020140:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789785118.020617:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789785118.020630:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549036800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789785118.020669:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785118.020719:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549036544 00000100:00100000:2.0:1789785118.020724:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549036544 00000100:00100000:2.0:1789785118.020760:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549036800 00000100:00100000:2.0:1789785118.020763:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549036800 00000100:00100000:2.0:1789785118.020781:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789785118.020789:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb539500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549036544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789785118.020813:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785118.020854:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb539500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549036544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (1483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785118.020861:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789785118.020874:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789785118.020880:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549036800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789785118.020890:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785118.020915:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549036800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785118.020920:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1789785118.020936:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789785118.020967:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3d3b80 x1876725549036800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785134 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785118.020988:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549036800:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1789785118.021021:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83875180 x1876725549036544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785134 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785118.021035:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549036544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789785118.029286:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549036672:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789785118.728019:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785119.746491:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789785119.769474:0:10409:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdee32ee60 20000000:00000080:3.0:1789785119.769499:0:10409:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dafb5d8d400 uarg=0000000000000000 20000000:01000000:3.0:1789785119.769552:0:10409:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789785119.769559:0:10409:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789785119.769564:0:10409:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789785119.775251:0:10410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789785119.775798:0:10409:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1789785119.786766:0:10409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1789785119.786812:0:10409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1789785119.786829:0:10409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1789785119.786851:0:10409:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789785119.786877:0:10409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dae81ead600/0x2f18ee3fd845c331 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785119.786919:0:10409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9daf80031a00/0x2f18ee3fd845bfcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bfc6 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785119.786928:0:10409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc1b08800/0x2f18ee3fd845bfdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845bfd4 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785119.786936:0:10409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc1b08200/0x2f18ee3fd845c02f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c028 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785119.786943:0:10409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc1b09c00/0x2f18ee3fd845c155 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c14e expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785119.786954:0:10409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc2051a00/0x2f18ee3fd845c26d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd851a expref: 9 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785119.786963:0:10409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dae81ead600/0x2f18ee3fd845c331 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785119.787014:0:10409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc2051a00/0x2f18ee3fd845c26d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd851a expref: 9 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785119.787034:0:10409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dafc2051a00/0x2f18ee3fd845c26d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd851a expref: 9 pid: 6528 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785119.787051:0:10409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10409:1876725549036928:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789785119.787194:0:10409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc1b09c00/0x2f18ee3fd845c155 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c14e expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785119.787204:0:10409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dafc1b09c00/0x2f18ee3fd845c155 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c14e expref: 23 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785119.787222:0:10409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb538380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10409:1876725549037056:0@lo:104: 00000100:00100000:0.0:1789785119.787272:0:10409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789785119.787317:0:10409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc1b08200/0x2f18ee3fd845c02f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c028 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785119.787325:0:10409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dafc1b08200/0x2f18ee3fd845c02f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c028 expref: 23 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785119.787333:0:10409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb538700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10409:1876725549037184:0@lo:104: 00000100:00100000:0.0:1789785119.787398:0:10409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789785119.787433:0:10409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc1b08800/0x2f18ee3fd845bfdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845bfd4 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785119.787441:0:10409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dafc1b08800/0x2f18ee3fd845bfdb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845bfd4 expref: 23 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785119.787450:0:10409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb53bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10409:1876725549037312:0@lo:104: 00010000:00010000:0.0:1789785119.787474:0:10409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9daf80031a00/0x2f18ee3fd845bfcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845bfc6 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785119.787482:0:10409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9daf80031a00/0x2f18ee3fd845bfcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845bfc6 expref: 23 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785119.787490:0:10409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10409:1876725549037440:0@lo:104: 00000100:00100000:0.0:1789785119.787508:0:10409:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8280a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785119.787618:0:6517:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789785119.787640:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785119.787668:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785119.787678:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549037056 00000100:00100000:3.0:1789785119.787696:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549037056 00000100:00100000:3.0:1789785119.787743:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549037184 00000100:00100000:3.0:1789785119.787746:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549037184 00000100:00100000:3.0:1789785119.787755:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549037312 00000100:00100000:3.0:1789785119.787757:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549037312 00000100:00100000:3.0:1789785119.787766:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549037440 00000100:00100000:3.0:1789785119.787776:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549037440 00000100:00100000:3.0:1789785119.787796:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789785119.787806:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb539c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+6:10409:x1876725549037056:12345-0@lo:104: 00010000:00010000:3.0:1789785119.787821:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dae81ead400/0x2f18ee3fd845c14e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c155 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.787879:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789785119.787886:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb539c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+6:10409:x1876725549037056:12345-0@lo:104: Request processed in 81us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785119.787894:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789785119.787913:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789785119.787918:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb536850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+5:10409:x1876725549037184:12345-0@lo:104: 00010000:00010000:3.0:1789785119.787926:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dae81eac400/0x2f18ee3fd845c028 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c02f expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.787959:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789785119.787964:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb536850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+5:10409:x1876725549037184:12345-0@lo:104: Request processed in 47us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785119.787971:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789785119.788007:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789785119.788013:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf44b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+4:10409:x1876725549037312:12345-0@lo:104: 00010000:00010000:3.0:1789785119.788021:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9daf80030e00/0x2f18ee3fd845bfd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845bfdb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.788050:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789785119.788055:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf44b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+4:10409:x1876725549037312:12345-0@lo:104: Request processed in 43us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785119.788061:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789785119.788080:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789785119.788086:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf448e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+3:10409:x1876725549037440:12345-0@lo:104: 00010000:00010000:3.0:1789785119.788094:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb800/0x2f18ee3fd845bfc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845bfcd expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.788122:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789785119.788127:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf448e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+3:10409:x1876725549037440:12345-0@lo:104: Request processed in 42us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785119.788133:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1789785119.788151:0:9538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789785119.788158:0:9538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dae81ead400/0x2f18ee3fd845c14e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c155 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.788165:0:9538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81ead400 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:3.0:1789785119.788170:0:9538:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dae81ead400/0x2f18ee3fd845c14e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c155 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.788178:0:9538:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dae81ead400/0x2f18ee3fd845c14e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c155 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789785119.788187:0:9538:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dae81ead400/0x2f18ee3fd845c14e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c155 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785119.788193:0:9538:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789785119.788224:0:9538:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dae81ead400/0x2f18ee3fd845c14e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c155 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.788231:0:9538:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789785119.788253:0:9538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dae81ead400/0x2f18ee3fd845c14e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c155 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.788270:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dae81ead400/0x2f18ee3fd845c14e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c155 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.788287:0:9538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789785119.788291:0:9538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dae81eac400/0x2f18ee3fd845c028 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c02f expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.788297:0:9538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eac400 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:3.0:1789785119.788300:0:9538:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dae81eac400/0x2f18ee3fd845c028 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c02f expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.788307:0:9538:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dae81eac400/0x2f18ee3fd845c028 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c02f expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789785119.788314:0:9538:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dae81eac400/0x2f18ee3fd845c028 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c02f expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785119.788319:0:9538:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789785119.788332:0:9538:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dae81eac400/0x2f18ee3fd845c028 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c02f expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.788371:0:9538:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789785119.788386:0:9538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dae81eac400/0x2f18ee3fd845c028 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c02f expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.788393:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dae81eac400/0x2f18ee3fd845c028 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c02f expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.788403:0:9538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789785119.788412:0:9538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9daf80030e00/0x2f18ee3fd845bfd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845bfdb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.788419:0:9538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf80030e00 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:3.0:1789785119.788421:0:9538:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9daf80030e00/0x2f18ee3fd845bfd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845bfdb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.788428:0:9538:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9daf80030e00/0x2f18ee3fd845bfd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845bfdb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789785119.788433:0:9538:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9daf80030e00/0x2f18ee3fd845bfd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845bfdb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785119.788438:0:9538:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789785119.788453:0:9538:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9daf80030e00/0x2f18ee3fd845bfd4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bfdb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.788459:0:9538:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789785119.788465:0:9538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9daf80030e00/0x2f18ee3fd845bfd4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bfdb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.788472:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9daf80030e00/0x2f18ee3fd845bfd4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bfdb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.788482:0:9538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789785119.788485:0:9538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb800/0x2f18ee3fd845bfc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845bfcd expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.788491:0:9538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc21cb800 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:3.0:1789785119.788494:0:9538:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb800/0x2f18ee3fd845bfc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845bfcd expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.788510:0:9538:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb800/0x2f18ee3fd845bfc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845bfcd expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789785119.788517:0:9538:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb800/0x2f18ee3fd845bfc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845bfcd expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785119.788522:0:9538:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789785119.788534:0:9538:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb800/0x2f18ee3fd845bfc6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bfcd expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.788540:0:9538:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789785119.788547:0:9538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb800/0x2f18ee3fd845bfc6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bfcd expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.788553:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb800/0x2f18ee3fd845bfc6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845bfcd expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785119.788695:0:10409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb538380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10409:1876725549037056:0@lo:104: 00000100:00100000:0.0:1789785119.788708:0:10409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb538700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10409:1876725549037184:0@lo:104: 00000100:00100000:0.0:1789785119.788724:0:10409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb53bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10409:1876725549037312:0@lo:104: 00000100:00100000:0.0:1789785119.788731:0:10409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10409:1876725549037440:0@lo:104: 00010000:00010000:3.0:1789785119.789121:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785119.789124:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785119.789126:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785119.789144:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf44b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549037952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789785119.789197:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785119.789248:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789785119.789255:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549037568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789785119.789276:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785119.789312:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf44b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549037824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789785119.789335:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785119.789414:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789785119.789431:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549037696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789785119.789456:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785119.789485:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549037952 00000100:00100000:3.0:1789785119.789492:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549037952 00010000:00010000:3.0:1789785119.789523:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9daf80031a00/0x2f18ee3fd845bfcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845bfc6 expref: 24 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785119.789542:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549037568 00000100:00100000:3.0:1789785119.789545:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549037568 00010000:00010000:3.0:1789785119.789556:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc1b09c00/0x2f18ee3fd845c155 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c14e expref: 25 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785119.789566:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549037824 00000100:00100000:3.0:1789785119.789568:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549037824 00010000:00010000:3.0:1789785119.789577:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc1b08800/0x2f18ee3fd845bfdb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845bfd4 expref: 26 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785119.789586:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549037696 00000100:00100000:3.0:1789785119.789588:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549037696 00010000:00010000:3.0:1789785119.789597:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc1b08200/0x2f18ee3fd845c02f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c028 expref: 27 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785119.789610:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789785119.789617:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf448700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+27:3661:x1876725549037952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789785119.789629:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785119.789635:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9daf80031a00/0x2f18ee3fd845bfcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845bfc6 expref: 27 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.789646:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9daf80031a00/0x2f18ee3fd845bfcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845bfc6 expref: 27 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.789674:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9daf80031a00/0x2f18ee3fd845bfcd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845bfc6 expref: 27 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.789702:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785119.789737:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf448700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+26:3661:x1876725549037952:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785119.789745:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789785119.789762:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789785119.789768:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+25:3661:x1876725549037568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789785119.789776:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785119.789780:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc1b09c00/0x2f18ee3fd845c155 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c14e expref: 25 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.789787:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc1b09c00/0x2f18ee3fd845c155 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c14e expref: 25 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.789797:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1b09c00/0x2f18ee3fd845c155 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c14e expref: 25 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.789805:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785119.789827:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+24:3661:x1876725549037568:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785119.789833:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789785119.789845:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789785119.789852:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+23:3660:x1876725549037824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789785119.789860:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785119.789864:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc1b08800/0x2f18ee3fd845bfdb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845bfd4 expref: 23 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.789880:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc1b08800/0x2f18ee3fd845bfdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845bfd4 expref: 23 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.789891:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1b08800/0x2f18ee3fd845bfdb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845bfd4 expref: 23 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.789900:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785119.789926:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+22:3660:x1876725549037824:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785119.789933:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789785119.789945:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789785119.789951:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9e9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+21:3660:x1876725549037696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789785119.789959:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785119.789963:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc1b08200/0x2f18ee3fd845c02f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c028 expref: 21 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.789972:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc1b08200/0x2f18ee3fd845c02f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c028 expref: 21 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.789982:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1b08200/0x2f18ee3fd845c02f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c028 expref: 21 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.789991:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785119.790012:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9e9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+20:3660:x1876725549037696:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785119.790018:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789785119.790077:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549037696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789785119.790087:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf44b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549037824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789785119.790127:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549037568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789785119.790135:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf44b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549037952:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789785119.790397:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785119.790413:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785119.795656:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785119.795791:0:10409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10409:1876725549036928:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789785119.795842:0:10409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dae81ead600/0x2f18ee3fd845c331 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785119.799008:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530106240 00000100:00100000:3.0:1789785119.799028:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530106240 00010000:00010000:3.0:1789785119.799091:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc2051a00/0x2f18ee3fd845c26d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd851a expref: 10 pid: 6528 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785119.799137:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 39 00000100:00100000:3.0:1789785119.799148:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2397:x1876725530106240:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789785119.799167:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785119.799173:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc2051a00/0x2f18ee3fd845c26d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd851a expref: 10 pid: 6528 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.799187:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc2051a00/0x2f18ee3fd845c26d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd851a expref: 10 pid: 6528 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.799209:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc2051a00/0x2f18ee3fd845c26d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd851a expref: 10 pid: 6528 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.799227:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dae81ead600/0x2f18ee3fd845c331 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.799236:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dae81ead600/0x2f18ee3fd845c331 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.799255:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dae81ead600/0x2f18ee3fd845c331 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.799263:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dae81ead600/0x2f18ee3fd845c331 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.799289:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dae81ead600/0x2f18ee3fd845c331 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.799297:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dae81ead600/0x2f18ee3fd845c331 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.799303:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81ead600 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:3.0:1789785119.799308:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dae81ead600/0x2f18ee3fd845c331 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.799317:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dae81ead600/0x2f18ee3fd845c331 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.799387:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dae81ead600/0x2f18ee3fd845c331 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785119.799400:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785119.799473:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dddf7d7-41ac-477b-b9db-b5e699635211+9:2397:x1876725530106240:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 325us (3831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785119.799481:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 39 00010000:00010000:1.0:1789785119.799573:0:10409:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dae81ead600/0x2f18ee3fd845c331 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785119.799582:0:10409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dae81ead600/0x2f18ee3fd845c331 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785119.799589:0:10409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dae81ead600/0x2f18ee3fd845c331 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785120.771297:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789785120.898725:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789785120.898735:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dae829a7000 from 4 10000000:01000000:1.0:1789785120.898743:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789785120.898819:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845c338 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785120.898832:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845c338 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785120.898844:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845c338 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785120.898879:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83875f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549038080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789785120.898980:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785120.904604:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549038080 00000100:00100000:0.0:1789785120.904627:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549038080 00000100:00100000:0.0:1789785120.904748:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789785120.904769:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+20:6531:x1876725549038080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789785120.904792:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785120.904819:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dae81eac400/0x2f18ee3fd845c33f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c338 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785120.904855:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dae81eac400/0x2f18ee3fd845c33f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c338 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785120.904867:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dae81eac400/0x2f18ee3fd845c33f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c338 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785120.904878:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eac400, rc 0) 00000100:00100000:0.0:1789785120.904992:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549038080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 233us (6012us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785120.905000:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789785120.907582:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf878facc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789785120.907636:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83875f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549038080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789785120.907667:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845c338 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c33f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785120.907690:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845c338 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c33f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785120.908566:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83875f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549038208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789785120.908649:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785120.908700:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf878facc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789785120.908836:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549038208 00000100:00100000:0.0:1789785120.908845:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549038208 00000100:00100000:0.0:1789785120.908936:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789785120.908956:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549038208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789785120.909130:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549038208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785120.909138:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789785120.909207:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83875f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549038208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789785120.909244:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83875f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549038336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789785120.909288:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785120.913197:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf878facc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785120.915095:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549038336 00000100:00100000:3.0:1789785120.915117:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549038336 00000100:00100000:3.0:1789785120.915204:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789785120.915217:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549038336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789785120.917119:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549038336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1896us (7821us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785120.917136:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789785120.920147:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83875f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549038336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789785120.926296:0:10450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83a22680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10450:1876725549038464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789785120.930561:0:10450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785120.930627:0:10450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf92353b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789785120.930866:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549038464 00000100:00100000:3.0:1789785120.930877:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549038464 00000100:00100000:3.0:1789785120.930947:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789785120.930959:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+21:10450:x1876725549038464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789785120.931142:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+21:10450:x1876725549038464:12345-0@lo:502:llog_process_th.0 Request processed in 185us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785120.931150:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789785120.931900:0:10450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83a22680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10450:1876725549038464:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789785120.932877:0:10450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789785120.932893:0:10450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785120.932896:0:10450:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789785120.932905:0:10450:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dae829a7000 00000020:00000080:1.0:1789785120.932909:0:10450:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789785120.933177:0:10450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83875f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10450:1876725549038592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789785120.933261:0:10450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785120.933894:0:10450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb35c540 going to sleep for 11 seconds 00000100:00100000:0.0:1789785120.939377:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549038592 00000100:00100000:0.0:1789785120.939395:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549038592 00000100:00100000:0.0:1789785120.939480:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789785120.939493:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+21:10450:x1876725549038592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789785120.939726:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+21:10450:x1876725549038592:12345-0@lo:502:llog_process_th.0 Request processed in 235us (6464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785120.939735:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789785120.941702:0:10450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83875f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10450:1876725549038592:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789785120.941818:0:10450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785120.941830:0:10450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785120.941833:0:10450:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789785120.941838:0:10450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789785120.943444:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789785120.943483:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789785120.943497:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845c338 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c33f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785120.943513:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845c338 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c33f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785120.943525:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789785120.943528:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dafb5cd8800 from 4 10000000:01000000:2.0:1789785120.943531:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789785120.943577:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c346 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785120.943586:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c346 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785120.943599:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c346 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785120.943629:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549038720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789785120.943730:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785120.943800:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb41e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789785120.943830:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549038720 00000100:00100000:2.0:1789785120.943838:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549038720 00000100:00100000:2.0:1789785120.943902:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789785120.943923:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549038720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789785120.944868:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785120.944893:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1b09800/0x2f18ee3fd845c34d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c346 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785120.944931:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1b09800/0x2f18ee3fd845c34d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c346 expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785120.944956:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1b09800/0x2f18ee3fd845c34d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c346 expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785120.944966:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b09800, rc 0) 00000100:00100000:2.0:1789785120.945035:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549038720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1113us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785120.945044:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789785120.945116:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549038720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789785120.945134:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c346 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c34d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785120.945146:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c346 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c34d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785120.945233:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549038848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789785120.945268:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785120.945301:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb41e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789785120.945317:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549038848 00000100:00100000:2.0:1789785120.945323:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549038848 00000100:00100000:2.0:1789785120.945383:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789785120.945402:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549038848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789785120.945420:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785120.945538:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549038848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785120.945546:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789785120.945567:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530106368 00000100:00100000:2.0:1789785120.945570:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530106368 00000100:00100000:2.0:1789785120.945589:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 256 00000100:00100000:2.0:1789785120.945595:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+9:6169:x1876725530106368:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789785120.945603:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785120.945613:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1b09a00/0x2f18ee3fd845c354 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8560 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785120.945629:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1b09a00/0x2f18ee3fd845c354 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8560 expref: 10 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785120.945639:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1b09a00/0x2f18ee3fd845c354 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8560 expref: 10 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785120.945647:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b09a00, rc 0) 00000100:00100000:2.0:1789785120.945704:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+10:6169:x1876725530106368:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 Request processed in 107us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785120.945711:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 256 00000100:00100000:2.0:1789785120.945881:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549038848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789785120.945917:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549038976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789785120.945960:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785120.945979:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf85828240 going to sleep for 11 seconds 00000100:00100000:2.0:1789785120.945998:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549038976 00000100:00100000:2.0:1789785120.946003:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549038976 00000100:00100000:2.0:1789785120.946025:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789785120.946032:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549038976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789785120.946121:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549038976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785120.946128:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789785120.946173:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549038976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789785120.946423:0:10455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10455:1876725549039104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789785120.946461:0:10455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785120.946482:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549039104 00000100:00100000:2.0:1789785120.946486:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549039104 00000100:00100000:2.0:1789785120.946509:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789785120.946516:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+22:10455:x1876725549039104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789785120.946603:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+22:10455:x1876725549039104:12345-0@lo:502:llog_process_th.0 Request processed in 86us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785120.946610:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789785120.946647:0:10455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf858286c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789785120.946660:0:10455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10455:1876725549039104:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789785120.946701:0:10455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789785120.946713:0:10455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785120.946716:0:10455:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789785120.946723:0:10455:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dafb5cd8800 00000020:00000080:2.0:1789785120.946726:0:10455:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789785120.947200:0:10455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10455:1876725549039232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789785120.947239:0:10455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785120.947274:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549039232 00000100:00100000:2.0:1789785120.947278:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549039232 00000100:00100000:2.0:1789785120.947307:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789785120.947315:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+22:10455:x1876725549039232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789785120.947423:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+22:10455:x1876725549039232:12345-0@lo:502:llog_process_th.0 Request processed in 108us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785120.947431:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789785120.947467:0:10455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf858286c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789785120.947483:0:10455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10455:1876725549039232:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789785120.947506:0:10455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789785120.947511:0:10455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785120.947513:0:10455:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789785120.947518:0:10455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789785120.947578:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789785120.947601:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789785120.947612:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c346 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c34d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785120.947624:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c346 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c34d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785120.947638:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789785120.947641:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dafc189c800 from 4 10000000:01000000:2.0:1789785120.947644:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789785120.954080:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c35b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785120.954107:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c35b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785120.954137:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c35b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785120.954236:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785120.954291:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549039360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789785120.954367:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785120.954412:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530106496 00000100:00100000:2.0:1789785120.954421:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530106496 00000100:00100000:2.0:1789785120.954475:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549039360 00000100:00100000:2.0:1789785120.954478:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549039360 00000100:00100000:2.0:1789785120.954497:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 260 00000100:00100000:2.0:1789785120.954507:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+10:6169:x1876725530106496:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789785120.954689:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+10:6169:x1876725530106496:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 Request processed in 182us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785120.954698:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 260 00000100:00100000:2.0:1789785120.954728:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789785120.954734:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549039360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789785120.954744:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1789785120.958432:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf858286c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789785120.959107:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1b08400/0x2f18ee3fd845c362 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c35b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785120.959157:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1b08400/0x2f18ee3fd845c362 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c35b expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785120.959174:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1b08400/0x2f18ee3fd845c362 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c35b expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785120.959204:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b08400, rc 0) 00000100:00100000:2.0:1789785120.959315:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549039360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 4578us (4946us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785120.959325:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789785120.959452:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549039360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789785120.959477:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c35b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c362 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785120.959490:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c35b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c362 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785120.959630:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83a23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549039488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789785120.959685:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785120.959722:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549039488 00000100:00100000:3.0:1789785120.959729:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549039488 00000100:00100000:3.0:1789785120.959771:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789785120.959780:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549039488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789785120.959920:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549039488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785120.959928:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789785120.960086:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf858286c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785120.960100:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83a23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549039488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789785120.960131:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83a23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549039616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789785120.960187:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785120.960200:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf858286c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789785120.960752:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549039616 00000100:00100000:2.0:1789785120.960832:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549039616 00000100:00100000:2.0:1789785120.960871:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789785120.960880:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549039616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789785120.961067:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549039616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785120.961076:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789785120.961133:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83a23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549039616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789785120.964107:0:10459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10459:1876725549039744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789785120.964214:0:10459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785120.964270:0:10459:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf858286c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785120.964625:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549039744 00000100:00100000:3.0:1789785120.964634:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549039744 00000100:00100000:3.0:1789785120.964702:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789785120.964713:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+23:10459:x1876725549039744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789785120.965386:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+23:10459:x1876725549039744:12345-0@lo:502:llog_process_th.0 Request processed in 669us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785120.965724:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789785120.967586:0:10459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10459:1876725549039744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789785120.967741:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785120.967858:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530106624 00000100:00100000:2.0:1789785120.967866:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530106624 00000100:00100000:2.0:1789785120.967919:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 265 00000100:00100000:2.0:1789785120.967938:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+10:6169:x1876725530106624:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789785120.968157:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+10:6169:x1876725530106624:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 Request processed in 218us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785120.968177:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 265 00000020:01000000:3.0:1789785120.968396:0:10459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789785120.968410:0:10459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789785120.968413:0:10459:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789785120.968423:0:10459:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dafc189c800 00000020:00000080:3.0:1789785120.968426:0:10459:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789785120.971389:0:10459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10459:1876725549039872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789785120.971491:0:10459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785120.971550:0:10459:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf982a8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789785120.971596:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549039872 00000100:00100000:3.0:1789785120.971606:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549039872 00000100:00100000:3.0:1789785120.971681:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789785120.971694:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+23:10459:x1876725549039872:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789785120.971851:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+23:10459:x1876725549039872:12345-0@lo:502:llog_process_th.0 Request processed in 159us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785120.971861:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789785120.973154:0:10459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10459:1876725549039872:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789785120.973204:0:10459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789785120.973215:0:10459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785120.973218:0:10459:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789785120.973224:0:10459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789785120.973317:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789785120.973378:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789785120.973393:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c35b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c362 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785120.973406:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c35b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c362 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785120.973418:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789785120.973421:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9daf89061800 from 4 10000000:01000000:2.0:1789785120.973425:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789785120.973461:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08800/0x2f18ee3fd845c369 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785120.973471:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08800/0x2f18ee3fd845c369 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785120.973482:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08800/0x2f18ee3fd845c369 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785120.973517:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549040000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789785120.973576:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785120.973620:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf982a8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789785120.976100:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549040000 00000100:00100000:3.0:1789785120.976118:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549040000 00000100:00100000:3.0:1789785120.976213:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789785120.976225:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549040000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789785120.976260:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785120.976284:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc2051600/0x2f18ee3fd845c370 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c369 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785120.976318:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc2051600/0x2f18ee3fd845c370 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c369 expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785120.976330:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc2051600/0x2f18ee3fd845c370 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c369 expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785120.976359:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc2051600, rc 0) 00000100:00100000:3.0:1789785120.976454:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:6531:x1876725549040000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 231us (2877us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785120.976462:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789785120.983276:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785120.983382:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530106752 00000100:00100000:2.0:1789785120.983395:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530106752 00000100:00100000:2.0:1789785120.983458:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 268 00000100:00100000:2.0:1789785120.983470:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+10:6709:x1876725530106752:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789785120.983649:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+10:6709:x1876725530106752:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 180us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785120.983658:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 268 00000100:00100000:2.0:1789785120.983838:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549040000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789785120.983866:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08800/0x2f18ee3fd845c369 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c370 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785120.983882:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08800/0x2f18ee3fd845c369 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c370 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785120.983986:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549040128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789785120.984033:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785120.984063:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549040128 00000100:00100000:2.0:1789785120.984067:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549040128 00000100:00100000:2.0:1789785120.984091:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789785120.984098:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:6531:x1876725549040128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789785120.984197:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:6531:x1876725549040128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785120.984212:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789785120.984248:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf982a8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789785120.984259:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549040128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789785120.984285:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549040256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789785120.984317:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785120.984334:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549040256 00000100:00100000:2.0:1789785120.984363:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549040256 00000100:00100000:2.0:1789785120.984386:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789785120.984393:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:6531:x1876725549040256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789785120.984461:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:6531:x1876725549040256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785120.984467:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789785120.984497:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf982a8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789785120.984507:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549040256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789785120.986309:0:10462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10462:1876725549040384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789785120.986434:0:10462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785120.986473:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549040384 00000100:00100000:2.0:1789785120.986480:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549040384 00000100:00100000:2.0:1789785120.986522:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789785120.986530:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:10462:x1876725549040384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789785120.986654:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:10462:x1876725549040384:12345-0@lo:502:llog_process_th.0 Request processed in 123us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785120.986662:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789785120.986728:0:10462:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf982a8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789785120.986758:0:10462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10462:1876725549040384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789785120.986801:0:10462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789785120.986811:0:10462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785120.986814:0:10462:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789785120.986822:0:10462:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9daf89061800 00000020:00000080:2.0:1789785120.986825:0:10462:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789785120.989444:0:10462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10462:1876725549040512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789785120.989544:0:10462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785120.989594:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549040512 00000100:00100000:2.0:1789785120.989602:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549040512 00000100:00100000:2.0:1789785120.989657:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789785120.989667:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:10462:x1876725549040512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789785120.992325:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:10462:x1876725549040512:12345-0@lo:502:llog_process_th.0 Request processed in 2652us (2775us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785120.992360:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789785120.992461:0:10462:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf982a8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789785120.992493:0:10462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:10462:1876725549040512:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789785120.992534:0:10462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789785120.992543:0:10462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785120.992546:0:10462:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789785120.992551:0:10462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789785120.992622:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789785120.992642:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789785120.992656:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08800/0x2f18ee3fd845c369 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c370 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785120.992669:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08800/0x2f18ee3fd845c369 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c370 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785120.997024:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785120.997088:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530106880 00000100:00100000:2.0:1789785120.997099:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530106880 00000100:00100000:2.0:1789785120.997158:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 273 00000100:00100000:2.0:1789785120.997170:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+10:6709:x1876725530106880:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789785120.997361:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+10:6709:x1876725530106880:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 192us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785120.997370:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 273 00000100:00100000:0.0:1789785121.602967:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb538700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549041024:0@lo:400:kworker.0 00000100:00100000:0.0:1789785121.603068:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785121.603129:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb53b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549041536:0@lo:400:kworker.0 00000100:00100000:0.0:1789785121.603158:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785121.603182:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb5ee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549042048:0@lo:400:kworker.0 00000100:00100000:0.0:1789785121.603203:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785121.603233:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789785121.603239:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549040640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789785121.603263:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785121.603278:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549041152:0@lo:400:kworker.0 00000100:00100000:0.0:1789785121.603313:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785121.603333:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549041664:0@lo:400:kworker.0 00000100:00100000:0.0:1789785121.603957:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785121.603985:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb5ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549042176:0@lo:400:kworker.0 00000100:00100000:0.0:1789785121.604012:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785121.604039:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb53bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549040896:0@lo:400:kworker.0 00000100:00100000:2.0:1789785121.604200:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549040768:0@lo:400:kworker.0 00000100:00100000:1.0:1789785121.604322:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549041536 00000100:00100000:1.0:1789785121.604331:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549041536 00000100:00100000:1.0:1789785121.604418:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549042048 00000100:00100000:1.0:1789785121.604422:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549042048 00000100:00100000:1.0:1789785121.604437:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549041664 00000100:00100000:1.0:1789785121.604440:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549041664 00000100:00100000:1.0:1789785121.604456:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549042176 00000100:00100000:1.0:1789785121.604458:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549042176 00000100:00100000:1.0:1789785121.604475:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789785121.604484:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549041536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785121.606073:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549040640 00000100:00100000:3.0:1789785121.606090:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549040640 00000100:00100000:3.0:1789785121.606148:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789785121.606158:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3661:x1876725549040640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789785121.606194:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785121.607441:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785121.607500:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb53a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549041280:0@lo:400:kworker.0 00000100:00100000:2.0:1789785121.607545:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785121.607564:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb5ee5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549041792:0@lo:400:kworker.0 00000100:00100000:2.0:1789785121.607588:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785121.607604:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549042304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789785121.607633:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785121.607664:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789785121.607683:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549042432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789785121.607732:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785121.607799:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789785121.607815:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3661:x1876725549042048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785121.607873:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3661:x1876725549042048:12345-0@lo:400:kworker.0 Request processed in 64us (4668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785121.607890:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789785121.608170:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789785121.608181:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549041664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785121.608228:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549041664:12345-0@lo:400:kworker.0 Request processed in 39us (4832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785121.608235:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789785121.608248:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789785121.608256:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549042176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785121.608289:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549042176:12345-0@lo:400:kworker.0 Request processed in 33us (4275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785121.608295:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1789785121.608316:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789785121.608322:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789785121.608422:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549041024 00000100:00100000:2.0:1789785121.608430:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549041024 00000100:00100000:2.0:1789785121.608461:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549040768 00000100:00100000:2.0:1789785121.608464:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549040768 00000100:00100000:2.0:1789785121.608475:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549041280 00000100:00100000:2.0:1789785121.608477:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549041280 00000100:00100000:2.0:1789785121.608499:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549041792 00000100:00100000:2.0:1789785121.608502:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549041792 00000100:00100000:2.0:1789785121.608516:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789785121.608523:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549041024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785121.608558:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549041024:12345-0@lo:400:kworker.0 Request processed in 35us (5490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785121.608564:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789785121.608579:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789785121.608594:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549040768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785121.608628:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549040768:12345-0@lo:400:kworker.0 Request processed in 36us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785121.608634:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789785121.608647:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789785121.608653:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549041280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785121.608690:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549041280:12345-0@lo:400:kworker.0 Request processed in 38us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785121.608697:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789785121.608707:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789785121.608712:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549041792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785121.608736:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549041792:12345-0@lo:400:kworker.0 Request processed in 25us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785121.608742:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789785121.609031:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549041152 00000100:00100000:2.0:1789785121.609036:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549041152 00000100:00100000:2.0:1789785121.609076:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549042304 00000100:00100000:2.0:1789785121.609079:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549042304 00000100:00100000:2.0:1789785121.609093:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789785121.609099:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3661:x1876725549041152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785121.609138:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3661:x1876725549041152:12345-0@lo:400:kworker.0 Request processed in 39us (5824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785121.609145:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789785121.609159:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789785121.609165:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549042304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789785121.609205:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789785121.609258:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549042304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (1624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785121.609264:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1789785121.609283:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789785121.609329:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549041152:0@lo:400:kworker.0 00010000:00080000:2.0:1789785121.609369:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb539c00 x1876725549041664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785121.609380:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549041664:0@lo:400:kworker.0 00010000:00080000:2.0:1789785121.609464:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb5ee7800 x1876725549042176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785121.609473:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb5ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549042176:0@lo:400:kworker.0 00000100:00100000:2.0:1789785121.609486:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb538700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549041024:0@lo:400:kworker.0 00010000:00080000:2.0:1789785121.609500:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb5ee7100 x1876725549042048/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785121.609508:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb5ee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549042048:0@lo:400:kworker.0 00000100:00100000:2.0:1789785121.609553:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549040768:0@lo:400:kworker.0 00000100:00100000:2.0:1789785121.609564:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb53a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549041280:0@lo:400:kworker.0 00000100:00100000:2.0:1789785121.609575:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb5ee5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549041792:0@lo:400:kworker.0 00000100:00100000:2.0:1789785121.609589:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549042304:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789785121.611176:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549041536:12345-0@lo:400:kworker.0 Request processed in 6682us (8006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785121.611192:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789785121.611249:0:8452:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1789785121.611260:0:8452:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1789785121.611513:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549042432 00000100:00100000:1.0:1789785121.611523:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549042432 00000100:00100000:1.0:1789785121.611642:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789785121.611652:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549042432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789785121.611693:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785121.611754:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549042432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (4020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785121.612069:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1789785121.612654:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb53b480 x1876725549041536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785121.612686:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb53b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549041536:0@lo:400:kworker.0 00010000:00080000:2.0:1789785121.612744:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83877480 x1876725549042432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785121.612777:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549042432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789785121.621187:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549040640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 15016us (17908us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785121.621205:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789785121.621522:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785121.621714:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549041408:0@lo:400:kworker.0 00000100:00100000:0.0:1789785121.621779:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785121.621803:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb5ee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1876725549041920:0@lo:400:kworker.0 00000100:00100000:0.0:1789785121.621826:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785121.621872:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549040896 00000100:00100000:0.0:1789785121.621883:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549040896 00000100:00100000:0.0:1789785121.621945:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789785121.621955:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549040896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785121.622020:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549040896:12345-0@lo:400:kworker.0 Request processed in 66us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785121.622027:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789785121.622049:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549041408 00000100:00100000:0.0:1789785121.622053:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549041408 00000100:00100000:0.0:1789785121.622100:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549041920 00000100:00100000:0.0:1789785121.622104:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549041920 00000100:00100000:0.0:1789785121.622127:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789785121.622134:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1876725549041408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785121.622166:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1876725549041408:12345-0@lo:400:kworker.0 Request processed in 33us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785121.622188:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789785121.622202:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789785121.622207:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1876725549041920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785121.622562:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1876725549041920:12345-0@lo:400:kworker.0 Request processed in 353us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785121.622569:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1789785121.622596:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789785121.622639:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb53bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549040896:0@lo:400:kworker.0 00010000:00080000:0.0:1789785121.622655:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb538000 x1876725549041408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785121.622679:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549041408:0@lo:400:kworker.0 00010000:00080000:0.0:1789785121.622691:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb5ee6680 x1876725549041920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785121.622700:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb5ee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1876725549041920:0@lo:400:kworker.0 00010000:00080000:2.0:1789785121.624883:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb539f80 x1876725549040640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785121.624915:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549040640:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789785121.795037:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785122.795837:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785122.795888:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785122.795936:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785122.795959:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785122.795994:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785122.796170:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530107264 00000100:00100000:1.0:1789785122.796179:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530107264 00000100:00100000:1.0:1789785122.796234:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530107136 00000100:00100000:1.0:1789785122.796237:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530107136 00000100:00100000:1.0:1789785122.796273:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 67 00000100:00100000:1.0:1789785122.796284:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530107264:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785122.796552:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530107520 00000100:00100000:3.0:1789785122.796557:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530107520 00000100:00100000:0.0:1789785122.796629:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530107008 00000100:00100000:0.0:1789785122.796633:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530107008 00000100:00100000:1.0:1789785122.798774:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530107264:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 2482us (2875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785122.798787:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 67 00000100:00100000:1.0:1789785122.798823:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 68 00000100:00100000:1.0:1789785122.798838:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+6:2400:x1876725530107136:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785122.798900:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+6:2400:x1876725530107136:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 68us (2939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785122.798907:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 68 00000100:00080000:1.0:1789785122.809209:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789785122.809220:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789785122.809223:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789785122.812143:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530107392 00000100:00100000:3.0:1789785122.812160:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530107392 00000100:00100000:3.0:1789785122.812229:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 23 00000100:00100000:3.0:1789785122.812241:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530107520:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785122.812360:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530107520:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 122us (16422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785122.812369:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 23 00000100:00100000:3.0:1789785122.813204:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 24 00000100:00100000:3.0:1789785122.813216:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530107392:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785122.813266:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530107392:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 54us (17271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785122.813273:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 24 00000100:00080000:1.0:1789785122.815044:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789785122.819539:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785122.819838:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 274 00000100:00100000:0.0:1789785122.819863:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2400:x1876725530107008:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785122.819964:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2400:x1876725530107008:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 114us (24138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785122.819972:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 274 00000100:00100000:2.0:1789785123.138828:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549042560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789785123.138893:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785123.138970:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549042560 00000100:00100000:2.0:1789785123.138977:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549042560 00000100:00100000:2.0:1789785123.139037:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789785123.139058:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549042560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789785123.139086:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785123.139129:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549042560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785123.139136:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1789785123.139159:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789785123.139183:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3f3800 x1876725549042560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785139 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785123.139217:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549042560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789785123.140975:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83a23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549042688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789785123.141023:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785123.141072:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549042688 00000100:00100000:3.0:1789785123.141078:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549042688 00000100:00100000:3.0:1789785123.141120:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789785123.141129:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549042688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789785123.141145:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785123.141181:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549042688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785123.141188:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1789785123.141205:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789785123.141226:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83a23800 x1876725549042688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785139 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785123.141241:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83a23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549042688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789785123.141414:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789785123.141424:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb5ee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549042816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789785123.141466:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785123.141497:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549042816 00000100:00100000:0.0:1789785123.141501:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549042816 00000100:00100000:0.0:1789785123.141528:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789785123.141535:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549042816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789785123.141557:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789785123.141589:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549042816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785123.141596:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789785123.141626:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb5ee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549042816:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789785123.854134:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785124.869673:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785125.890746:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789785126.509086:0:10710:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1789785126.723804:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549042944:0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.723870:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785126.723918:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549043456:0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.723977:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785126.724000:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549043968:0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.724041:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785126.724060:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf42e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549044480:0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.724079:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785126.724104:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789785126.724110:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1876725549043328:0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.724136:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785126.724153:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549043840:0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.724187:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785126.724206:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549044352:0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.724225:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785126.724259:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549043200:0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.724284:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785126.724303:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1876725549043712:0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.724322:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785126.724370:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1876725549044224:0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.724393:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785126.724411:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789785126.724417:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1876725549043072:0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.724438:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785126.726086:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1876725549043584:0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.726131:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785126.726144:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1876725549044096:0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.726162:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785126.726191:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549043456 00000100:00100000:1.0:1789785126.726197:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549043456 00000100:00100000:3.0:1789785126.726649:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549042944 00000100:00100000:3.0:1789785126.726663:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549042944 00000100:00100000:3.0:1789785126.726702:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789785126.726709:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:3660:x1876725549042944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785126.726763:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:3660:x1876725549042944:12345-0@lo:400:kworker.0 Request processed in 54us (2892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785126.726770:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789785126.727527:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549043200 00000100:00100000:1.0:1789785126.727532:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549043200 00000100:00100000:1.0:1789785126.727550:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789785126.727557:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549043456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.727601:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549043456:12345-0@lo:400:kworker.0 Request processed in 45us (3623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785126.727607:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789785126.727641:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789785126.727647:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549043200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.727683:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549043200:12345-0@lo:400:kworker.0 Request processed in 36us (3398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785126.727689:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789785126.727710:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549043968 00000100:00100000:1.0:1789785126.727713:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549043968 00000100:00100000:1.0:1789785126.727742:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549044480 00000100:00100000:1.0:1789785126.727745:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549044480 00000100:00100000:1.0:1789785126.727755:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549043840 00000100:00100000:1.0:1789785126.727758:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549043840 00000100:00100000:1.0:1789785126.727770:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549044352 00000100:00100000:1.0:1789785126.727772:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549044352 00000100:00100000:1.0:1789785126.727785:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789785126.727791:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549043968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.727822:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549043968:12345-0@lo:400:kworker.0 Request processed in 31us (3781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785126.727827:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789785126.727839:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789785126.727845:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549044480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.727871:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549044480:12345-0@lo:400:kworker.0 Request processed in 27us (3790us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785126.727876:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789785126.727886:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789785126.727892:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549043840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.727914:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549043840:12345-0@lo:400:kworker.0 Request processed in 22us (3726us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785126.727928:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789785126.727939:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789785126.727945:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549044352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.727972:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549044352:12345-0@lo:400:kworker.0 Request processed in 27us (3746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785126.727977:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789785126.727997:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549043328 00000100:00100000:1.0:1789785126.728000:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549043328 00000100:00100000:1.0:1789785126.728018:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549043712 00000100:00100000:1.0:1789785126.728020:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549043712 00000100:00100000:1.0:1789785126.728031:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549044224 00000100:00100000:1.0:1789785126.728034:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549044224 00000100:00100000:1.0:1789785126.728044:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549043072 00000100:00100000:1.0:1789785126.728046:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549043072 00000100:00100000:1.0:1789785126.728055:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549043584 00000100:00100000:1.0:1789785126.728057:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549043584 00000100:00100000:1.0:1789785126.728068:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549044096 00000100:00100000:1.0:1789785126.728070:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549044096 00000100:00100000:1.0:1789785126.728083:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789785126.728089:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1876725549043328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.728120:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1876725549043328:12345-0@lo:400:kworker.0 Request processed in 31us (3984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785126.728126:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789785126.728137:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789785126.728143:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1876725549043712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.728169:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1876725549043712:12345-0@lo:400:kworker.0 Request processed in 27us (3846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785126.728175:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789785126.728195:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789785126.728201:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1876725549044224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.728230:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1876725549044224:12345-0@lo:400:kworker.0 Request processed in 29us (3835us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785126.728235:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789785126.728247:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789785126.728253:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1876725549043072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.728278:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1876725549043072:12345-0@lo:400:kworker.0 Request processed in 26us (3839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785126.728284:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789785126.728294:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789785126.728299:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1876725549043584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.728324:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1876725549043584:12345-0@lo:400:kworker.0 Request processed in 25us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785126.728330:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789785126.728660:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789785126.728669:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1876725549044096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.728714:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1876725549044096:12345-0@lo:400:kworker.0 Request processed in 47us (2550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785126.728720:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789785126.728785:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1876725549043328:0@lo:400:kworker.0 00010000:00080000:1.0:1789785126.728800:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83876300 x1876725549043840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785126.728811:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549043840:0@lo:400:kworker.0 00010000:00080000:1.0:1789785126.728834:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83876d80 x1876725549044352/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785126.728842:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549044352:0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.728852:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549042944:0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.728862:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549043456:0@lo:400:kworker.0 00010000:00080000:1.0:1789785126.728872:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83875c00 x1876725549043968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785126.728879:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549043968:0@lo:400:kworker.0 00010000:00080000:1.0:1789785126.728888:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf42e680 x1876725549044480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785126.728895:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf42e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549044480:0@lo:400:kworker.0 00000100:00080000:1.0:1789785126.728932:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789785126.728936:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789785126.728939:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789785126.728941:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789785126.732945:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549044608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789785126.733013:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785126.733053:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789785126.733060:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549044736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789785126.733083:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785126.733110:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549044864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789785126.733135:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785126.733170:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549044608 00000100:00100000:2.0:1789785126.733177:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549044608 00000100:00100000:2.0:1789785126.733272:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549044736 00000100:00100000:2.0:1789785126.733276:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549044736 00000100:00100000:2.0:1789785126.733294:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789785126.733302:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549044608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789785126.733330:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785126.733396:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549044608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785126.733403:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789785126.733419:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789785126.733426:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549044736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789785126.733435:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785126.733468:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549044736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785126.733482:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1789785126.733521:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3f0000 x1876725549044736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785126.733539:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549044736:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789785126.733551:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3f3800 x1876725549044608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785126.733561:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549044608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789785126.733585:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549044864 00000100:00100000:2.0:1789785126.733588:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549044864 00000100:00100000:2.0:1789785126.733612:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789785126.733618:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549044864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789785126.733649:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789785126.733683:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549044864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785126.733689:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789785126.733717:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549044864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789785126.735516:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1876725549043072:0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.735533:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1876725549043584:0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.735545:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1876725549044096:0@lo:400:kworker.0 00000100:00100000:1.0:1789785126.735558:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549043200:0@lo:400:kworker.0 00010000:00080000:1.0:1789785126.735571:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83875f80 x1876725549043712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785126.735582:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1876725549043712:0@lo:400:kworker.0 00010000:00080000:1.0:1789785126.735604:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83875880 x1876725549044224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785126.735613:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1876725549044224:0@lo:400:kworker.0 00010000:00010000:3.0:1789785126.914726:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785127.931749:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785127.931795:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785127.931833:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785127.931861:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785127.931890:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785127.931918:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530107904 00000100:00100000:1.0:1789785127.931928:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530107904 00000100:00100000:1.0:1789785127.931991:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530107776 00000100:00100000:1.0:1789785127.931994:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530107776 00000100:00100000:1.0:1789785127.932017:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 75 00000100:00100000:1.0:1789785127.932028:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530107904:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785127.932095:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530107904:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 71us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785127.932102:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 75 00000100:00100000:1.0:1789785127.932117:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 76 00000100:00100000:1.0:1789785127.932123:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+6:2398:x1876725530107776:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785127.932281:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+6:2398:x1876725530107776:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 156us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785127.932288:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 76 00000100:00100000:1.0:1789785127.932309:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530108160 00000100:00100000:1.0:1789785127.932313:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530108160 00000100:00100000:3.0:1789785127.932417:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530108032 00000100:00100000:3.0:1789785127.932421:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530108032 00000100:00100000:3.0:1789785127.932453:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 29 00000100:00100000:3.0:1789785127.932460:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530108032:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785127.932486:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530108032:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 27us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785127.932493:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 29 00000100:00080000:3.0:1789785127.932541:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789785127.932546:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789785127.932548:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789785127.932581:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530107648 00000100:00100000:0.0:1789785127.932585:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530107648 00000100:00100000:0.0:1789785127.932614:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 276 00000100:00100000:0.0:1789785127.932651:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2398:x1876725530107648:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785127.932677:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2398:x1876725530107648:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 56us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785127.932683:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 276 00000100:00100000:0.0:1789785127.933769:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 30 00000100:00100000:0.0:1789785127.933778:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530108160:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785127.933814:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530108160:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 37us (1979us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785127.933821:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 30 00000100:00080000:1.0:1789785127.937537:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789785127.939637:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785128.258743:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb5ee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549044992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789785128.258816:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785128.258860:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789785128.258890:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf42ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549045120:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789785128.258920:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785128.259019:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549044992 00000100:00100000:0.0:1789785128.259028:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549044992 00000100:00100000:0.0:1789785128.259078:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789785128.259087:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549044992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789785128.259133:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789785128.259200:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549044992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785128.259208:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789785128.259584:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb5ee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549044992:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789785128.259775:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789785128.259786:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb5ee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549045248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789785128.259818:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785128.281171:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549045120 00000100:00100000:2.0:1789785128.281186:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549045120 00000100:00100000:2.0:1789785128.281258:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549045248 00000100:00100000:2.0:1789785128.281261:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549045248 00000100:00100000:2.0:1789785128.281283:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789785128.281292:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549045120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789785128.281332:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785128.281455:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549045120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 163us (22533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785128.281462:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789785128.281477:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789785128.281484:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549045248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789785128.281494:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785128.281522:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549045248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (21703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785128.281528:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1789785128.281881:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789785128.281917:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf42ce00 x1876725549045120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785144 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785128.281948:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf42ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549045120:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1789785128.282657:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb5ee4380 x1876725549045248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785144 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785128.282675:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb5ee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549045248:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789785128.970591:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785129.990682:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785131.013084:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789785131.711085:0:10953:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing yml_node 00000100:00100000:3.0:1789785131.842773:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83a22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876725549045504:0@lo:400:kworker.0 00000100:00100000:3.0:1789785131.842847:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785131.842928:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83a23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549045376:0@lo:400:kworker.0 00000100:00100000:2.0:1789785131.842964:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785131.843007:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf44b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549045888:0@lo:400:kworker.0 00000100:00100000:2.0:1789785131.843043:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785131.843062:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549046400:0@lo:400:kworker.0 00000100:00100000:2.0:1789785131.843083:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785131.843100:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549046912:0@lo:400:kworker.0 00000100:00100000:2.0:1789785131.843120:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785131.843217:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549045888 00000100:00100000:2.0:1789785131.843224:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549045888 00000100:00100000:2.0:1789785131.843268:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789785131.843276:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549045888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785131.843327:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549045888:12345-0@lo:400:kworker.0 Request processed in 51us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785131.843376:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789785131.843399:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549046400 00000100:00100000:2.0:1789785131.843403:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549046400 00000100:00100000:2.0:1789785131.843441:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549046912 00000100:00080000:1.0:1789785131.843950:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789785131.844584:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1876725549046016:0@lo:400:kworker.0 00000100:00100000:3.0:1789785131.844627:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785131.844646:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1876725549046528:0@lo:400:kworker.0 00000100:00100000:3.0:1789785131.844672:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785131.844706:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf44b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549045632:0@lo:400:kworker.0 00000100:00100000:3.0:1789785131.844732:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785131.844750:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725549046144:0@lo:400:kworker.0 00000100:00100000:3.0:1789785131.844772:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785131.844789:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549046656:0@lo:400:kworker.0 00000100:00100000:3.0:1789785131.844809:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785131.844821:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789785131.844827:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549045760:0@lo:400:kworker.0 00000100:00100000:3.0:1789785131.844846:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785131.844869:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549046272:0@lo:400:kworker.0 00000100:00100000:3.0:1789785131.844890:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785131.844908:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549046784:0@lo:400:kworker.0 00000100:00100000:3.0:1789785131.844931:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785131.844955:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549045376 00000100:00100000:3.0:1789785131.844959:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549045376 00000100:00100000:3.0:1789785131.844994:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789785131.845003:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:3659:x1876725549045376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785131.845040:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:3659:x1876725549045376:12345-0@lo:400:kworker.0 Request processed in 39us (2076us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785131.845057:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789785131.845088:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549046272 00000100:00100000:3.0:1789785131.845092:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549046272 00000100:00100000:3.0:1789785131.845117:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549046784 00000100:00100000:3.0:1789785131.845119:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549046784 00000100:00100000:3.0:1789785131.845131:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789785131.845138:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549046400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785131.845169:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549046400:12345-0@lo:400:kworker.0 Request processed in 32us (2085us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785131.845176:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789785131.845188:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789785131.845194:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549046272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785131.845225:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549046272:12345-0@lo:400:kworker.0 Request processed in 30us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785131.845230:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789785131.845242:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789785131.845248:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549046784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785131.845273:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549046784:12345-0@lo:400:kworker.0 Request processed in 26us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785131.845279:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789785131.845295:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549045504 00000100:00100000:3.0:1789785131.845298:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549045504 00000100:00100000:3.0:1789785131.845314:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549046016 00000100:00100000:3.0:1789785131.845317:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549046016 00000100:00100000:3.0:1789785131.845328:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549046528 00000100:00100000:3.0:1789785131.845330:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549046528 00000100:00100000:3.0:1789785131.845361:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549046144 00000100:00100000:3.0:1789785131.845370:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549046144 00000100:00100000:3.0:1789785131.845386:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549046656 00000100:00100000:3.0:1789785131.845388:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549046656 00000100:00100000:3.0:1789785131.845399:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549045760 00000100:00100000:3.0:1789785131.845402:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549045760 00000100:00100000:3.0:1789785131.845414:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789785131.845420:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876725549045504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785131.846538:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549046912 00000100:00100000:2.0:1789785131.846584:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789785131.846600:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549046912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785131.846678:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789785131.846689:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1876725549046016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785131.849609:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549046912:12345-0@lo:400:kworker.0 Request processed in 3001us (6470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785131.849622:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789785131.849807:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549045632 00000100:00100000:2.0:1789785131.849815:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549045632 00000100:00100000:2.0:1789785131.849860:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789785131.849870:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549045632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785131.849919:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549045632:12345-0@lo:400:kworker.0 Request processed in 50us (5185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785131.849925:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789785131.850045:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83a23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549045376:0@lo:400:kworker.0 00000100:00100000:2.0:1789785131.850059:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf44b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549045888:0@lo:400:kworker.0 00010000:00080000:2.0:1789785131.850073:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb415880 x1876725549046400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785131.850084:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549046400:0@lo:400:kworker.0 00010000:00080000:2.0:1789785131.850095:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafc1b38700 x1876725549046912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785131.850103:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549046912:0@lo:400:kworker.0 00000100:00100000:2.0:1789785131.850138:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789785131.850148:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549047040:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789785131.850179:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785131.850209:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549047040 00000100:00100000:2.0:1789785131.850212:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549047040 00000100:00100000:2.0:1789785131.850235:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789785131.850241:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549047040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789785131.850264:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789785131.850299:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549047040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785131.850305:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789785131.850333:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549047040:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789785131.853314:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1876725549046016:12345-0@lo:400:kworker.0 Request processed in 6621us (8679us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785131.853327:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789785131.853374:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789785131.853387:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1876725549046528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785131.853427:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1876725549046528:12345-0@lo:400:kworker.0 Request processed in 45us (8754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785131.853432:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789785131.853443:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789785131.853450:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725549046144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785131.853477:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725549046144:12345-0@lo:400:kworker.0 Request processed in 28us (8705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785131.853483:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789785131.853495:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789785131.853501:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549046656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785131.853526:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549046656:12345-0@lo:400:kworker.0 Request processed in 26us (8716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785131.853539:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789785131.853551:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789785131.853557:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549045760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785131.853587:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549045760:12345-0@lo:400:kworker.0 Request processed in 30us (8740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785131.853602:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1789785131.854056:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789785131.854061:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789785131.854064:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789785131.854067:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789785131.854085:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549047168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789785131.854119:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785131.854163:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549045760:0@lo:400:kworker.0 00010000:00080000:1.0:1789785131.854177:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb414000 x1876725549046272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785131.854186:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549046272:0@lo:400:kworker.0 00010000:00080000:1.0:1789785131.854195:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafc1b39500 x1876725549046784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785131.854203:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549046784:0@lo:400:kworker.0 00000100:00100000:1.0:1789785131.854212:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf44b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549045632:0@lo:400:kworker.0 00010000:00080000:1.0:1789785131.854221:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf448700 x1876725549046144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785131.854228:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725549046144:0@lo:400:kworker.0 00010000:00080000:1.0:1789785131.854245:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafc1b3b480 x1876725549046656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785131.854253:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549046656:0@lo:400:kworker.0 00000100:00100000:1.0:1789785131.854293:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789785131.854300:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549047296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789785131.854325:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785131.854470:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549047168 00000100:00100000:2.0:1789785131.854477:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549047168 00000100:00100000:2.0:1789785131.854510:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549047296 00000100:00100000:2.0:1789785131.854513:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549047296 00000100:00100000:2.0:1789785131.854526:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789785131.854532:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549047168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789785131.854552:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785131.854602:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549047168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785131.854608:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789785131.854621:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789785131.854628:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549047296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789785131.854638:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785131.854660:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549047296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785131.854673:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1789785131.854697:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3f0000 x1876725549047296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785131.854711:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549047296:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789785131.854719:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3f3100 x1876725549047168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785131.854729:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549047168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789785131.854831:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876725549045504:12345-0@lo:400:kworker.0 Request processed in 9409us (11982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785131.854839:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789785131.859459:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83a22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876725549045504:0@lo:400:kworker.0 00000100:00100000:0.0:1789785131.859480:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1876725549046016:0@lo:400:kworker.0 00000100:00100000:0.0:1789785131.859493:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1876725549046528:0@lo:400:kworker.0 00010000:00010000:3.0:1789785132.037846:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785133.058616:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785133.059669:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785133.059713:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785133.059757:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785133.059785:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530108544 00000100:00100000:2.0:1789785133.059794:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530108544 00000100:00100000:2.0:1789785133.059858:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530108416 00000100:00100000:2.0:1789785133.059862:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530108416 00000100:00100000:2.0:1789785133.059886:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 83 00000100:00100000:2.0:1789785133.059896:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2399:x1876725530108544:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785133.059959:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2399:x1876725530108544:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 65us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785133.059966:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 83 00000100:00100000:2.0:1789785133.059982:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 84 00000100:00100000:2.0:1789785133.059988:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+6:2399:x1876725530108416:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785133.060010:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+6:2399:x1876725530108416:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 22us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785133.060016:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 84 00000100:00100000:0.0:1789785133.060087:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530108288 00000100:00100000:0.0:1789785133.060092:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530108288 00000100:00100000:0.0:1789785133.060125:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 278 00000100:00100000:0.0:1789785133.060133:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2399:x1876725530108288:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785133.060158:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2399:x1876725530108288:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 26us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785133.060165:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 278 00000100:00080000:1.0:1789785133.060225:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789785133.060229:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789785133.082758:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785133.082795:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785133.082934:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530108672 00000100:00100000:1.0:1789785133.082944:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530108672 00000100:00100000:1.0:1789785133.083010:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530108800 00000100:00100000:1.0:1789785133.083014:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530108800 00000100:00100000:1.0:1789785133.083037:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 18 00000100:00100000:1.0:1789785133.083048:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2396:x1876725530108672:12345-192.168.203.46@tcp:9:kworker.0 00000020:00000080:1.0:1789785133.083080:0:8805:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c282 00000100:00080000:1.0:1789785133.083090:0:8805:0:(import.c:65:import_set_state_nolock()) ffff9dae83733800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789785133.083129:0:8805:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789785133.083273:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+2:2396:x1876725530108672:12345-192.168.203.46@tcp:9:kworker.0 Request processed in 227us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785133.083282:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 18 00000100:00100000:1.0:1789785133.083297:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:1.0:1789785133.083317:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2396:x1876725530108800:12345-192.168.203.46@tcp:9:kworker.0 00000020:00000080:1.0:1789785133.083363:0:8805:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c289 00000100:00080000:1.0:1789785133.083371:0:8805:0:(import.c:65:import_set_state_nolock()) ffff9dae83737800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789785133.083392:0:8805:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:3.0:1789785133.083532:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785133.083538:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789785133.083544:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789785133.083548:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789785133.083769:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+2:2396:x1876725530108800:12345-192.168.203.46@tcp:9:kworker.0 Request processed in 453us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785133.083787:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:2.0:1789785133.379065:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf42d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549047424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789785133.379150:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785133.379222:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789785133.379230:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549047552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789785133.379254:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785133.379289:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549047424 00000100:00100000:2.0:1789785133.379296:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549047424 00000100:00100000:2.0:1789785133.379380:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549047552 00000100:00100000:2.0:1789785133.379384:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549047552 00000100:00100000:2.0:1789785133.379405:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789785133.379414:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549047424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789785133.379456:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785133.379499:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549047424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785133.379507:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789785133.379523:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789785133.379530:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549047552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789785133.379541:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785133.379565:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549047552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785133.379571:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1789785133.379597:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789785133.379626:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb620f800 x1876725549047552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785149 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785133.379642:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549047552:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1789785133.379652:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf42d880 x1876725549047424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785149 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785133.379677:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf42d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549047424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789785133.380374:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf42ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549047680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789785133.380414:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785133.381616:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549047680 00000100:00100000:1.0:1789785133.381625:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549047680 00000100:00100000:1.0:1789785133.381672:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789785133.381681:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549047680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789785133.381712:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789785133.381768:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549047680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785133.381786:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789785133.382217:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf42ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549047680:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789785134.084274:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785135.107382:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785136.135126:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785136.962969:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789785136.962994:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb5ee7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549047936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789785136.963058:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785136.963135:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549047808:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789785136.963172:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785136.963186:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789785136.963205:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549048064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789785136.963258:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785136.963287:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549048448:0@lo:400:kworker.0 00000100:00100000:3.0:1789785136.963310:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549048192:0@lo:400:kworker.0 00000100:00100000:0.0:1789785136.963313:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785136.963360:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549048960:0@lo:400:kworker.0 00000100:00100000:3.0:1789785136.963372:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785136.963390:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785136.963411:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacaeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1876725549049472:0@lo:400:kworker.0 00000100:00100000:0.0:1789785136.963430:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785136.963445:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789785136.963450:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876725549048576:0@lo:400:kworker.0 00000100:00100000:0.0:1789785136.963469:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785136.963485:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549049088:0@lo:400:kworker.0 00000100:00100000:0.0:1789785136.963504:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785136.963525:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549049600:0@lo:400:kworker.0 00000100:00100000:0.0:1789785136.963543:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785136.963597:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549048064 00000100:00100000:0.0:1789785136.963604:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549048064 00000100:00100000:0.0:1789785136.963641:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549048448 00000100:00100000:0.0:1789785136.963644:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549048448 00000100:00100000:0.0:1789785136.963661:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789785136.963669:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549048064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789785136.963703:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789785136.963717:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83980380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549048704:0@lo:400:kworker.0 00000100:00100000:3.0:1789785136.963758:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785136.963758:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549048064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785136.963768:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789785136.963775:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549049216:0@lo:400:kworker.0 00000100:00100000:0.0:1789785136.963795:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549048704 00000100:00100000:0.0:1789785136.963800:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549048704 00000100:00100000:3.0:1789785136.963813:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785136.963826:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789785136.963834:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549048448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785136.963840:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789785136.963849:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725549048320:0@lo:400:kworker.0 00000100:00100000:0.0:1789785136.963873:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549048448:12345-0@lo:400:kworker.0 Request processed in 40us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785136.963880:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789785136.963890:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785136.963895:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789785136.963904:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549048704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785136.963914:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1876725549048832:0@lo:400:kworker.0 00000100:00100000:0.0:1789785136.963943:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549048704:12345-0@lo:400:kworker.0 Request processed in 40us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785136.963948:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785136.963956:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789785136.963965:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1876725549049344:0@lo:400:kworker.0 00000100:00100000:0.0:1789785136.963977:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549048960 00000100:00100000:0.0:1789785136.963983:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549048960 00000100:00100000:3.0:1789785136.963987:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785136.964015:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549049472 00000100:00100000:3.0:1789785136.964016:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83980380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549048704:0@lo:400:kworker.0 00000100:00100000:0.0:1789785136.964019:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549049472 00000100:00100000:0.0:1789785136.964036:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549048576 00000100:00100000:0.0:1789785136.964040:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549048576 00000100:00100000:3.0:1789785136.964050:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549048320 00000100:00100000:0.0:1789785136.964054:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549048832 00000100:00100000:3.0:1789785136.964055:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549048320 00000100:00100000:0.0:1789785136.964059:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549048832 00000100:00100000:3.0:1789785136.964083:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549049344 00000100:00100000:0.0:1789785136.964088:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789785136.964089:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549049344 00000100:00100000:0.0:1789785136.964102:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549048960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785136.964117:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789785136.964126:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876725549049472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785136.964138:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549048960:12345-0@lo:400:kworker.0 Request processed in 40us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785136.964144:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789785136.964160:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789785136.964173:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876725549049472:12345-0@lo:400:kworker.0 Request processed in 44us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785136.964173:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876725549048576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785136.964185:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789785136.964203:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789785136.964213:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725549048320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785136.964213:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876725549048576:12345-0@lo:400:kworker.0 Request processed in 44us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785136.964235:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789785136.964252:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789785136.964256:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725549048320:12345-0@lo:400:kworker.0 Request processed in 46us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785136.964263:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1876725549048832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785136.964269:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789785136.964287:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789785136.964296:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf450380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1876725549049344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785136.964303:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1876725549048832:12345-0@lo:400:kworker.0 Request processed in 43us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785136.964310:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789785136.964331:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf450380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1876725549049344:12345-0@lo:400:kworker.0 Request processed in 36us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785136.964357:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549049088 00000100:00100000:0.0:1789785136.964361:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549049088 00000100:00100000:3.0:1789785136.964366:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789785136.964385:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549049600 00000100:00100000:0.0:1789785136.964389:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549049600 00000100:00100000:0.0:1789785136.964401:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549049216 00000100:00100000:0.0:1789785136.964404:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549049216 00000100:00100000:0.0:1789785136.964416:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789785136.964422:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549049088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785136.964451:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549049088:12345-0@lo:400:kworker.0 Request processed in 30us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785136.964458:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789785136.964468:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789785136.964474:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549049600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785136.964505:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549049600:12345-0@lo:400:kworker.0 Request processed in 31us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785136.964512:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789785136.964526:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789785136.964532:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725549048320:0@lo:400:kworker.0 00000100:00100000:0.0:1789785136.964536:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549049216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785136.964548:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1876725549048832:0@lo:400:kworker.0 00000100:00100000:3.0:1789785136.964570:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1876725549049344:0@lo:400:kworker.0 00000100:00100000:0.0:1789785136.964590:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549049216:12345-0@lo:400:kworker.0 Request processed in 56us (776us total) trans 0 rc 0/0 00010000:00080000:3.0:1789785136.964598:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafacae9500 x1876725549049216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785136.964612:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789785136.964617:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549049216:0@lo:400:kworker.0 00000100:00100000:0.0:1789785136.964664:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876725549048576:0@lo:400:kworker.0 00010000:00080000:0.0:1789785136.964676:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafacae8700 x1876725549049088/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785136.964684:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549049088:0@lo:400:kworker.0 00010000:00080000:0.0:1789785136.964693:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafacae8380 x1876725549049600/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785136.964701:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549049600:0@lo:400:kworker.0 00010000:00080000:0.0:1789785136.964709:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafacaeb800 x1876725549049472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785136.964717:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549048192 00000100:00100000:0.0:1789785136.964718:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacaeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1876725549049472:0@lo:400:kworker.0 00000100:00100000:3.0:1789785136.964724:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549048192 00000100:00100000:0.0:1789785136.964733:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549048448:0@lo:400:kworker.0 00010000:00080000:0.0:1789785136.964748:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83980700 x1876725549048960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785136.964758:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789785136.964758:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549048960:0@lo:400:kworker.0 00000100:00100000:3.0:1789785136.964770:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:3661:x1876725549048192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785136.964780:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549048064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789785136.964812:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:3661:x1876725549048192:12345-0@lo:400:kworker.0 Request processed in 43us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785136.964818:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00080000:0.0:1789785136.964855:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789785136.964860:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789785136.964863:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789785136.964865:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549048192:0@lo:400:kworker.0 00000100:00080000:0.0:1789785136.964866:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789785136.965713:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549047936 00000100:00100000:2.0:1789785136.965720:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549047936 00000100:00100000:3.0:1789785136.965824:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549047808 00000100:00100000:3.0:1789785136.965829:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549047808 00000100:00100000:3.0:1789785136.965867:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789785136.965875:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789785136.965879:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549047808:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789785136.965888:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549047936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789785136.965905:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1789785136.965906:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785136.965965:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549047808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (2791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785136.965972:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549047936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (2911us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785136.965976:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789785136.965985:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1789785136.966024:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb5ee7480 x1876725549047936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785136.966040:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb5ee7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549047936:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789785136.966087:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789785136.976316:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3f1180 x1876725549047808/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785136.976357:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549047808:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789785137.155306:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785138.162707:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785138.162742:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785138.162797:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785138.162957:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530109184 00000100:00100000:0.0:1789785138.162967:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530109184 00000100:00100000:2.0:1789785138.163128:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530108928 00000100:00100000:2.0:1789785138.163133:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530108928 00000100:00100000:2.0:1789785138.163172:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 280 00000100:00100000:2.0:1789785138.163181:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2400:x1876725530108928:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785138.163240:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2400:x1876725530108928:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 60us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785138.163247:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 280 00000100:00100000:2.0:1789785138.163971:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530109056 00000100:00100000:2.0:1789785138.163977:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530109056 00000100:00100000:2.0:1789785138.164028:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 91 00000100:00100000:2.0:1789785138.164048:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530109184:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785138.164093:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530109184:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 47us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785138.164100:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 91 00000100:00100000:2.0:1789785138.164114:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 92 00000100:00100000:2.0:1789785138.164120:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+6:2400:x1876725530109056:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785138.164145:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+6:2400:x1876725530109056:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 25us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785138.164152:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 92 00000100:00080000:3.0:1789785138.164561:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789785138.164567:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789785138.179021:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785138.500802:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf42f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549049728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789785138.500882:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785138.500930:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549049728 00000100:00100000:3.0:1789785138.500940:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549049728 00000100:00100000:3.0:1789785138.500996:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789785138.501006:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549049728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789785138.501039:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789785138.501087:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549049728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785138.501094:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789785138.501242:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf42f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549049728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789785138.502567:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789785138.502586:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549049984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789785138.502651:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785138.502705:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549049984 00000100:00100000:3.0:1789785138.502711:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549049984 00000100:00100000:3.0:1789785138.502767:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789785138.502777:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf453100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549049984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789785138.502810:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785138.502864:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf453100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549049984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785138.502872:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1789785138.502894:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789785138.502926:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf452680 x1876725549049984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785154 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785138.502946:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549049984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789785138.502994:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549049856:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789785138.503027:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785138.503177:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549049856 00000100:00100000:3.0:1789785138.503183:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549049856 00000100:00100000:3.0:1789785138.503271:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789785138.503280:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549049856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789785138.503294:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785138.503367:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549049856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785138.503374:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1789785138.503487:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789785138.503518:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf451500 x1876725549049856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785154 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785138.503537:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549049856:0@lo:13:osp-pre-0-1.0 00000001:00100000:1.0:1789785138.505186:0:8445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 026b2112-ee35-499c-8d01-18663664f08e 00000020:00000080:1.0:1789785138.505194:0:8445:0:(genops.c:885:class_export_put()) final put ffff9dae83735800/026b2112-ee35-499c-8d01-18663664f08e 00000020:00000080:1.0:1789785138.505218:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae83735800/026b2112-ee35-499c-8d01-18663664f08e for lustre-OST0000 00000020:00000080:1.0:1789785138.505274:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dae83733800 for lustre-OST0000 00000001:00100000:3.0:1789785138.505945:0:9529:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 026b2112-ee35-499c-8d01-18663664f08e 00000020:00000080:3.0:1789785138.505949:0:9529:0:(genops.c:885:class_export_put()) final put ffff9dae83732000/026b2112-ee35-499c-8d01-18663664f08e 00000020:00000080:1.0:1789785138.509083:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae83732000/026b2112-ee35-499c-8d01-18663664f08e for lustre-OST0001 00000020:00000080:1.0:1789785138.509131:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dae83737800 for lustre-OST0001 00000001:02000400:1.0:1789785138.883929:0:11137:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.110 00010000:00010000:0.0:1789785139.210556:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785140.227063:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785141.250541:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789785141.623923:0:11235:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.110 00000100:00100000:2.0:1789785142.082696:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb5ee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549050112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789785142.082807:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785142.082908:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549050112 00000100:00100000:2.0:1789785142.082918:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549050112 00000100:00100000:2.0:1789785142.082982:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789785142.082995:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549050112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789785142.083039:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789785142.083092:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549050112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785142.083102:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789785142.083166:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb5ee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549050112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789785142.085614:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1876725549050368:0@lo:400:kworker.0 00000100:00100000:2.0:1789785142.085707:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785142.085749:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1876725549050880:0@lo:400:kworker.0 00000100:00100000:2.0:1789785142.085797:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785142.085834:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1876725549051392:0@lo:400:kworker.0 00000100:00100000:2.0:1789785142.085868:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785142.085900:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789785142.086066:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549050368 00000100:00100000:3.0:1789785142.086077:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549050368 00000100:00100000:3.0:1789785142.086135:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549050880 00000100:00100000:3.0:1789785142.086138:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549050880 00000100:00100000:3.0:1789785142.086165:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549051392 00000100:00100000:3.0:1789785142.086168:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549051392 00000100:00100000:3.0:1789785142.086193:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789785142.086203:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1876725549050368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785142.086398:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549050240:0@lo:400:kworker.0 00000100:00100000:3.0:1789785142.086562:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1876725549050368:12345-0@lo:400:kworker.0 Request processed in 359us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785142.086572:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789785142.086600:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789785142.086607:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1876725549050880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785142.086643:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1876725549050880:12345-0@lo:400:kworker.0 Request processed in 36us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785142.086651:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789785142.086681:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789785142.086693:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1876725549051392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785142.086741:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1876725549051392:12345-0@lo:400:kworker.0 Request processed in 50us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785142.086750:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789785142.086779:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549050496:0@lo:400:kworker.0 00000100:00100000:3.0:1789785142.086818:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785142.086866:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549051008:0@lo:400:kworker.0 00000100:00100000:3.0:1789785142.086896:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785142.089976:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785142.090219:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1876725549050752:0@lo:400:kworker.0 00000100:00100000:2.0:1789785142.090288:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785142.090323:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1876725549051264:0@lo:400:kworker.0 00000100:00100000:2.0:1789785142.090373:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785142.090384:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549050752 00000100:00100000:0.0:1789785142.090400:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549050752 00000100:00100000:2.0:1789785142.090428:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1876725549050368:0@lo:400:kworker.0 00010000:00080000:2.0:1789785142.090449:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae81ea8380 x1876725549050880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785142.090460:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1876725549050880:0@lo:400:kworker.0 00010000:00080000:2.0:1789785142.090473:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafc1b39500 x1876725549051392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785142.090481:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1876725549051392:0@lo:400:kworker.0 00000100:00100000:2.0:1789785142.090531:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf42ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549051904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789785142.090558:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785142.090581:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789785142.090587:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb5ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549051776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789785142.090613:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785142.090653:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549051264 00000100:00100000:0.0:1789785142.090660:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549051264 00000100:00100000:2.0:1789785142.090669:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789785142.090942:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549051520:0@lo:400:kworker.0 00000100:00100000:3.0:1789785142.090969:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785142.091507:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789785142.091524:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876725549050624:0@lo:400:kworker.0 00000100:00100000:3.0:1789785142.091550:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785142.091562:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549051136:0@lo:400:kworker.0 00000100:00100000:1.0:1789785142.091568:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549051008 00000100:00100000:1.0:1789785142.091576:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549051008 00000100:00100000:3.0:1789785142.091583:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785142.091610:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549051648:0@lo:400:kworker.0 00000100:00100000:1.0:1789785142.091636:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549051520 00000100:00100000:3.0:1789785142.091637:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785142.091647:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549051520 00000100:00100000:1.0:1789785142.091670:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549051136 00000100:00100000:1.0:1789785142.091674:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549051136 00000100:00100000:3.0:1789785142.091682:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549051648 00000100:00100000:3.0:1789785142.091690:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549051648 00000100:00100000:1.0:1789785142.091701:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789785142.091718:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549051008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785142.091738:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789785142.091749:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf451880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549051520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785142.092899:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1876725549050752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785142.093045:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf451880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549051520:12345-0@lo:400:kworker.0 Request processed in 1296us (2071us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785142.093056:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789785142.093107:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789785142.093115:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549051136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785142.096097:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549050624 00000100:00100000:0.0:1789785142.096113:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549050624 00000100:00100000:0.0:1789785142.096162:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789785142.096174:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1876725549051264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785142.096286:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549051008:12345-0@lo:400:kworker.0 Request processed in 4572us (9386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785142.096297:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789785142.096320:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789785142.096328:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf452a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549051648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785142.096399:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf452a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549051648:12345-0@lo:400:kworker.0 Request processed in 73us (4767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785142.096413:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789785142.096455:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549050496 00000100:00100000:1.0:1789785142.096459:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549050496 00000100:00100000:1.0:1789785142.096499:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789785142.096506:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549050496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785142.096566:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549050496:12345-0@lo:400:kworker.0 Request processed in 61us (9748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785142.096572:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1789785142.096592:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789785142.096600:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789785142.096604:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789785142.096608:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789785142.096621:0:6533:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789785142.096631:0:6533:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1789785142.096878:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789785142.096886:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876725549050624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785142.096944:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876725549050624:12345-0@lo:400:kworker.0 Request processed in 60us (5392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785142.097937:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789785142.098761:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1876725549050752:12345-0@lo:400:kworker.0 Request processed in 5861us (8459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785142.098777:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789785142.098852:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549050240 00000100:00100000:2.0:1789785142.098866:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549050240 00000100:00100000:1.0:1789785142.098910:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549051904 00000100:00100000:1.0:1789785142.098926:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549051904 00000100:00100000:2.0:1789785142.099058:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789785142.099076:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:3662:x1876725549050240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785142.099155:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:3662:x1876725549050240:12345-0@lo:400:kworker.0 Request processed in 87us (9192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785142.099163:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1789785142.099167:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549051776 00000100:00100000:1.0:1789785142.099174:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549051776 00000100:00100000:1.0:1789785142.099214:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789785142.099224:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549051904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789785142.099263:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785142.099390:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549051904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (8829us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785142.099400:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1789785142.099467:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf42ed80 x1876725549051904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785142.099497:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf42ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549051904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789785142.099512:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549050240:0@lo:400:kworker.0 00000100:00100000:2.0:1789785142.099538:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1876725549050752:0@lo:400:kworker.0 00000100:00100000:3.0:1789785142.099688:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549051136:12345-0@lo:400:kworker.0 Request processed in 6571us (8102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785142.099700:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789785142.099759:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876725549050624:0@lo:400:kworker.0 00010000:00080000:3.0:1789785142.099773:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafc1b39180 x1876725549051136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785142.099782:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549051136:0@lo:400:kworker.0 00010000:00080000:3.0:1789785142.099795:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafc1b3ad80 x1876725549051648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785142.099804:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549051648:0@lo:400:kworker.0 00000100:00100000:3.0:1789785142.099818:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549050496:0@lo:400:kworker.0 00010000:00080000:3.0:1789785142.099834:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae81ea9c00 x1876725549051008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785142.099842:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549051008:0@lo:400:kworker.0 00010000:00080000:3.0:1789785142.099857:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafc1b38700 x1876725549051520/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785142.099866:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549051520:0@lo:400:kworker.0 00000100:00100000:0.0:1789785142.103142:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1876725549051264:12345-0@lo:400:kworker.0 Request processed in 6962us (12760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785142.103158:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789785142.103223:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1876725549051264:0@lo:400:kworker.0 00000100:00100000:3.0:1789785142.105711:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789785142.105759:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549051776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789785142.105816:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785142.106378:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549051776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 645us (15760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785142.106387:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1789785142.107369:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb5ee7800 x1876725549051776/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785142.107398:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb5ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549051776:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789785142.283873:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785143.275283:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785143.275324:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785143.275396:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785143.275485:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530109568 00000100:00100000:0.0:1789785143.275495:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530109568 00000100:00100000:0.0:1789785143.275560:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530109440 00000100:00100000:0.0:1789785143.275563:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530109440 00000100:00100000:0.0:1789785143.275586:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 99 00000100:00100000:0.0:1789785143.275596:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530109568:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785143.275662:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530109568:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 68us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785143.275670:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 99 00000100:00100000:0.0:1789785143.275693:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 100 00000100:00100000:0.0:1789785143.275700:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+6:2397:x1876725530109440:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785143.275723:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+6:2397:x1876725530109440:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 24us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785143.275729:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 100 00000100:00080000:1.0:1789785143.277314:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789785143.277322:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789785143.277587:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530109312 00000100:00100000:3.0:1789785143.277595:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530109312 00000100:00100000:3.0:1789785143.277651:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 282 00000100:00100000:3.0:1789785143.277659:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2397:x1876725530109312:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785143.277705:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2397:x1876725530109312:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 47us (2430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785143.277712:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 282 00010000:00010000:0.0:1789785143.298581:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785143.618614:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789785143.618638:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549052032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789785143.618716:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785143.619099:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf451c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549052160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789785143.619130:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785143.619167:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549052160 00000100:00100000:3.0:1789785143.619174:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549052160 00000100:00100000:3.0:1789785143.619214:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789785143.619223:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549052160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789785143.619251:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785143.619291:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549052160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785143.619298:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1789785143.619333:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf451c00 x1876725549052160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785159 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785143.619367:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf451c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549052160:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789785143.620119:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549052032 00000100:00100000:1.0:1789785143.620125:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549052032 00000100:00100000:1.0:1789785143.620170:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789785143.620178:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549052032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789785143.620201:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789785143.620245:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549052032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785143.620252:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789785143.620365:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb5ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549052288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789785143.620396:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785143.620572:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549052288 00000100:00100000:1.0:1789785143.620577:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549052288 00000100:00100000:1.0:1789785143.620609:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789785143.620615:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549052288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789785143.620627:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785143.620665:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549052288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785143.620670:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789785143.620819:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549052032:0@lo:41:osp-pre-0-1.0 00010000:00080000:0.0:1789785143.621001:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb5ee7800 x1876725549052288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785159 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785143.621016:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb5ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549052288:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789785144.325702:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789785145.088242:0:11333:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.110 00010000:00010000:0.0:1789785145.350300:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785146.372809:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789785147.032908:0:11381:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 18 22:32:24 EDT 2026 00000100:00100000:2.0:1789785147.202978:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549052416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789785147.203070:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785147.203157:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549052544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789785147.203205:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785147.203247:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549052416 00000100:00100000:2.0:1789785147.203256:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549052416 00000100:00100000:2.0:1789785147.203326:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789785147.203359:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549052416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789785147.203398:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785147.203468:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549052416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785147.203485:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789785147.203513:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549052544 00000100:00100000:2.0:1789785147.203517:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549052544 00000100:00100000:2.0:1789785147.203541:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789785147.203548:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549052544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789785147.203574:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789785147.203611:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549052544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785147.203618:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1789785147.203647:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789785147.203693:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549052544:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1789785147.203729:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafc1b38700 x1876725549052416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785147.203744:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549052416:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789785147.204035:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb5ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549052672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789785147.204073:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785147.204110:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549052672 00000100:00100000:0.0:1789785147.204115:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549052672 00000100:00100000:0.0:1789785147.204148:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789785147.204155:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549052672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789785147.204167:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785147.204201:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549052672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785147.204208:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1789785147.204225:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789785147.204242:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb5ee7800 x1876725549052672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785147.204273:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb5ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549052672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789785147.207309:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1876725549053184:0@lo:400:kworker.0 00000100:00100000:0.0:1789785147.207418:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785147.207474:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549053696:0@lo:400:kworker.0 00000100:00100000:0.0:1789785147.207511:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785147.207541:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789785147.207548:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549053056:0@lo:400:kworker.0 00000100:00100000:0.0:1789785147.207592:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785147.207613:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacaeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549053568:0@lo:400:kworker.0 00000100:00100000:0.0:1789785147.207647:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785147.207688:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549053184 00000100:00100000:0.0:1789785147.207697:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549053184 00000100:00100000:0.0:1789785147.207748:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789785147.207757:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1876725549053184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785147.207812:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1876725549053184:12345-0@lo:400:kworker.0 Request processed in 56us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785147.207820:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789785147.207846:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549053696 00000100:00100000:0.0:1789785147.207849:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549053696 00000100:00100000:0.0:1789785147.207882:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549053568 00000100:00100000:0.0:1789785147.207885:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549053568 00000100:00100000:0.0:1789785147.207905:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789785147.207911:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549053696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785147.207943:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549053696:12345-0@lo:400:kworker.0 Request processed in 32us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785147.207959:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789785147.207973:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789785147.207979:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549053568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785147.208008:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549053568:12345-0@lo:400:kworker.0 Request processed in 31us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785147.208014:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789785147.208034:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549053056 00000100:00100000:0.0:1789785147.208037:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549053056 00000100:00100000:0.0:1789785147.208061:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789785147.208068:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549053056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785147.208101:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549053056:12345-0@lo:400:kworker.0 Request processed in 34us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785147.208106:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1789785147.208138:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789785147.208178:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549053056:0@lo:400:kworker.0 00010000:00080000:0.0:1789785147.208192:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafacaeb800 x1876725549053568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785147.208202:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacaeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549053568:0@lo:400:kworker.0 00000100:00100000:0.0:1789785147.208212:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1876725549053184:0@lo:400:kworker.0 00010000:00080000:0.0:1789785147.208221:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafacae8380 x1876725549053696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785147.208230:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549053696:0@lo:400:kworker.0 00000100:00100000:2.0:1789785147.208904:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf451c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549052800:0@lo:400:kworker.0 00000100:00100000:2.0:1789785147.208958:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785147.209009:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1876725549053312:0@lo:400:kworker.0 00000100:00100000:2.0:1789785147.209054:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785147.209077:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1876725549053824:0@lo:400:kworker.0 00000100:00100000:2.0:1789785147.209099:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785147.209122:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789785147.209131:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725549052928:0@lo:400:kworker.0 00000100:00100000:2.0:1789785147.209158:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785147.209175:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725549053440:0@lo:400:kworker.0 00000100:00100000:2.0:1789785147.209197:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785147.209216:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549053952:0@lo:400:kworker.0 00000100:00100000:2.0:1789785147.209238:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785147.209269:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549053312 00000100:00100000:2.0:1789785147.209275:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549053312 00000100:00100000:2.0:1789785147.209310:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549053824 00000100:00100000:2.0:1789785147.209313:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549053824 00000100:00100000:2.0:1789785147.209330:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549052928 00000100:00100000:2.0:1789785147.209332:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549052928 00000100:00100000:2.0:1789785147.209369:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549053440 00000100:00100000:2.0:1789785147.209372:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549053440 00000100:00100000:2.0:1789785147.209386:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549053952 00000100:00100000:2.0:1789785147.209388:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549053952 00000100:00100000:2.0:1789785147.209406:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789785147.209415:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1876725549053312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785147.209596:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1876725549053312:12345-0@lo:400:kworker.0 Request processed in 180us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785147.209605:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789785147.209694:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789785147.209705:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1876725549053824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785147.209750:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1876725549053824:12345-0@lo:400:kworker.0 Request processed in 48us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785147.209757:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789785147.209774:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789785147.209782:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725549052928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785147.209812:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725549052928:12345-0@lo:400:kworker.0 Request processed in 31us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785147.209818:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789785147.209833:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789785147.209840:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725549053440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785147.209868:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725549053440:12345-0@lo:400:kworker.0 Request processed in 30us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785147.209874:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789785147.209884:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789785147.209890:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549053952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785147.209916:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549053952:12345-0@lo:400:kworker.0 Request processed in 26us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785147.209922:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789785147.209992:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725549052928:0@lo:400:kworker.0 00010000:00080000:2.0:1789785147.210009:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafaca24e00 x1876725549053440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785147.210022:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725549053440:0@lo:400:kworker.0 00010000:00080000:2.0:1789785147.210035:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafacae9500 x1876725549053952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785147.210057:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549053952:0@lo:400:kworker.0 00000100:00100000:2.0:1789785147.210073:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1876725549053312:0@lo:400:kworker.0 00000100:00100000:2.0:1789785147.210087:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1876725549053824:0@lo:400:kworker.0 00000100:00100000:0.0:1789785147.212778:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549052800 00000100:00100000:0.0:1789785147.212802:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549052800 00000100:00100000:0.0:1789785147.212886:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789785147.212896:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:3661:x1876725549052800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785147.213026:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:3661:x1876725549052800:12345-0@lo:400:kworker.0 Request processed in 129us (4066us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785147.213034:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00080000:0.0:1789785147.213109:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789785147.213116:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789785147.213157:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf451c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549052800:0@lo:400:kworker.0 00010000:00010000:3.0:1789785147.394957:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785148.397146:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785148.397211:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785148.397251:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785148.397287:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530109824 00000100:00100000:3.0:1789785148.397300:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530109824 00000100:00100000:3.0:1789785148.397390:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530109952 00000100:00100000:3.0:1789785148.397394:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530109952 00000100:00100000:3.0:1789785148.397424:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 107 00000100:00100000:3.0:1789785148.397436:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+6:2400:x1876725530109824:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785148.397546:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+6:2400:x1876725530109824:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 113us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785148.397555:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 107 00000100:00100000:3.0:1789785148.397575:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 108 00000100:00100000:3.0:1789785148.397582:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2399:x1876725530109952:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785148.397607:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2399:x1876725530109952:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 26us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785148.397614:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 108 00000100:00080000:3.0:1789785148.397632:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789785148.397637:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789785148.398260:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530109696 00000100:00100000:0.0:1789785148.398268:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530109696 00000100:00100000:0.0:1789785148.398314:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 284 00000100:00100000:0.0:1789785148.398322:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2399:x1876725530109696:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785148.398380:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2399:x1876725530109696:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 59us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785148.398387:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 284 00010000:00010000:0.0:1789785148.418563:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785148.738523:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789785148.738552:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549054080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789785148.738648:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785148.738742:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549054080 00000100:00100000:0.0:1789785148.738751:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549054080 00000100:00100000:0.0:1789785148.738806:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789785148.738815:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549054080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789785148.738853:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785148.738897:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549054080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785148.738922:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1789785148.738967:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3ead80 x1876725549054080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785164 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785148.738988:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549054080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789785148.740606:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789785148.740631:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549054336:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789785148.740694:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785148.740751:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549054336 00000100:00100000:1.0:1789785148.740757:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549054336 00000100:00100000:1.0:1789785148.740805:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789785148.740813:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549054336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789785148.740849:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789785148.740892:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549054336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785148.740914:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789785148.740937:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789785148.740945:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549054208:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789785148.740976:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785148.741005:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549054208 00000100:00100000:1.0:1789785148.741008:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549054208 00000100:00100000:1.0:1789785148.741032:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789785148.741038:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549054208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789785148.741053:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785148.741095:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549054208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785148.741102:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1789785148.741130:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafacae9500 x1876725549054208/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785164 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785148.741149:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549054208:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789785148.741174:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549054336:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789785149.456844:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785150.469438:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785151.492092:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785152.322565:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549054464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789785152.322704:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789785152.322725:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549054720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789785152.322788:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785152.322879:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785152.322942:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549054592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789785152.322971:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785152.323017:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549054464 00000100:00100000:1.0:1789785152.323027:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549054464 00000100:00100000:1.0:1789785152.323089:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549054592 00000100:00100000:1.0:1789785152.323092:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549054592 00000100:00100000:1.0:1789785152.323136:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789785152.323150:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549054464:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789785152.323169:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549054720 00000100:00100000:0.0:1789785152.323178:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549054720 00000100:00100000:0.0:1789785152.323235:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789785152.323245:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacaeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549054720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789785152.323276:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789785152.323328:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacaeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549054720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785152.323358:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789785152.323401:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789785152.323411:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549054592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789785152.323430:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785152.323478:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549054592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785152.323484:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1789785152.323522:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3ead80 x1876725549054592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785152.323539:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549054592:0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789785152.324517:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785152.324610:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549054464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1462us (1730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785152.324619:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1789785152.325520:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafaca24700 x1876725549054464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785152.325574:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549054464:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789785152.325892:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789785152.325923:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549054720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789785152.327062:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549054848:0@lo:400:kworker.0 00000100:00100000:3.0:1789785152.327134:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785152.327234:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549054848 00000100:00100000:0.0:1789785152.327240:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549054848 00000100:00100000:0.0:1789785152.327281:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789785152.327290:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:3660:x1876725549054848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785152.327302:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876725549055232:0@lo:400:kworker.0 00000100:00100000:1.0:1789785152.327329:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785152.334550:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549055232 00000100:00100000:1.0:1789785152.335678:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549055744:0@lo:400:kworker.0 00000100:00100000:1.0:1789785152.335747:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785152.335794:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789785152.335802:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549055360:0@lo:400:kworker.0 00000100:00100000:1.0:1789785152.335826:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785152.335851:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549055872:0@lo:400:kworker.0 00000100:00100000:1.0:1789785152.335871:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785152.335904:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549055360 00000100:00100000:1.0:1789785152.335910:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549055360 00000100:00100000:1.0:1789785152.335960:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549055872 00000100:00100000:1.0:1789785152.335963:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549055872 00000100:00100000:1.0:1789785152.335992:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789785152.336001:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549055360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785152.336053:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549055360:12345-0@lo:400:kworker.0 Request processed in 53us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785152.336061:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789785152.336079:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789785152.336085:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549055872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785152.336130:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549055872:12345-0@lo:400:kworker.0 Request processed in 45us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785152.336136:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1789785152.336157:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789785152.336183:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549055360:0@lo:400:kworker.0 00000100:00100000:1.0:1789785152.336194:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549055872:0@lo:400:kworker.0 00000100:00100000:1.0:1789785152.336234:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549055744 00000100:00100000:1.0:1789785152.336238:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549055744 00000100:00100000:1.0:1789785152.336277:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789785152.336284:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549055744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785152.336320:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549055744:12345-0@lo:400:kworker.0 Request processed in 37us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785152.336326:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1789785152.336368:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789785152.336386:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae828fc700 x1876725549055744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785152.336397:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549055744:0@lo:400:kworker.0 00000100:00100000:2.0:1789785152.337026:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549055232 00000100:00100000:2.0:1789785152.337056:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789785152.337063:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876725549055232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785152.337110:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876725549055232:12345-0@lo:400:kworker.0 Request processed in 47us (9780us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785152.337116:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789785152.337142:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549055104:0@lo:400:kworker.0 00000100:00100000:2.0:1789785152.337169:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785152.337186:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549055616:0@lo:400:kworker.0 00000100:00100000:2.0:1789785152.337205:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785152.337229:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789785152.337236:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1876725549054976:0@lo:400:kworker.0 00000100:00100000:2.0:1789785152.337257:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785152.337283:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1876725549055488:0@lo:400:kworker.0 00000100:00100000:2.0:1789785152.337301:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785152.337314:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1876725549056000:0@lo:400:kworker.0 00000100:00100000:2.0:1789785152.337329:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785152.337359:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549054976 00000100:00100000:2.0:1789785152.337369:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549054976 00000100:00100000:2.0:1789785152.337384:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549055488 00000100:00100000:2.0:1789785152.337386:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549055488 00000100:00100000:2.0:1789785152.337400:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549056000 00000100:00100000:2.0:1789785152.337402:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549056000 00000100:00100000:2.0:1789785152.337413:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789785152.337418:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf44b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1876725549054976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785152.337462:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf44b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1876725549054976:12345-0@lo:400:kworker.0 Request processed in 43us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785152.337468:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789785152.337478:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789785152.337484:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf44aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1876725549055488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785152.337511:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf44aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1876725549055488:12345-0@lo:400:kworker.0 Request processed in 28us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785152.337516:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789785152.337527:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789785152.337533:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf44bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1876725549056000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785152.337558:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf44bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1876725549056000:12345-0@lo:400:kworker.0 Request processed in 26us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785152.337564:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789785152.337590:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1876725549054976:0@lo:400:kworker.0 00010000:00080000:2.0:1789785152.337600:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae828fca80 x1876725549055488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785152.337603:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:3660:x1876725549054848:12345-0@lo:400:kworker.0 Request processed in 10313us (10468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785152.337610:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1876725549055488:0@lo:400:kworker.0 00000100:00100000:0.0:1789785152.337612:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00010000:00080000:2.0:1789785152.337618:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf448700 x1876725549056000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785152.337634:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549055616 00000100:00100000:2.0:1789785152.337636:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1876725549056000:0@lo:400:kworker.0 00000100:00100000:0.0:1789785152.337637:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549055616 00000100:00100000:0.0:1789785152.337670:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789785152.337678:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549055616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785152.337712:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549055616:12345-0@lo:400:kworker.0 Request processed in 35us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785152.337718:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1789785152.337744:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae828fed80 x1876725549055616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785152.337753:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549055616:0@lo:400:kworker.0 00000100:00100000:1.0:1789785152.341797:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549055104 00000100:00100000:1.0:1789785152.341812:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549055104 00000100:00100000:1.0:1789785152.341866:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789785152.341877:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf44b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549055104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785152.341982:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf44b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549055104:12345-0@lo:400:kworker.0 Request processed in 107us (4811us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785152.341988:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1789785152.342018:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789785152.342036:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789785152.342077:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876725549055232:0@lo:400:kworker.0 00000100:00100000:2.0:1789785152.343408:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549055104:0@lo:400:kworker.0 00000100:00100000:3.0:1789785152.343783:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549054848:0@lo:400:kworker.0 00010000:00010000:0.0:1789785152.516150:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785153.514594:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785153.514647:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785153.514679:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785153.514719:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530110208 00000100:00100000:3.0:1789785153.514731:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530110208 00000100:00100000:3.0:1789785153.514807:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530110336 00000100:00100000:3.0:1789785153.514812:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530110336 00000100:00100000:3.0:1789785153.514855:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 115 00000100:00100000:3.0:1789785153.514867:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+6:2399:x1876725530110208:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785153.514966:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+6:2399:x1876725530110208:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 101us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785153.514975:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 115 00000100:00100000:3.0:1789785153.514995:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 116 00000100:00100000:3.0:1789785153.515003:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+5:2399:x1876725530110336:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785153.515030:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+5:2399:x1876725530110336:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 28us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785153.515036:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 116 00000100:00100000:3.0:1789785153.515054:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530110080 00000100:00100000:3.0:1789785153.515058:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530110080 00000100:00100000:3.0:1789785153.515080:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 286 00000100:00100000:3.0:1789785153.515086:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2399:x1876725530110080:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785153.515109:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2399:x1876725530110080:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 23us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785153.515135:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 286 00000100:00080000:3.0:1789785153.515182:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789785153.515187:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789785153.539414:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785153.859534:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789785153.859556:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549056128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789785153.859627:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785153.859629:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549056256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789785153.859667:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785153.859715:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549056128 00000100:00100000:1.0:1789785153.859722:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549056128 00000100:00100000:1.0:1789785153.859776:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549056256 00000100:00100000:1.0:1789785153.859779:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549056256 00000100:00100000:1.0:1789785153.859797:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789785153.859808:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549056128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789785153.859843:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785153.859885:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549056128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785153.859892:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789785153.859909:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789785153.859915:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549056256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789785153.859926:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785153.859953:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549056256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785153.859960:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1789785153.859993:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83876d80 x1876725549056256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785169 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785153.860014:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549056256:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789785153.860045:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3ead80 x1876725549056128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785169 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785153.860071:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549056128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789785153.863705:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789785153.863726:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549056384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789785153.863786:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785153.863837:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549056384 00000100:00100000:1.0:1789785153.863844:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549056384 00000100:00100000:1.0:1789785153.863882:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789785153.863891:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549056384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789785153.863934:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789785153.863979:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549056384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785153.863987:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789785153.864033:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549056384:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789785154.562622:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785155.588117:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785156.611460:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785157.444611:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549056512:0@lo:400:kworker.0 00000100:00100000:0.0:1789785157.444678:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785157.444723:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549057024:0@lo:400:kworker.0 00000100:00100000:0.0:1789785157.444750:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785157.444777:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549057536:0@lo:400:kworker.0 00000100:00100000:0.0:1789785157.444800:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785157.444819:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549058048:0@lo:400:kworker.0 00000100:00100000:0.0:1789785157.444840:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785157.444865:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789785157.444872:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725549056640:0@lo:400:kworker.0 00000100:00100000:0.0:1789785157.444894:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785157.444912:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1876725549057152:0@lo:400:kworker.0 00000100:00100000:0.0:1789785157.444932:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785157.444958:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1876725549057664:0@lo:400:kworker.0 00000100:00100000:0.0:1789785157.444988:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785157.445005:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549058176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789785157.445027:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785157.445055:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549056768:0@lo:400:kworker.0 00000100:00100000:0.0:1789785157.445078:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785157.445095:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549057280:0@lo:400:kworker.0 00000100:00100000:0.0:1789785157.445112:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785157.445306:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1876725549057792:0@lo:400:kworker.0 00000100:00100000:0.0:1789785157.445329:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785157.445365:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789785157.445371:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876725549056896:0@lo:400:kworker.0 00000100:00100000:0.0:1789785157.445392:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785157.445412:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549057408:0@lo:400:kworker.0 00000100:00100000:0.0:1789785157.445433:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785157.445459:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549057920:0@lo:400:kworker.0 00000100:00100000:0.0:1789785157.445482:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785157.445509:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549056512 00000100:00100000:0.0:1789785157.445515:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549056512 00000100:00100000:0.0:1789785157.445557:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789785157.445566:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:3661:x1876725549056512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785157.445612:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:3661:x1876725549056512:12345-0@lo:400:kworker.0 Request processed in 47us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785157.445619:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789785157.445649:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549057024 00000100:00100000:0.0:1789785157.445653:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549057024 00000100:00100000:0.0:1789785157.445674:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549056768 00000100:00100000:0.0:1789785157.445677:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549056768 00000100:00100000:0.0:1789785157.445689:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789785157.445694:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549057024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785157.445728:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549057024:12345-0@lo:400:kworker.0 Request processed in 32us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785157.445734:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789785157.445746:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789785157.445752:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549056768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785157.445783:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549056768:12345-0@lo:400:kworker.0 Request processed in 31us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785157.445788:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789785157.445804:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549057536 00000100:00100000:0.0:1789785157.445807:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549057536 00000100:00100000:0.0:1789785157.445832:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549058048 00000100:00100000:0.0:1789785157.445836:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549058048 00000100:00100000:0.0:1789785157.445847:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549057408 00000100:00100000:0.0:1789785157.445857:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549057408 00000100:00100000:0.0:1789785157.445872:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549057920 00000100:00100000:0.0:1789785157.445874:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549057920 00000100:00100000:0.0:1789785157.445887:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789785157.445893:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf451c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549057536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785157.445923:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf451c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549057536:12345-0@lo:400:kworker.0 Request processed in 30us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785157.445929:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789785157.445941:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789785157.445948:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf453b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549058048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785157.445972:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf453b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549058048:12345-0@lo:400:kworker.0 Request processed in 25us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785157.445977:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789785157.445988:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789785157.445993:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549057408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785157.446019:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549057408:12345-0@lo:400:kworker.0 Request processed in 25us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785157.446024:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789785157.446035:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789785157.446041:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549057920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785157.446067:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549057920:12345-0@lo:400:kworker.0 Request processed in 26us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785157.446073:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789785157.446094:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549056640 00000100:00100000:0.0:1789785157.446098:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549056640 00000100:00100000:3.0:1789785157.446575:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549057664 00000100:00100000:3.0:1789785157.446580:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549057664 00000100:00100000:3.0:1789785157.446599:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549057280 00000100:00100000:3.0:1789785157.446602:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549057280 00000100:00100000:3.0:1789785157.446613:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549057792 00000100:00100000:3.0:1789785157.446615:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549057792 00000100:00100000:3.0:1789785157.446628:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549056896 00000100:00100000:3.0:1789785157.446631:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549056896 00000100:00100000:3.0:1789785157.446644:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789785157.446650:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725549056640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785157.446686:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725549056640:12345-0@lo:400:kworker.0 Request processed in 36us (1791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785157.446692:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789785157.446704:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789785157.446710:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1876725549057664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785157.446736:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1876725549057664:12345-0@lo:400:kworker.0 Request processed in 26us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785157.446741:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789785157.446753:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789785157.446759:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549057280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785157.446783:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549057280:12345-0@lo:400:kworker.0 Request processed in 25us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785157.446795:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789785157.446807:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789785157.446812:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876725549057792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785157.446843:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876725549057792:12345-0@lo:400:kworker.0 Request processed in 30us (1512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785157.446849:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789785157.446859:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789785157.446864:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876725549056896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785157.446889:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876725549056896:12345-0@lo:400:kworker.0 Request processed in 25us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785157.446895:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:3.0:1789785157.446924:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789785157.446927:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789785157.446930:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789785157.446932:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789785157.447686:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549058432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789785157.447724:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785157.447753:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789785157.447759:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549058304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789785157.447780:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785157.447806:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549058176 00000100:00100000:2.0:1789785157.447811:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549058176 00000100:00100000:2.0:1789785157.447839:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549058432 00000100:00100000:2.0:1789785157.447841:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549058432 00000100:00100000:2.0:1789785157.447854:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789785157.447861:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549058176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789785157.447881:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785157.447911:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549058176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (2884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785157.447917:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789785157.447929:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789785157.447936:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf44a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549058432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789785157.447944:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785157.447970:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf44a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549058432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785157.447976:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1789785157.448021:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf448700 x1876725549058432/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785157.448039:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549058432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789785157.448060:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549058304 00000100:00100000:2.0:1789785157.448063:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549058304 00000100:00100000:2.0:1789785157.448081:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789785157.448087:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549058304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789785157.448108:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789785157.448164:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549058304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785157.448170:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789785157.448264:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549058304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789785157.450305:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549057152 00000100:00100000:0.0:1789785157.450317:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549057152 00000100:00100000:0.0:1789785157.450718:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789785157.450727:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1876725549057152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785157.450795:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1876725549057152:12345-0@lo:400:kworker.0 Request processed in 69us (5861us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785157.450802:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789785157.450868:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876725549056896:0@lo:400:kworker.0 00010000:00080000:0.0:1789785157.450883:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3e8380 x1876725549057408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785157.450894:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549057408:0@lo:400:kworker.0 00010000:00080000:0.0:1789785157.450906:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3ea680 x1876725549057920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785157.450914:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549057920:0@lo:400:kworker.0 00000100:00100000:0.0:1789785157.450925:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549056768:0@lo:400:kworker.0 00010000:00080000:0.0:1789785157.450935:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3e8700 x1876725549057280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785157.450943:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549057280:0@lo:400:kworker.0 00010000:00080000:0.0:1789785157.450955:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3e9500 x1876725549057792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785157.450962:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1876725549057792:0@lo:400:kworker.0 00000100:00100000:0.0:1789785157.451006:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725549056640:0@lo:400:kworker.0 00000100:00100000:0.0:1789785157.451017:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1876725549057152:0@lo:400:kworker.0 00000100:00100000:0.0:1789785157.451027:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1876725549057664:0@lo:400:kworker.0 00010000:00080000:0.0:1789785157.451050:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3eb800 x1876725549058176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785157.451065:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549058176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789785157.451076:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549056512:0@lo:400:kworker.0 00000100:00100000:0.0:1789785157.451086:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549057024:0@lo:400:kworker.0 00010000:00080000:0.0:1789785157.451098:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3eb480 x1876725549057536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785157.451106:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549057536:0@lo:400:kworker.0 00010000:00080000:0.0:1789785157.451134:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3eb100 x1876725549058048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785157.451142:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549058048:0@lo:400:kworker.0 00000100:00080000:2.0:1789785157.452313:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789785157.634586:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785158.635716:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785158.635760:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785158.635799:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785158.635836:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530110464 00000100:00100000:3.0:1789785158.635846:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530110464 00000100:00100000:3.0:1789785158.635894:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 288 00000100:00100000:3.0:1789785158.635903:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2400:x1876725530110464:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785158.635983:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2400:x1876725530110464:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 80us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785158.635991:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 288 00000100:00100000:3.0:1789785158.636020:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530110592 00000100:00100000:3.0:1789785158.636029:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530110592 00000100:00100000:3.0:1789785158.636063:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530110720 00000100:00100000:3.0:1789785158.636066:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530110720 00000100:00100000:3.0:1789785158.636086:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 123 00000100:00100000:3.0:1789785158.636093:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+6:2400:x1876725530110592:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785158.636134:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+6:2400:x1876725530110592:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 41us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785158.636141:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 123 00000100:00100000:3.0:1789785158.636373:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 124 00000100:00100000:3.0:1789785158.636382:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530110720:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785158.636419:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530110720:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 39us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785158.636425:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 124 00000100:00080000:3.0:1789785158.636540:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789785158.636544:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789785158.659510:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785158.979490:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789785158.979521:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549058560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789785158.979544:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789785158.979553:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549058688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789785158.979584:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785158.979584:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785158.979675:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789785158.979684:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549058816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789785158.983502:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549058688 00000100:00100000:0.0:1789785158.983517:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549058688 00000100:00100000:0.0:1789785158.983568:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789785158.983578:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549058688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789785158.983606:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785158.983672:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549058688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (4087us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785158.983680:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1789785158.983733:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf4a1c00 x1876725549058688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785174 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785158.983755:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549058688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789785158.986047:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549058560 00000100:00100000:0.0:1789785158.986057:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549058560 00000100:00100000:0.0:1789785158.986107:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789785158.986116:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549058560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789785158.986148:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789785158.986209:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549058560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (6625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785158.986228:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789785158.991518:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785158.991598:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549058816 00000100:00100000:0.0:1789785158.991607:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549058816 00000100:00100000:0.0:1789785158.991669:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789785158.991679:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549058816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789785158.991707:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785158.991757:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549058816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785158.991764:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1789785158.991961:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83980700 x1876725549058816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785174 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785158.991981:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549058816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789785158.996411:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549058560:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789785159.692574:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785160.708938:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785161.731658:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785162.565196:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549059072:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789785162.565200:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549058944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789785162.570835:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549059200:0@lo:400:kworker.0 00000100:00100000:3.0:1789785162.578850:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785162.578850:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785162.578921:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549059584:0@lo:400:kworker.0 00000100:00100000:3.0:1789785162.578944:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549059328:0@lo:400:kworker.0 00000100:00100000:2.0:1789785162.578965:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785162.578986:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549059456:0@lo:400:kworker.0 00000100:00100000:2.0:1789785162.578997:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549059584 00000100:00100000:2.0:1789785162.579004:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549059584 00000100:00100000:3.0:1789785162.579007:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785162.579027:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549058944 00000100:00100000:3.0:1789785162.579030:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549058944 00000100:00100000:2.0:1789785162.579047:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789785162.579051:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549059456 00000100:00100000:3.0:1789785162.579053:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549059456 00000100:00100000:2.0:1789785162.579055:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549059584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785162.579064:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789785162.579103:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549059584:12345-0@lo:400:kworker.0 Request processed in 48us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785162.579112:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789785162.579138:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785162.579168:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549059840:0@lo:400:kworker.0 00000100:00100000:2.0:1789785162.579205:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785162.579213:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549058944:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789785162.579229:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549060352:0@lo:400:kworker.0 00000004:00000024:3.0:1789785162.579240:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789785162.579247:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785162.579263:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549060864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789785162.579270:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549058944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 200us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785162.579277:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789785162.579285:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785162.579291:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789785162.579297:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549059456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785162.579517:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549059328 00000100:00100000:2.0:1789785162.579521:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549059328 00000100:00100000:2.0:1789785162.579546:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549059840 00000100:00100000:2.0:1789785162.579549:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549059840 00000100:00100000:1.0:1789785162.579605:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785162.579637:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549059712:0@lo:400:kworker.0 00000100:00100000:2.0:1789785162.579646:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549060352 00000100:00100000:2.0:1789785162.579651:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549060352 00000100:00100000:1.0:1789785162.579672:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785162.579676:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789785162.579684:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549059328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785162.579693:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549060224:0@lo:400:kworker.0 00000100:00100000:2.0:1789785162.579729:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549059328:12345-0@lo:400:kworker.0 Request processed in 45us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785162.579730:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785162.579740:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789785162.579757:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789785162.579765:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549059840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785162.579767:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549060224 00000100:00100000:1.0:1789785162.579779:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549060224 00000100:00100000:2.0:1789785162.579795:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549059840:12345-0@lo:400:kworker.0 Request processed in 32us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785162.579802:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789785162.579817:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789785162.579821:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789785162.579826:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549060352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785162.579835:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549060224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785162.579857:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549060352:12345-0@lo:400:kworker.0 Request processed in 33us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785162.579874:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789785162.579876:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549059456:12345-0@lo:400:kworker.0 Request processed in 39us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785162.579882:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549060224:12345-0@lo:400:kworker.0 Request processed in 50us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785162.579888:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789785162.579895:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549059072 00000100:00100000:1.0:1789785162.579895:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789785162.579899:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549059712 00000100:00100000:2.0:1789785162.579901:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549059072 00000100:00100000:3.0:1789785162.579903:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549059712 00000100:00100000:3.0:1789785162.579921:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789785162.579923:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549060864 00000100:00100000:2.0:1789785162.579925:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549060864 00000100:00100000:3.0:1789785162.579928:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549059712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785162.579940:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789785162.579945:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549059072:12345-0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789785162.579952:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf4a0e00 x1876725549060224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785162.579959:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549059712:12345-0@lo:400:kworker.0 Request processed in 31us (288us total) trans 0 rc 0/0 00002000:00000024:2.0:1789785162.579962:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785162.579971:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789785162.579974:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549060224:0@lo:400:kworker.0 00000100:00100000:1.0:1789785162.579985:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549060736:0@lo:400:kworker.0 00000100:00100000:2.0:1789785162.579993:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549059072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785162.579999:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789785162.580012:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789785162.580016:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785162.580023:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549060864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789785162.580033:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785162.580048:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549060736 00000100:00100000:1.0:1789785162.580053:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549060736 00000100:00100000:2.0:1789785162.580060:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1876725549060864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785162.580067:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789785162.580083:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789785162.580093:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549060736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785162.580102:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549059328:0@lo:400:kworker.0 00000100:00100000:2.0:1789785162.580116:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549059840:0@lo:400:kworker.0 00000100:00100000:2.0:1789785162.580130:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549060352:0@lo:400:kworker.0 00000100:00100000:1.0:1789785162.580137:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549060736:12345-0@lo:400:kworker.0 Request processed in 43us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785162.580145:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1789785162.580153:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83876d80 x1876725549060864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1789785162.580174:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3e9c00 x1876725549060736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785162.580184:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549060736:0@lo:400:kworker.0 00000100:00100000:1.0:1789785162.580207:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549059712:0@lo:400:kworker.0 00000100:00100000:2.0:1789785162.580232:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549060864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789785162.580290:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549059584:0@lo:400:kworker.0 00000100:00100000:2.0:1789785162.580304:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549060096:0@lo:400:kworker.0 00000100:00100000:2.0:1789785162.580328:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785162.580537:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549059200 00000100:00100000:3.0:1789785162.580542:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549059200 00000100:00100000:3.0:1789785162.580567:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789785162.580580:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:3662:x1876725549059200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785162.580617:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:3662:x1876725549059200:12345-0@lo:400:kworker.0 Request processed in 38us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785162.580623:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00080000:3.0:1789785162.580646:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789785162.580650:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789785162.580652:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789785162.580682:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549060096 00000100:00100000:1.0:1789785162.580688:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549060096 00000100:00080000:3.0:1789785162.580728:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789785162.580729:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789785162.580744:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549060096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785162.580778:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549060096:12345-0@lo:400:kworker.0 Request processed in 35us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785162.580783:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789785162.580809:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549059200:0@lo:400:kworker.0 00010000:00080000:2.0:1789785162.580854:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf4a3480 x1876725549060096/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785162.580864:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549060096:0@lo:400:kworker.0 00000100:00100000:2.0:1789785162.580870:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549060608:0@lo:400:kworker.0 00000100:00100000:2.0:1789785162.580893:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789785162.580923:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafaca24700 x1876725549059072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785162.580936:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549059072:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789785162.581023:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549060608 00000100:00100000:1.0:1789785162.581027:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549060608 00000100:00100000:1.0:1789785162.581057:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789785162.581064:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549060608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785162.581104:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549060608:12345-0@lo:400:kworker.0 Request processed in 40us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785162.581110:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1789785162.581133:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3e9f80 x1876725549060608/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785162.581144:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549060608:0@lo:400:kworker.0 00000100:00100000:3.0:1789785162.581230:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549059456:0@lo:400:kworker.0 00000100:00100000:3.0:1789785162.581238:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549059968:0@lo:400:kworker.0 00000100:00100000:3.0:1789785162.581261:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785162.581283:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549059968 00000100:00100000:3.0:1789785162.581286:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549059968 00000100:00100000:3.0:1789785162.581314:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789785162.581321:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1876725549059968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785162.581382:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1876725549059968:12345-0@lo:400:kworker.0 Request processed in 61us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785162.581389:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:2.0:1789785162.581445:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf4a0380 x1876725549059968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785162.581455:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549059968:0@lo:400:kworker.0 00000100:00100000:2.0:1789785162.581461:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1876725549060480:0@lo:400:kworker.0 00000100:00100000:2.0:1789785162.581482:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785162.581508:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549058944:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1789785162.581548:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789785162.581559:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549060480 00000100:00100000:3.0:1789785162.581563:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549060480 00000100:00100000:3.0:1789785162.581603:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789785162.581609:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1876725549060480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785162.581650:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1876725549060480:12345-0@lo:400:kworker.0 Request processed in 41us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785162.581656:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00010000:00080000:1.0:1789785162.581985:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3eb480 x1876725549060480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785162.581996:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1876725549060480:0@lo:400:kworker.0 00000100:00080000:2.0:1789785162.581999:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789785162.754921:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785163.756625:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785163.756664:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785163.756697:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785163.756779:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530111104 00000100:00100000:2.0:1789785163.756788:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530111104 00000100:00100000:2.0:1789785163.756858:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530110976 00000100:00100000:2.0:1789785163.756861:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530110976 00000100:00100000:2.0:1789785163.756879:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 131 00000100:00100000:2.0:1789785163.756889:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530111104:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785163.756953:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530111104:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 66us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785163.756972:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 131 00000100:00100000:2.0:1789785163.756987:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 132 00000100:00100000:2.0:1789785163.756994:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+6:2400:x1876725530110976:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785163.757017:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+6:2400:x1876725530110976:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 23us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785163.757023:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 132 00000100:00080000:0.0:1789785163.757179:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789785163.757184:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789785163.757449:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530110848 00000100:00100000:3.0:1789785163.757454:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530110848 00000100:00100000:3.0:1789785163.757502:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 290 00000100:00100000:3.0:1789785163.757509:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2400:x1876725530110848:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785163.757534:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2400:x1876725530110848:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 27us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785163.757541:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 290 00010000:00010000:3.0:1789785163.778931:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785164.098632:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789785164.098656:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549060992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789785164.098727:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785164.099498:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549060992 00000100:00100000:0.0:1789785164.099507:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549060992 00000100:00100000:1.0:1789785164.099619:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789785164.099632:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549061120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789785164.099671:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785164.099853:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549061120 00000100:00100000:3.0:1789785164.099857:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549061120 00000100:00100000:3.0:1789785164.099908:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789785164.099917:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549061120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789785164.099948:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789785164.100009:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549061120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785164.100016:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789785164.100048:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789785164.100057:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549061248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789785164.100083:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785164.100119:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549061248 00000100:00100000:3.0:1789785164.100123:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549061248 00000100:00100000:1.0:1789785164.100190:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549061120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789785164.103845:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789785164.103873:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549060992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789785164.103911:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785164.104013:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549060992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 157us (5284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785164.104021:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1789785164.104079:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83980700 x1876725549060992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785180 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785164.104099:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549060992:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789785164.108607:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789785164.108828:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789785164.108841:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549061248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789785164.108867:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785164.109244:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549061248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 404us (9158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785164.109252:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1789785164.109389:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf446300 x1876725549061248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785180 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785164.109410:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549061248:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789785164.802646:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789785165.316845:0:12011:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 22:32:42 (1789785162) === 00010000:00010000:3.0:1789785165.828370:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785165.876065:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785165.878247:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530111232 00000100:00100000:3.0:1789785165.878264:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530111232 00000100:00100000:3.0:1789785165.878335:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 291 00000100:00100000:3.0:1789785165.878382:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+10:8726:x1876725530111232:12345-192.168.203.46@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789785165.878400:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785165.878429:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc2050000/0x2f18ee3fd845c377 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8567 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785165.878458:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc2050000/0x2f18ee3fd845c377 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8567 expref: 11 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785165.878470:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc2050000/0x2f18ee3fd845c377 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8567 expref: 11 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785165.878479:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc2050000, rc 0) 00000100:00100000:3.0:1789785165.878549:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+11:8726:x1876725530111232:12345-192.168.203.46@tcp:101:mount.lustre.0 Request processed in 169us (2493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785165.878556:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 291 00000100:00100000:3.0:1789785165.896787:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785165.900898:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530111360 00000100:00100000:0.0:1789785165.900919:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530111360 00000100:00100000:0.0:1789785165.901094:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 292 00000100:00100000:0.0:1789785165.901107:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+11:8726:x1876725530111360:12345-192.168.203.46@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789785165.901372:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+11:8726:x1876725530111360:12345-192.168.203.46@tcp:501:mount.lustre.0 Request processed in 267us (4657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785165.901382:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 292 00000100:00100000:1.0:1789785165.907300:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785165.907548:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530111488 00000100:00100000:3.0:1789785165.907561:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530111488 00000100:00100000:3.0:1789785165.907629:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 293 00000100:00100000:3.0:1789785165.907640:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+11:8726:x1876725530111488:12345-192.168.203.46@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789785165.907837:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+11:8726:x1876725530111488:12345-192.168.203.46@tcp:503:mount.lustre.0 Request processed in 198us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785165.907847:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 293 00000100:00100000:1.0:1789785165.913252:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785165.918257:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530111616 00000100:00100000:3.0:1789785165.918930:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530111616 00000100:00100000:2.0:1789785165.919150:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 294 00000100:00100000:2.0:1789785165.919163:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+11:8730:x1876725530111616:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789785165.919686:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+11:8730:x1876725530111616:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 522us (6446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785165.919696:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 294 00000100:00100000:2.0:1789785165.964814:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785165.964933:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530111744 00000100:00100000:0.0:1789785165.964946:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530111744 00000100:00100000:0.0:1789785165.965015:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 295 00000100:00100000:0.0:1789785165.965028:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+11:8730:x1876725530111744:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789785165.967726:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+11:8730:x1876725530111744:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 2682us (2907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785165.967767:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 295 00000100:00100000:0.0:1789785165.983434:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785165.984186:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530111872 00000100:00100000:1.0:1789785165.984200:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530111872 00000100:00100000:1.0:1789785165.984264:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 296 00000100:00100000:1.0:1789785165.984276:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+11:8730:x1876725530111872:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789785165.985066:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+11:8730:x1876725530111872:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 786us (1641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785165.985078:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 296 00000100:00100000:1.0:1789785165.988071:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785165.988185:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530112000 00000100:00100000:0.0:1789785165.988199:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530112000 00000100:00100000:0.0:1789785165.988269:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 297 00000100:00100000:0.0:1789785165.988281:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+11:8726:x1876725530112000:12345-192.168.203.46@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789785165.988304:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785165.988328:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dae81ead600/0x2f18ee3fd845c37e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8598 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785165.988415:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dae81ead600/0x2f18ee3fd845c37e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8598 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785165.988428:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dae81ead600/0x2f18ee3fd845c37e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8598 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785165.988449:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81ead600, rc 0) 00000100:00100000:0.0:1789785165.988527:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+12:8726:x1876725530112000:12345-192.168.203.46@tcp:101:mount.lustre.0 Request processed in 248us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785165.988535:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 297 00000100:00100000:3.0:1789785165.992648:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785165.992848:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530112128 00000100:00100000:2.0:1789785165.992862:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530112128 00000100:00100000:2.0:1789785165.992935:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 298 00000100:00100000:2.0:1789785165.992946:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+12:8726:x1876725530112128:12345-192.168.203.46@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789785165.992980:0:6526:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789785165.993013:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789785165.993018:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789785165.993021:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789785165.993024:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789785165.993027:0:6526:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789785165.996783:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+12:8726:x1876725530112128:12345-192.168.203.46@tcp:256:mount.lustre.0 Request processed in 3822us (4134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785165.996803:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 298 00000100:00100000:1.0:1789785166.001422:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785166.001715:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530112256 00000100:00100000:3.0:1789785166.001739:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530112256 00000100:00100000:3.0:1789785166.001804:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 299 00000100:00100000:3.0:1789785166.001816:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+12:8726:x1876725530112256:12345-192.168.203.46@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789785166.001837:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785166.001859:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc2051a00/0x2f18ee3fd845c385 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd859f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785166.001895:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc2051a00/0x2f18ee3fd845c385 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd859f expref: 13 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785166.001908:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc2051a00/0x2f18ee3fd845c385 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd859f expref: 13 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785166.001919:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc2051a00, rc 0) 00000100:00100000:3.0:1789785166.002053:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:8726:x1876725530112256:12345-192.168.203.46@tcp:101:mount.lustre.0 Request processed in 239us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785166.002071:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 299 00000100:00100000:0.0:1789785166.004926:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785166.005126:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530112384 00000100:00100000:2.0:1789785166.005139:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530112384 00000100:00100000:2.0:1789785166.005208:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 300 00000100:00100000:2.0:1789785166.005220:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+13:8726:x1876725530112384:12345-192.168.203.46@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789785166.005820:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+13:8726:x1876725530112384:12345-192.168.203.46@tcp:501:mount.lustre.0 Request processed in 599us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785166.005830:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 300 00000100:00100000:2.0:1789785166.008109:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785166.008210:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530112512 00000100:00100000:0.0:1789785166.008222:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530112512 00000100:00100000:0.0:1789785166.008284:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 301 00000100:00100000:0.0:1789785166.008313:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+13:8726:x1876725530112512:12345-192.168.203.46@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789785166.008664:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+13:8726:x1876725530112512:12345-192.168.203.46@tcp:503:mount.lustre.0 Request processed in 352us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785166.008674:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 301 00000100:00100000:1.0:1789785166.011927:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785166.012538:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530112640 00000100:00100000:3.0:1789785166.012551:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530112640 00000100:00100000:3.0:1789785166.012612:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 302 00000100:00100000:3.0:1789785166.012623:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:8735:x1876725530112640:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789785166.012820:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:8735:x1876725530112640:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 198us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785166.012828:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 302 00000100:00100000:1.0:1789785166.015739:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785166.015893:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530112768 00000100:00100000:2.0:1789785166.015905:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530112768 00000100:00100000:2.0:1789785166.015976:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 303 00000100:00100000:2.0:1789785166.015988:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+13:8735:x1876725530112768:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789785166.016191:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+13:8735:x1876725530112768:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 204us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785166.016200:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 303 00000100:00100000:2.0:1789785166.023321:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785166.023521:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785166.023640:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530113536 00000100:00100000:0.0:1789785166.023654:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530113536 00000100:00100000:0.0:1789785166.023754:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530113664 00000100:00100000:0.0:1789785166.023759:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530113664 00000100:00100000:0.0:1789785166.023794:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 133 00000100:00100000:0.0:1789785166.023807:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+6:2398:x1876725530113536:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785166.023904:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+6:2398:x1876725530113536:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 100us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785166.023912:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 133 00000100:00100000:0.0:1789785166.023930:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 134 00000100:00100000:0.0:1789785166.023936:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530113664:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785166.023961:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530113664:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 25us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785166.023967:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 134 00000100:00080000:2.0:1789785166.025406:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789785166.025417:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789785166.025889:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785166.025927:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785166.026457:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530112896 00000100:00100000:0.0:1789785166.026470:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530112896 00000100:00100000:0.0:1789785166.026523:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530113152 00000100:00100000:0.0:1789785166.026527:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530113152 00000100:00100000:0.0:1789785166.026554:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:0.0:1789785166.026564:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1876725530112896:12345-192.168.203.46@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789785166.026606:0:6533:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 12a32a3b-e9e7-466a-b40d-7d74895946de@192.168.203.46@tcp t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:0.0:1789785166.026674:0:6533:0:(genops.c:1385:class_connect()) connect: client 12a32a3b-e9e7-466a-b40d-7d74895946de, cookie 0x2f18ee3fd845c38c 00000004:00100000:0.0:1789785166.026710:0:6533:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789785166.026875:0:6533:0:(import.c:65:import_set_state_nolock()) ffff9dae836f8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789785166.026957:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+6:2396:x1876725530112896:12345-192.168.203.46@tcp:38:mount.lustre.0 Request processed in 392us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785166.026966:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:0.0:1789785166.026986:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:0.0:1789785166.026991:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1876725530113152:12345-192.168.203.46@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789785166.027008:0:6533:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 12a32a3b-e9e7-466a-b40d-7d74895946de@192.168.203.46@tcp t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:0.0:1789785166.027031:0:6533:0:(genops.c:1385:class_connect()) connect: client 12a32a3b-e9e7-466a-b40d-7d74895946de, cookie 0x2f18ee3fd845c393 00000004:00100000:0.0:1789785166.027045:0:6533:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789785166.027117:0:6533:0:(import.c:65:import_set_state_nolock()) ffff9dae836fc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789785166.027143:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+6:2396:x1876725530113152:12345-192.168.203.46@tcp:38:mount.lustre.0 Request processed in 150us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785166.027150:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:1.0:1789785166.030410:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785166.030532:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785166.030921:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530113280 00000100:00100000:3.0:1789785166.030951:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530113280 00000100:00100000:3.0:1789785166.031045:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530113024 00000100:00100000:3.0:1789785166.031049:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530113024 00000100:00100000:3.0:1789785166.031095:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 18 00000100:00100000:3.0:1789785166.031107:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12a32a3b-e9e7-466a-b40d-7d74895946de+6:0:x1876725530113280:12345-192.168.203.46@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789785166.031157:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789785166.031258:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12a32a3b-e9e7-466a-b40d-7d74895946de+6:0:x1876725530113280:12345-192.168.203.46@tcp:41:mount.lustre.0 Request processed in 152us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785166.031266:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 18 00000100:00100000:3.0:1789785166.031286:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:3.0:1789785166.031293:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12a32a3b-e9e7-466a-b40d-7d74895946de+6:0:x1876725530113024:12345-192.168.203.46@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789785166.031310:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789785166.031385:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12a32a3b-e9e7-466a-b40d-7d74895946de+6:0:x1876725530113024:12345-192.168.203.46@tcp:41:mount.lustre.0 Request processed in 93us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785166.031393:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00080000:2.0:1789785166.033613:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789785166.033628:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789785166.045733:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785166.045917:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530113408 00000100:00100000:3.0:1789785166.045929:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530113408 00000100:00100000:3.0:1789785166.046009:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 20 00000100:00100000:3.0:1789785166.046021:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb53ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12a32a3b-e9e7-466a-b40d-7d74895946de+6:8726:x1876725530113408:12345-192.168.203.46@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789785166.046072:0:11254:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789785166.046167:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb53ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12a32a3b-e9e7-466a-b40d-7d74895946de+6:8726:x1876725530113408:12345-192.168.203.46@tcp:41:mount.lustre.0 Request processed in 147us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785166.046176:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 20 00000100:00100000:1.0:1789785166.049552:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785166.049720:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530113792 00000100:00100000:3.0:1789785166.049743:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530113792 00000100:00100000:3.0:1789785166.049817:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 21 00000100:00100000:3.0:1789785166.049848:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+6:8726:x1876725530113792:12345-192.168.203.46@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789785166.049961:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+6:8726:x1876725530113792:12345-192.168.203.46@tcp:40:mount.lustre.0 Request processed in 116us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785166.049968:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 21 00000100:00100000:1.0:1789785166.054199:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785166.054257:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785166.054298:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785166.054594:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530113920 00000100:00100000:0.0:1789785166.054606:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530113920 00000100:00100000:0.0:1789785166.054657:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530114048 00000100:00100000:0.0:1789785166.054661:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530114048 00000100:00100000:0.0:1789785166.054688:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 20 00000100:00100000:0.0:1789785166.054699:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2396:x1876725530113920:12345-192.168.203.46@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789785166.054754:0:8450:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 12a32a3b-e9e7-466a-b40d-7d74895946de@192.168.203.46@tcp t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:0.0:1789785166.054799:0:8450:0:(genops.c:1385:class_connect()) connect: client 12a32a3b-e9e7-466a-b40d-7d74895946de, cookie 0x2f18ee3fd845c39a 00002000:00100000:0.0:1789785166.054815:0:8450:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 12a32a3b-e9e7-466a-b40d-7d74895946de/ffff9dae836fb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789785166.054839:0:8450:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789785166.054960:0:8450:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789785166.055004:0:8450:0:(import.c:65:import_set_state_nolock()) ffff9dae836f9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789785166.055104:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12a32a3b-e9e7-466a-b40d-7d74895946de+6:2396:x1876725530113920:12345-192.168.203.46@tcp:8:mount.lustre.0 Request processed in 404us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785166.055113:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 20 00000100:00100000:0.0:1789785166.055134:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 21 00000100:00100000:0.0:1789785166.055138:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2396:x1876725530114048:12345-192.168.203.46@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789785166.055156:0:8450:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 12a32a3b-e9e7-466a-b40d-7d74895946de@192.168.203.46@tcp t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:0.0:1789785166.055174:0:8450:0:(genops.c:1385:class_connect()) connect: client 12a32a3b-e9e7-466a-b40d-7d74895946de, cookie 0x2f18ee3fd845c3a1 00002000:00100000:0.0:1789785166.055180:0:8450:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 12a32a3b-e9e7-466a-b40d-7d74895946de/ffff9dae836fc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789785166.055193:0:8450:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789785166.055235:0:8450:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789785166.055250:0:8450:0:(import.c:65:import_set_state_nolock()) ffff9dae836fb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789785166.055277:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12a32a3b-e9e7-466a-b40d-7d74895946de+6:2396:x1876725530114048:12345-192.168.203.46@tcp:8:mount.lustre.0 Request processed in 137us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785166.055283:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 21 00000100:00100000:3.0:1789785166.056427:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530114176 00000100:00100000:3.0:1789785166.056456:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530114176 00000100:00100000:3.0:1789785166.056514:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:3.0:1789785166.056523:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:12a32a3b-e9e7-466a-b40d-7d74895946de+6:8726:x1876725530114176:12345-192.168.203.46@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789785166.056598:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:12a32a3b-e9e7-466a-b40d-7d74895946de+6:8726:x1876725530114176:12345-192.168.203.46@tcp:900:mount.lustre.0 Request processed in 75us (2414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785166.056606:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:1.0:1789785166.063495:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785166.063671:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530114304 00000100:00100000:0.0:1789785166.063685:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530114304 00000100:00100000:0.0:1789785166.063773:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 1 00000100:00100000:0.0:1789785166.063785:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+6:8726:x1876725530114304:12345-192.168.203.46@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789785166.063906:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789785166.064013:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+6:8726:x1876725530114304:12345-192.168.203.46@tcp:33:mount.lustre.0 Request processed in 230us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785166.064022:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 1 00010000:00010000:3.0:1789785166.850962:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785167.683488:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549061376:0@lo:400:kworker.0 00000100:00100000:3.0:1789785167.683561:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785167.683566:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549061632:0@lo:400:kworker.0 00000100:00100000:0.0:1789785167.683614:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785167.683622:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549061888:0@lo:400:kworker.0 00000100:00100000:1.0:1789785167.683632:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876725549061504:0@lo:400:kworker.0 00000100:00100000:0.0:1789785167.683639:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725549062144:0@lo:400:kworker.0 00000100:00100000:3.0:1789785167.683660:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785167.683674:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785167.683682:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549061632 00000100:00100000:3.0:1789785167.683688:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549062400:0@lo:400:kworker.0 00000100:00100000:0.0:1789785167.683688:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549061632 00000100:00100000:1.0:1789785167.683708:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1876725549062016:0@lo:400:kworker.0 00000100:00100000:3.0:1789785167.683722:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785167.683734:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549061888 00000100:00100000:0.0:1789785167.683738:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549061888 00000100:00100000:1.0:1789785167.683743:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785167.683752:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549062912:0@lo:400:kworker.0 00000100:00100000:0.0:1789785167.683756:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789785167.683764:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549061632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785167.683772:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1876725549062528:0@lo:400:kworker.0 00000100:00100000:1.0:1789785167.683813:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785167.683813:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549061632:12345-0@lo:400:kworker.0 Request processed in 47us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785167.683822:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789785167.683837:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789785167.683844:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549061888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785167.683847:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb538a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549063040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789785167.683889:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549061888:12345-0@lo:400:kworker.0 Request processed in 47us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785167.683895:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785167.683907:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789785167.683934:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725549061760:0@lo:400:kworker.0 00000100:00100000:1.0:1789785167.683964:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785167.683988:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549062272:0@lo:400:kworker.0 00000100:00100000:0.0:1789785167.683993:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549061504 00000100:00100000:0.0:1789785167.683997:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549061504 00000100:00100000:1.0:1789785167.684015:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785167.684028:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549062016 00000100:00100000:0.0:1789785167.684031:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549062016 00000100:00100000:1.0:1789785167.684039:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549062784:0@lo:400:kworker.0 00000100:00100000:0.0:1789785167.684057:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549062528 00000100:00100000:0.0:1789785167.684060:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549062528 00000100:00100000:1.0:1789785167.684064:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785167.684079:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549061760 00000100:00100000:0.0:1789785167.684082:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549061760 00000100:00100000:0.0:1789785167.684104:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789785167.684111:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876725549061504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785167.684126:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789785167.684137:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1876725549062016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785167.684144:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876725549061504:12345-0@lo:400:kworker.0 Request processed in 34us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785167.684157:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789785167.684174:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789785167.684180:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1876725549062016:12345-0@lo:400:kworker.0 Request processed in 45us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785167.684181:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1876725549062528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785167.684193:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789785167.684214:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789785167.684221:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1876725549062528:12345-0@lo:400:kworker.0 Request processed in 41us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785167.684225:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725549061760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785167.684233:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789785167.684264:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725549061760:12345-0@lo:400:kworker.0 Request processed in 43us (299us total) trans 0 rc 0/0 00000100:00080000:0.0:1789785167.684268:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789785167.684273:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789785167.684299:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549063040 00000100:00100000:1.0:1789785167.684302:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549063040 00000100:00100000:1.0:1789785167.684370:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789785167.684376:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549063040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789785167.684387:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785167.684411:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549063040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785167.684415:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789785167.684430:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549062400 00000100:00100000:1.0:1789785167.684433:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549062400 00000100:00080000:0.0:1789785167.684435:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789785167.684463:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789785167.684479:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549062272 00000100:00100000:1.0:1789785167.684483:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549062272 00000100:00100000:1.0:1789785167.684514:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549062784 00000100:00080000:0.0:1789785167.684515:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789785167.684519:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549062784 00000100:00100000:1.0:1789785167.684535:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789785167.684541:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549062400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785167.684574:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549062400:12345-0@lo:400:kworker.0 Request processed in 33us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785167.684580:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789785167.684593:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789785167.684600:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549062272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785167.684626:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549062272:12345-0@lo:400:kworker.0 Request processed in 27us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785167.684631:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789785167.684643:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789785167.684649:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549062784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785167.684676:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549062784:12345-0@lo:400:kworker.0 Request processed in 28us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785167.684682:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789785167.684713:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785167.684743:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549062656:0@lo:400:kworker.0 00000100:00100000:1.0:1789785167.684769:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785167.684790:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549063168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789785167.684812:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785167.684848:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549061632:0@lo:400:kworker.0 00000100:00100000:3.0:1789785167.684863:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785167.684891:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549062144 00000100:00100000:1.0:1789785167.684895:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725549061760:0@lo:400:kworker.0 00000100:00100000:0.0:1789785167.684896:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549062144 00000100:00100000:3.0:1789785167.684911:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549061888:0@lo:400:kworker.0 00000100:00100000:0.0:1789785167.684924:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549062656 00010000:00080000:1.0:1789785167.684925:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3e8a80 x1876725549062272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785167.684927:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549062656 00010000:00080000:3.0:1789785167.684934:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3eb480 x1876725549062400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785167.684943:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549062272:0@lo:400:kworker.0 00000100:00100000:0.0:1789785167.684945:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789785167.684956:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549062400:0@lo:400:kworker.0 00000100:00100000:0.0:1789785167.684957:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725549062144:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789785167.684965:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3e9c00 x1876725549062784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785167.684977:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549062784:0@lo:400:kworker.0 00000100:00100000:0.0:1789785167.685004:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725549062144:12345-0@lo:400:kworker.0 Request processed in 49us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785167.685012:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789785167.685033:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789785167.685038:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549061376 00000100:00100000:0.0:1789785167.685042:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549062656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785167.685045:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549061376 00000100:00100000:1.0:1789785167.685049:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876725549061504:0@lo:400:kworker.0 00000100:00100000:1.0:1789785167.685066:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1876725549062016:0@lo:400:kworker.0 00000100:00100000:0.0:1789785167.685075:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549062656:12345-0@lo:400:kworker.0 Request processed in 35us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785167.685081:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1876725549062528:0@lo:400:kworker.0 00000100:00100000:0.0:1789785167.685082:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789785167.685088:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00010000:00080000:1.0:1789785167.685098:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb538a80 x1876725549063040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785167.685102:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:3659:x1876725549061376:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789785167.685109:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789785167.685126:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb538a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549063040:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1789785167.685136:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3e8380 x1876725549062144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785167.685157:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:3659:x1876725549061376:12345-0@lo:400:kworker.0 Request processed in 59us (1596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785167.685163:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725549062144:0@lo:400:kworker.0 00000100:00100000:3.0:1789785167.685170:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00010000:00080000:0.0:1789785167.685183:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3eb100 x1876725549062656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785167.685193:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549062656:0@lo:400:kworker.0 00000100:00100000:0.0:1789785167.685208:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789785167.685209:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549062912 00000100:00100000:3.0:1789785167.685215:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549062912 00000100:00100000:0.0:1789785167.685222:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549063296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789785167.685247:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785167.685282:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549063296 00000100:00100000:0.0:1789785167.685286:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549063296 00000100:00100000:0.0:1789785167.685310:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789785167.685316:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549063296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789785167.685365:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789785167.685398:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549063296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785167.685405:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789785167.685435:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549063296:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789785167.686628:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789785167.686639:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549062912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785167.686689:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549062912:12345-0@lo:400:kworker.0 Request processed in 53us (1828us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785167.686696:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789785167.686719:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549063168 00000100:00100000:3.0:1789785167.686724:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549063168 00000100:00100000:3.0:1789785167.686755:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789785167.686769:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549063168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789785167.686783:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785167.686817:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549063168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (2004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785167.686823:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1789785167.686870:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83ad4380 x1876725549063168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785167.686885:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549063168:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789785167.686912:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83980700 x1876725549062912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785167.686927:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549062912:0@lo:400:kworker.0 00000100:00100000:3.0:1789785167.686937:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549061376:0@lo:400:kworker.0 00000100:00080000:1.0:1789785167.689424:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789785167.880428:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785168.903597:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785169.221931:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549063424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789785169.222019:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785169.222089:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789785169.222095:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549063552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789785169.222127:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785169.222167:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549063424 00000100:00100000:1.0:1789785169.222176:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549063424 00000100:00100000:1.0:1789785169.222242:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789785169.222253:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549063424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789785169.222301:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785169.222381:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549063424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785169.222389:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789785169.222416:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549063552 00000100:00100000:1.0:1789785169.222420:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549063552 00000100:00100000:1.0:1789785169.222451:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789785169.222458:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf887c4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549063552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789785169.222484:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789785169.222518:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf887c4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549063552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785169.222524:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1789785169.222845:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789785169.222892:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549063552:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1789785169.222907:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83ad6680 x1876725549063424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785185 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785169.222921:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549063424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789785169.225446:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789785169.225474:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549063680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789785169.225554:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785169.225610:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549063680 00000100:00100000:1.0:1789785169.225618:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549063680 00000100:00100000:1.0:1789785169.225696:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789785169.226013:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549063680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789785169.226112:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785169.226188:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549063680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 180us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785169.226197:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1789785169.226224:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789785169.226293:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83ad6680 x1876725549063680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785185 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785169.226325:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549063680:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789785169.929637:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785170.946492:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785171.439520:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785171.439560:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785171.439598:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785171.439633:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785171.439653:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785171.439677:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785171.439706:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785171.439709:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530114688 00000100:00100000:2.0:1789785171.439720:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530114688 00000100:00100000:0.0:1789785171.439746:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530114944 00000100:00100000:0.0:1789785171.439752:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530114944 00000100:00100000:2.0:1789785171.439788:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530114560 00000100:00100000:2.0:1789785171.439793:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530114560 00000100:00100000:3.0:1789785171.439864:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530114432 00000100:00100000:3.0:1789785171.439869:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530114432 00000100:00100000:3.0:1789785171.439899:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 305 00000100:00100000:3.0:1789785171.439909:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2399:x1876725530114432:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785171.439974:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2399:x1876725530114432:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 65us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785171.439981:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 305 00000100:00100000:0.0:1789785171.441593:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530114816 00000100:00100000:0.0:1789785171.441602:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530114816 00000100:00100000:0.0:1789785171.441633:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 141 00000100:00100000:0.0:1789785171.441641:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2399:x1876725530114688:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785171.441708:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2399:x1876725530114688:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 67us (2146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785171.441715:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 141 00000100:00100000:0.0:1789785171.441730:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 142 00000100:00100000:0.0:1789785171.441735:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+6:2399:x1876725530114944:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785171.441756:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+6:2399:x1876725530114944:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 21us (2158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785171.441761:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 142 00000100:00100000:0.0:1789785171.441771:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 143 00000100:00100000:0.0:1789785171.441776:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+6:2399:x1876725530114560:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785171.441793:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+6:2399:x1876725530114560:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 17us (2139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785171.441799:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 143 00000100:00100000:0.0:1789785171.441807:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 144 00000100:00100000:0.0:1789785171.441812:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+6:2399:x1876725530114816:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785171.441827:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+6:2399:x1876725530114816:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 15us (2150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785171.441833:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 144 00000100:00100000:0.0:1789785171.441865:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530115200 00000100:00100000:0.0:1789785171.441868:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530115200 00000100:00100000:0.0:1789785171.441890:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530115072 00000100:00100000:0.0:1789785171.441892:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530115072 00000100:00100000:0.0:1789785171.441906:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 58 00000100:00100000:0.0:1789785171.441911:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+6:2399:x1876725530115200:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785171.441932:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+6:2399:x1876725530115200:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 21us (2300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785171.441938:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 58 00000100:00100000:0.0:1789785171.441946:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 59 00000100:00100000:0.0:1789785171.441951:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+6:2399:x1876725530115072:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785171.441967:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+6:2399:x1876725530115072:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 16us (2263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785171.441972:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 59 00000100:00080000:0.0:1789785171.441995:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789785171.441999:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789785171.442001:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789785171.442003:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:3.0:1789785171.783580:0:9529:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 12a32a3b-e9e7-466a-b40d-7d74895946de 00000001:00100000:1.0:1789785171.785764:0:8445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 12a32a3b-e9e7-466a-b40d-7d74895946de 00000001:00100000:3.0:1789785171.785765:0:7465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 12a32a3b-e9e7-466a-b40d-7d74895946de 00000001:00100000:2.0:1789785171.786543:0:6512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 12a32a3b-e9e7-466a-b40d-7d74895946de 00010000:00010000:2.0:1789785171.970514:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789785172.776953:0:12204:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:0.0:1789785172.804587:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549063808:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789785172.804649:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785172.804696:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725549064320:0@lo:400:kworker.0 00000100:00100000:0.0:1789785172.804721:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785172.804743:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549064832:0@lo:400:kworker.0 00000100:00100000:0.0:1789785172.804771:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785172.804792:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549065344:0@lo:400:kworker.0 00000100:00100000:0.0:1789785172.804811:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785172.804848:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789785172.804855:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549064192:0@lo:400:kworker.0 00000100:00100000:0.0:1789785172.804875:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785172.804892:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1876725549064704:0@lo:400:kworker.0 00000100:00100000:0.0:1789785172.804913:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785172.804929:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1876725549065216:0@lo:400:kworker.0 00000100:00100000:0.0:1789785172.804948:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785172.804974:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549063936:0@lo:400:kworker.0 00000100:00100000:0.0:1789785172.805012:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785172.805032:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549064448:0@lo:400:kworker.0 00000100:00100000:0.0:1789785172.805061:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785172.805089:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549064960:0@lo:400:kworker.0 00000100:00100000:0.0:1789785172.805113:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785172.805133:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549065472:0@lo:400:kworker.0 00000100:00100000:0.0:1789785172.805151:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785172.805171:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789785172.805176:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549064064:0@lo:400:kworker.0 00000100:00100000:0.0:1789785172.805195:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785172.805222:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549064576:0@lo:400:kworker.0 00000100:00100000:1.0:1789785172.805541:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549064320 00000100:00100000:1.0:1789785172.805550:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549064320 00000100:00100000:1.0:1789785172.805593:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549064704 00000100:00100000:1.0:1789785172.805596:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549064704 00000100:00100000:1.0:1789785172.805617:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549065216 00000100:00100000:1.0:1789785172.805619:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549065216 00000100:00100000:1.0:1789785172.805631:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549064064 00000100:00100000:1.0:1789785172.805633:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549064064 00000100:00100000:1.0:1789785172.805647:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789785172.805654:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725549064320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785172.805709:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725549064320:12345-0@lo:400:kworker.0 Request processed in 54us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785172.805717:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789785172.805733:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789785172.805739:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1876725549064704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785172.805766:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1876725549064704:12345-0@lo:400:kworker.0 Request processed in 28us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785172.805772:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789785172.805783:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789785172.805789:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1876725549065216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785172.805813:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1876725549065216:12345-0@lo:400:kworker.0 Request processed in 25us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785172.805828:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789785172.805841:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789785172.805847:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549064064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785172.805874:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549064064:12345-0@lo:400:kworker.0 Request processed in 27us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785172.805879:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:1.0:1789785172.805897:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789785172.805928:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83b58a80 x1876725549064704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785172.805942:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1876725549064704:0@lo:400:kworker.0 00010000:00080000:1.0:1789785172.805953:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83b58380 x1876725549065216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785172.805960:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1876725549065216:0@lo:400:kworker.0 00000100:00100000:1.0:1789785172.805970:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725549064320:0@lo:400:kworker.0 00000100:00100000:0.0:1789785172.806173:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785172.806200:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549065088:0@lo:400:kworker.0 00000100:00100000:0.0:1789785172.806221:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785172.806496:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549064064:0@lo:400:kworker.0 00000100:00100000:0.0:1789785172.806525:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549063808 00000100:00100000:0.0:1789785172.806536:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549063808 00000100:00100000:0.0:1789785172.806556:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549064192 00000100:00100000:0.0:1789785172.806559:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549064192 00000100:00100000:0.0:1789785172.806569:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549064448 00000100:00100000:0.0:1789785172.806571:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549064448 00000100:00100000:0.0:1789785172.806580:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789785172.806586:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3662:x1876725549063808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789785172.806621:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789785172.806656:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3662:x1876725549063808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (2007us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785172.806662:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789785172.806673:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789785172.806678:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549064192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785172.806699:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549064192:12345-0@lo:400:kworker.0 Request processed in 22us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785172.806704:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789785172.806712:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789785172.806717:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549064448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785172.806743:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549064448:12345-0@lo:400:kworker.0 Request processed in 26us (1681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785172.806748:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789785172.806763:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549064576 00000100:00100000:0.0:1789785172.806766:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549064576 00000100:00100000:0.0:1789785172.806782:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549065088 00000100:00100000:0.0:1789785172.806784:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549065088 00000100:00100000:0.0:1789785172.806794:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789785172.806798:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549064576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785172.806823:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549064576:12345-0@lo:400:kworker.0 Request processed in 24us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785172.806835:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789785172.806845:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789785172.806850:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549065088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785172.806873:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549065088:12345-0@lo:400:kworker.0 Request processed in 23us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785172.806878:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789785172.806894:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549064832 00000100:00100000:0.0:1789785172.806897:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549064832 00000100:00100000:0.0:1789785172.806913:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549065344 00000100:00100000:0.0:1789785172.806915:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549065344 00000100:00100000:0.0:1789785172.806925:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549064960 00000100:00100000:0.0:1789785172.806928:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549064960 00000100:00100000:0.0:1789785172.806936:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549065472 00000100:00100000:0.0:1789785172.806938:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549065472 00000100:00100000:0.0:1789785172.806950:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789785172.806956:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549064832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785172.807000:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549064832:12345-0@lo:400:kworker.0 Request processed in 43us (2228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785172.807005:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789785172.807015:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789785172.807021:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549065344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785172.807049:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549065344:12345-0@lo:400:kworker.0 Request processed in 28us (2236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785172.807055:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789785172.807064:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789785172.807081:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549064960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785172.807117:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549064960:12345-0@lo:400:kworker.0 Request processed in 48us (2004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785172.807123:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789785172.807133:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789785172.807137:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549065600:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789785172.807139:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549065472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785172.807166:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785172.807176:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549065472:12345-0@lo:400:kworker.0 Request processed in 26us (2012us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785172.807182:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789785172.807212:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549063936 00000100:00100000:0.0:1789785172.807215:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549063936 00000100:00080000:1.0:1789785172.807508:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789785172.807514:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789785172.807516:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789785172.807551:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549065600 00000100:00100000:1.0:1789785172.807554:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549065600 00000100:00100000:1.0:1789785172.807579:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789785172.807586:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549065600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789785172.807604:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785172.807643:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549065600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785172.807659:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789785172.809368:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1789785172.809389:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:3659:x1876725549063936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785172.809457:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:3659:x1876725549063936:12345-0@lo:400:kworker.0 Request processed in 75us (4443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785172.812059:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549065728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789785172.812141:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789785172.812249:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf444380 x1876725549065600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785172.812271:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549065600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789785172.812320:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549064192:0@lo:400:kworker.0 00000100:00100000:1.0:1789785172.812335:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549063808:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1789785172.812368:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83b59f80 x1876725549064832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785172.812377:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549064832:0@lo:400:kworker.0 00010000:00080000:1.0:1789785172.812387:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb620ca80 x1876725549065344/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785172.812394:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549065344:0@lo:400:kworker.0 00000100:00100000:0.0:1789785172.816126:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1789785172.816224:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549064576:0@lo:400:kworker.0 00000100:00100000:0.0:1789785172.816251:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549065088:0@lo:400:kworker.0 00000100:00100000:0.0:1789785172.816266:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549063936:0@lo:400:kworker.0 00000100:00100000:0.0:1789785172.816278:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549064448:0@lo:400:kworker.0 00010000:00080000:0.0:1789785172.816301:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83b59180 x1876725549064960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785172.816313:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549064960:0@lo:400:kworker.0 00010000:00080000:0.0:1789785172.816326:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb620d500 x1876725549065472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785172.816378:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549065472:0@lo:400:kworker.0 00000100:00100000:2.0:1789785172.816411:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549065728 00000100:00100000:2.0:1789785172.816419:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549065728 00000100:00100000:2.0:1789785172.816459:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789785172.816469:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549065728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789785172.816493:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785172.816572:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549065728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (4430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785172.816579:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1789785172.816611:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83ad5880 x1876725549065728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785172.816626:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549065728:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789785172.995182:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785174.018507:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785174.339505:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549065856:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789785174.339593:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785174.339661:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549065856 00000100:00100000:1.0:1789785174.339669:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549065856 00000100:00100000:1.0:1789785174.339718:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789785174.339727:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb6192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549065856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789785174.339771:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785174.339825:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb6192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549065856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785174.339833:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1789785174.339939:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789785174.339981:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83ad6d80 x1876725549065856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785190 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785174.340003:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549065856:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789785174.341223:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789785174.341243:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549065984:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789785174.341304:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785174.341367:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549065984 00000100:00100000:2.0:1789785174.341372:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549065984 00000100:00100000:2.0:1789785174.341410:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789785174.341419:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb538000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549065984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789785174.341446:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789785174.341500:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb538000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549065984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785174.341507:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789785174.341516:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549065984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789785174.341640:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789785174.341650:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549066112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789785174.341681:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785174.341813:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549066112 00000100:00100000:1.0:1789785174.341818:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549066112 00000100:00080000:0.0:1789785174.341837:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789785174.341860:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789785174.341868:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf453100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549066112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789785174.341880:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785174.341924:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf453100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549066112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785174.341932:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1789785174.342044:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83ad4a80 x1876725549066112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785190 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785174.342059:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549066112:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789785175.043308:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785176.067861:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785176.566205:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785176.566254:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785176.566295:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785176.566319:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785176.566364:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785176.566386:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785176.566479:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785176.566516:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530115328 00000100:00100000:0.0:1789785176.566528:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530115328 00000100:00100000:0.0:1789785176.566601:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 307 00000100:00100000:0.0:1789785176.566612:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2398:x1876725530115328:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785176.566711:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2398:x1876725530115328:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 100us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785176.566719:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 307 00000100:00100000:0.0:1789785176.566758:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530115584 00000100:00100000:0.0:1789785176.566762:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530115584 00000100:00100000:0.0:1789785176.566801:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530115840 00000100:00100000:0.0:1789785176.566804:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530115840 00000100:00100000:0.0:1789785176.566819:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530115456 00000100:00100000:0.0:1789785176.567040:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530115456 00000100:00100000:0.0:1789785176.567063:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530115712 00000100:00100000:0.0:1789785176.567066:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530115712 00000100:00100000:0.0:1789785176.567083:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 151 00000100:00100000:0.0:1789785176.567089:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530115584:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785176.567127:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530115584:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 37us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785176.567134:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 151 00000100:00100000:0.0:1789785176.567146:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 152 00000100:00100000:0.0:1789785176.567153:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530115840:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785176.567179:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530115840:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 25us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785176.567185:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 152 00000100:00100000:0.0:1789785176.567196:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 153 00000100:00100000:0.0:1789785176.567203:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+6:2398:x1876725530115456:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785176.567228:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+6:2398:x1876725530115456:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 26us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785176.567245:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 153 00000100:00100000:0.0:1789785176.567257:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 154 00000100:00100000:0.0:1789785176.567276:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530115712:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785176.567302:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530115712:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 28us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785176.567308:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 154 00000100:00100000:0.0:1789785176.567361:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530116096 00000100:00100000:0.0:1789785176.567364:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530116096 00000100:00100000:0.0:1789785176.567394:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530115968 00000100:00100000:0.0:1789785176.567397:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530115968 00000100:00100000:0.0:1789785176.567419:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 64 00000100:00100000:0.0:1789785176.567426:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530116096:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785176.567453:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530116096:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 28us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785176.567459:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 64 00000100:00100000:0.0:1789785176.567471:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 65 00000100:00100000:0.0:1789785176.567477:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530115968:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785176.567500:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530115968:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 24us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785176.567506:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 65 00000100:00080000:0.0:1789785176.571490:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789785176.571504:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789785176.571509:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789785176.571513:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789785177.100128:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785177.922464:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549066368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789785177.922561:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785177.922596:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549066368 00000100:00100000:1.0:1789785177.922603:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549066368 00000100:00100000:1.0:1789785177.922648:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789785177.922657:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549066368:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789785177.922683:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549066240:0@lo:13:osp-pre-1-1.0 00000004:00000024:1.0:1789785177.922685:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789785177.922724:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549066368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785177.922732:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789785177.922742:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785177.922828:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549066880:0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.922866:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785177.922884:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549067392:0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.922905:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785177.922918:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf42d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549067904:0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.922931:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785177.922960:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549066368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789785177.924270:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789785177.924281:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549066496:0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.924323:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785177.924368:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549067008:0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.924387:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785177.924407:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549067520:0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.924423:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785177.924437:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf42ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549068032:0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.924475:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785177.924508:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549066624:0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.924532:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785177.924551:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549067136:0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.924598:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785177.924629:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549067648:0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.924669:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785177.924686:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789785177.924691:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549066752:0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.924724:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785177.924739:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549067264:0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.924753:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785177.924765:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1876725549067776:0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.924789:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785177.924812:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549067008 00000100:00100000:0.0:1789785177.924817:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549067008 00000100:00100000:0.0:1789785177.924842:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549066752 00000100:00100000:0.0:1789785177.924845:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549066752 00000100:00100000:0.0:1789785177.924869:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789785177.924877:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacaeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549067008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.924923:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacaeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549067008:12345-0@lo:400:kworker.0 Request processed in 46us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785177.924929:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789785177.924944:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789785177.924950:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549066752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.924993:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549066752:12345-0@lo:400:kworker.0 Request processed in 43us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785177.924999:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789785177.925017:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549066240 00000100:00100000:0.0:1789785177.925020:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549066240 00000100:00100000:0.0:1789785177.925050:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789785177.925056:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549066240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789785177.925083:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785177.925123:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549066240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (2384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785177.925129:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789785177.925145:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549066880 00000100:00100000:0.0:1789785177.925148:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549066880 00000100:00100000:0.0:1789785177.925164:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549066624 00000100:00100000:0.0:1789785177.925166:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549066624 00000100:00100000:0.0:1789785177.925174:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549067136 00000100:00100000:0.0:1789785177.925175:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549067136 00000100:00100000:0.0:1789785177.925187:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549067648 00000100:00100000:0.0:1789785177.925189:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549067648 00000100:00100000:0.0:1789785177.925197:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549067264 00000100:00100000:0.0:1789785177.925199:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549067264 00000100:00100000:0.0:1789785177.925210:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549067776 00000100:00100000:0.0:1789785177.925212:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549067776 00000100:00100000:0.0:1789785177.925225:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789785177.925230:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacaead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549066880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.925266:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacaead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549066880:12345-0@lo:400:kworker.0 Request processed in 35us (2400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785177.925271:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789785177.925282:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789785177.925287:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549066624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.925308:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549066624:12345-0@lo:400:kworker.0 Request processed in 22us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785177.925314:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789785177.925322:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789785177.925327:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacaeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549067136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.925375:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacaeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549067136:12345-0@lo:400:kworker.0 Request processed in 47us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785177.925380:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789785177.925391:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789785177.925396:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549067648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.925444:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549067648:12345-0@lo:400:kworker.0 Request processed in 48us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785177.925449:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789785177.925459:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789785177.925464:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549067264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.925483:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549067264:12345-0@lo:400:kworker.0 Request processed in 20us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785177.925488:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789785177.925497:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789785177.925501:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf44a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876725549067776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.925520:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf44a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876725549067776:12345-0@lo:400:kworker.0 Request processed in 19us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785177.925525:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789785177.925540:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549067392 00000100:00100000:0.0:1789785177.925544:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549067392 00000100:00100000:0.0:1789785177.925558:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549067904 00000100:00100000:0.0:1789785177.925560:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549067904 00000100:00100000:0.0:1789785177.925568:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549067520 00000100:00100000:0.0:1789785177.925570:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549067520 00000100:00100000:0.0:1789785177.925578:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549068032 00000100:00100000:0.0:1789785177.925580:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549068032 00000100:00100000:0.0:1789785177.925590:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789785177.925600:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549067392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.925626:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549067392:12345-0@lo:400:kworker.0 Request processed in 26us (2721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785177.925632:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789785177.925641:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789785177.925646:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacaebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549067904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.925666:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacaebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549067904:12345-0@lo:400:kworker.0 Request processed in 20us (2734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785177.925671:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789785177.925682:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789785177.925687:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacaeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549067520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.925707:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacaeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549067520:12345-0@lo:400:kworker.0 Request processed in 19us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785177.925711:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789785177.925720:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789785177.925725:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacaeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549068032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.925749:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacaeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549068032:12345-0@lo:400:kworker.0 Request processed in 23us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785177.925754:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789785177.925774:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549066496 00000100:00100000:0.0:1789785177.925777:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549066496 00000100:00100000:2.0:1789785177.925779:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789785177.925795:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb53bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549068160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789785177.925800:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789785177.925806:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:3661:x1876725549066496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.925839:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:3661:x1876725549066496:12345-0@lo:400:kworker.0 Request processed in 32us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785177.925847:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785177.925859:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1789785177.925884:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549068160 00000100:00100000:2.0:1789785177.925889:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549068160 00000100:00080000:0.0:1789785177.925910:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789785177.925915:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789785177.925918:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789785177.925921:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789785177.925925:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789785177.925935:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb53b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549068160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789785177.925948:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785177.925960:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549066752:0@lo:400:kworker.0 00010000:00080000:0.0:1789785177.925975:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83ad4a80 x1876725549067264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785177.925988:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb53b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549068160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785177.925988:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549067264:0@lo:400:kworker.0 00000100:00100000:2.0:1789785177.926000:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:0.0:1789785177.926004:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83ad4380 x1876725549067776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785177.926014:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1876725549067776:0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.926028:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549066624:0@lo:400:kworker.0 00010000:00080000:2.0:1789785177.926037:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb53bb80 x1876725549068160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785177.926042:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549067136:0@lo:400:kworker.0 00000100:00100000:2.0:1789785177.926060:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb53bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549068160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789785177.926061:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549067648:0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.926111:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549066496:0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.926128:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549067008:0@lo:400:kworker.0 00010000:00080000:0.0:1789785177.926139:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83ad5880 x1876725549067520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785177.926147:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549067520:0@lo:400:kworker.0 00010000:00080000:0.0:1789785177.926155:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf42ce00 x1876725549068032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785177.926169:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf42ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549068032:0@lo:400:kworker.0 00000100:00100000:0.0:1789785177.926182:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549066880:0@lo:400:kworker.0 00010000:00080000:0.0:1789785177.926191:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83ad6d80 x1876725549067392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785177.926197:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549067392:0@lo:400:kworker.0 00010000:00080000:0.0:1789785177.926207:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf42d500 x1876725549067904/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785177.926215:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf42d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549067904:0@lo:400:kworker.0 00010000:00080000:0.0:1789785177.926223:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83ad5500 x1876725549066240/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785177.926233:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549066240:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789785178.114489:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785179.162981:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785179.458647:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789785179.458670:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549068288:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789785179.458738:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785179.458796:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549068288 00000100:00100000:0.0:1789785179.458803:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549068288 00000100:00100000:0.0:1789785179.458854:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789785179.458864:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549068288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789785179.458889:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785179.458929:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549068288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785179.458936:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1789785179.458966:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789785179.458993:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf448700 x1876725549068288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785195 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785179.459011:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549068288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789785179.459322:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb53a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549068544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789785179.459397:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785179.459419:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789785179.459425:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb53bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549068416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789785179.459448:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785179.459483:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549068544 00000100:00100000:2.0:1789785179.459488:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549068544 00000100:00100000:2.0:1789785179.459516:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789785179.459523:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb539180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549068544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789785179.459546:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789785179.464696:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb539180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549068544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5163us (5289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785179.464709:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789785179.464751:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549068416 00000100:00100000:2.0:1789785179.464759:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549068416 00000100:00100000:2.0:1789785179.464808:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789785179.464817:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb538700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549068416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789785179.464839:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785179.464872:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb538700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549068416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (5423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785179.464878:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1789785179.464896:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789785179.465020:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb53bb80 x1876725549068416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785195 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785179.465043:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb53bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549068416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789785179.465059:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb53a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549068544:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1789785179.862051:0:12520:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789785179.862299:0:12520:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789785180.170438:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785181.192905:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785181.679062:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785181.679182:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530116224 00000100:00100000:3.0:1789785181.679193:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530116224 00000100:00100000:3.0:1789785181.679253:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 309 00000100:00100000:3.0:1789785181.679263:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2397:x1876725530116224:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785181.679326:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2397:x1876725530116224:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 64us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785181.679334:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 309 00000100:00100000:0.0:1789785181.693236:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785181.696105:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785181.698416:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785181.698503:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785181.699454:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530116864 00000100:00100000:2.0:1789785181.699465:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530116864 00000100:00100000:2.0:1789785181.699524:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 70 00000100:00100000:2.0:1789785181.699535:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530116864:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785181.699709:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530116864:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 170us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785181.699726:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 70 00000100:00080000:2.0:1789785181.699823:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789785181.703055:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785181.703079:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530116352 00000100:00100000:3.0:1789785181.703087:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530116352 00000100:00080000:3.0:1789785181.703258:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789785181.703260:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530116608 00000100:00100000:2.0:1789785181.703265:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530116608 00000100:00100000:2.0:1789785181.703290:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530116480 00000100:00100000:2.0:1789785181.703294:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530116480 00000100:00100000:3.0:1789785181.703314:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 161 00000100:00100000:3.0:1789785181.703328:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+6:2398:x1876725530116352:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785181.703413:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+6:2398:x1876725530116352:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 88us (10194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785181.704413:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530116736 00000100:00100000:1.0:1789785181.704420:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530116736 00000100:00100000:2.0:1789785181.704492:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 162 00000100:00100000:2.0:1789785181.704502:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530116608:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785181.704545:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530116608:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 45us (9914us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785181.704552:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 162 00000100:00100000:2.0:1789785181.704584:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 163 00000100:00100000:2.0:1789785181.704593:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530116480:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785181.704631:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530116480:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 39us (6127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785181.704638:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 163 00000100:00080000:2.0:1789785181.704659:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789785181.705080:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 161 00000100:00100000:0.0:1789785181.706367:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785181.706717:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530116992 00000100:00100000:3.0:1789785181.706725:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530116992 00000100:00100000:3.0:1789785181.707075:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 71 00000100:00100000:3.0:1789785181.707085:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530116992:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785181.707142:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530116992:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 58us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785181.707150:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 71 00000100:00080000:2.0:1789785181.708490:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789785181.712198:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 164 00000100:00100000:1.0:1789785181.712219:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530116736:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785181.712317:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530116736:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 107us (9270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785181.712366:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 164 00000020:00000004:0.0:1789785181.857669:0:12617:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789785181.858163:0:12617:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789785182.210570:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785183.042595:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549068672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789785183.042665:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785183.042666:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf42f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549069056:0@lo:400:kworker.0 00000100:00100000:0.0:1789785183.047700:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf42f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549068800:0@lo:400:kworker.0 00000100:00100000:0.0:1789785183.047772:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785183.047881:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf42ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549069312:0@lo:400:kworker.0 00000100:00100000:0.0:1789785183.047905:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785183.047926:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549069824:0@lo:400:kworker.0 00000100:00100000:0.0:1789785183.047968:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785183.047992:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb5ee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549070336:0@lo:400:kworker.0 00000100:00100000:0.0:1789785183.048012:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785183.048032:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1789785183.048039:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf42ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549068928:0@lo:400:kworker.0 00000100:00100000:0.0:1789785183.048075:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785183.048094:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549069440:0@lo:400:kworker.0 00000100:00100000:0.0:1789785183.048111:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785183.048129:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549069952:0@lo:400:kworker.0 00000100:00100000:0.0:1789785183.048149:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785183.048177:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549070464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789785183.048197:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785183.048591:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549068672 00000100:00100000:0.0:1789785183.048600:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549068672 00000100:00100000:0.0:1789785183.048727:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789785183.048737:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549068672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789785183.048766:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785183.048825:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549068672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (6161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785183.048833:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789785183.048862:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549068800 00000100:00100000:0.0:1789785183.048866:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549068800 00000100:00100000:0.0:1789785183.048905:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789785183.048912:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:3659:x1876725549068800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785183.048944:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:3659:x1876725549068800:12345-0@lo:400:kworker.0 Request processed in 33us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785183.048956:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789785183.048978:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549069312 00000100:00100000:0.0:1789785183.048981:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549069312 00000100:00100000:0.0:1789785183.049002:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549070464 00000100:00100000:0.0:1789785183.049004:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549070464 00000100:00100000:3.0:1789785183.049016:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789785183.049028:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789785183.049033:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3659:x1876725549069312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785183.049038:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3659:x1876725549070464:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789785183.049088:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3659:x1876725549069312:12345-0@lo:400:kworker.0 Request processed in 63us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785183.049095:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000004:00000024:0.0:1789785183.049119:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789785183.049405:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549070464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785183.049415:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789785183.049502:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549069824 00000100:00100000:0.0:1789785183.049507:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549069824 00000100:00100000:0.0:1789785183.049541:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549070336 00000100:00100000:0.0:1789785183.049545:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549070336 00000100:00100000:0.0:1789785183.049567:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789785183.049574:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549069824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785183.049608:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549069824:12345-0@lo:400:kworker.0 Request processed in 34us (1639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785183.049614:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789785183.049636:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789785183.049643:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549070336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785183.049671:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549070336:12345-0@lo:400:kworker.0 Request processed in 28us (1657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785183.049676:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789785183.049696:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549068928 00000100:00100000:0.0:1789785183.049699:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549068928 00000100:00100000:0.0:1789785183.049731:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549069440 00000100:00100000:0.0:1789785183.049735:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549069440 00000100:00100000:0.0:1789785183.049757:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549069952 00000100:00100000:0.0:1789785183.049760:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549069952 00000100:00100000:0.0:1789785183.049776:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789785183.049782:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549068928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785183.049816:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549068928:12345-0@lo:400:kworker.0 Request processed in 34us (1739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785183.049830:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789785183.049844:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789785183.049851:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549069440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785183.049879:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549069440:12345-0@lo:400:kworker.0 Request processed in 29us (1766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785183.049885:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789785183.049895:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789785183.049901:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549069952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785183.049929:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549069952:12345-0@lo:400:kworker.0 Request processed in 28us (1779us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785183.049936:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:0.0:1789785183.049960:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789785183.049964:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789785183.049966:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789785183.050002:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf42ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549068928:0@lo:400:kworker.0 00000100:00100000:0.0:1789785183.050014:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549069440:0@lo:400:kworker.0 00000100:00100000:0.0:1789785183.050024:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549069952:0@lo:400:kworker.0 00000100:00100000:0.0:1789785183.050041:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549070464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789785183.050076:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf42ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549069312:0@lo:400:kworker.0 00010000:00080000:0.0:1789785183.050088:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb417800 x1876725549069824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785183.050098:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549069824:0@lo:400:kworker.0 00010000:00080000:0.0:1789785183.050110:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb5ee4e00 x1876725549070336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785183.050118:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb5ee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549070336:0@lo:400:kworker.0 00010000:00080000:0.0:1789785183.050130:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83ad5880 x1876725549068672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785183.050142:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549068672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789785183.050152:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf42f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549068800:0@lo:400:kworker.0 00000100:00100000:1.0:1789785183.052229:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785183.052286:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf42d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725549069184:0@lo:400:kworker.0 00000100:00100000:1.0:1789785183.052326:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785183.052369:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549069696:0@lo:400:kworker.0 00000100:00100000:1.0:1789785183.052391:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785183.052411:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb5ee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549070208:0@lo:400:kworker.0 00000100:00100000:1.0:1789785183.052431:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785183.052452:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789785183.052458:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf445500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549070592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789785183.052479:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785183.052788:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549070592 00000100:00100000:1.0:1789785183.052796:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549070592 00000100:00100000:1.0:1789785183.052842:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789785183.052852:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549070592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789785183.052874:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785183.052920:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549070592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785183.052928:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789785183.053001:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549069184 00000100:00100000:0.0:1789785183.053005:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549069184 00000100:00100000:0.0:1789785183.053043:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789785183.053120:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725549069184:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789785183.053135:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf445500 x1876725549070592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785183.053157:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf445500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549070592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789785183.053254:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549069056 00000100:00100000:2.0:1789785183.053259:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549069056 00000100:00100000:2.0:1789785183.053378:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789785183.053386:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549069056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785183.057506:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf42d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725549069184:0@lo:400:kworker.0 00000100:00100000:1.0:1789785183.057677:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725549069568:0@lo:400:kworker.0 00000100:00100000:1.0:1789785183.057737:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785183.057768:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549069568 00000100:00100000:0.0:1789785183.057775:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725549069184:12345-0@lo:400:kworker.0 Request processed in 4660us (5384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785183.057776:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549069568 00000100:00100000:0.0:1789785183.057814:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789785183.057850:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549069696 00000100:00100000:0.0:1789785183.057855:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549069696 00000100:00100000:2.0:1789785183.057886:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549069056:12345-0@lo:400:kworker.0 Request processed in 4498us (5669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785183.057890:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549070208 00000100:00100000:0.0:1789785183.057894:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549070208 00000100:00100000:2.0:1789785183.057909:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789785183.057920:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789785183.057931:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549069696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785183.057988:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549069696:12345-0@lo:400:kworker.0 Request processed in 59us (5595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785183.057994:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789785183.058004:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789785183.058008:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549070208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785183.058031:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549070208:12345-0@lo:400:kworker.0 Request processed in 23us (5601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785183.058034:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1789785183.058428:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789785183.058433:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789785183.058445:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549070080:0@lo:400:kworker.0 00000100:00100000:0.0:1789785183.058472:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785183.058489:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549070080 00000100:00100000:0.0:1789785183.058492:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549070080 00000100:00100000:1.0:1789785183.059485:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789785183.059494:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789785183.059499:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725549069568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785183.059507:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549070080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785183.059562:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725549069568:12345-0@lo:400:kworker.0 Request processed in 67us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785183.059566:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549070080:12345-0@lo:400:kworker.0 Request processed in 62us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785183.059575:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789785183.059582:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:0.0:1789785183.059607:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789785183.059619:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb416680 x1876725549069696/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785183.059633:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549069696:0@lo:400:kworker.0 00010000:00080000:1.0:1789785183.059643:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb5ee6a00 x1876725549070208/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785183.059651:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb5ee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549070208:0@lo:400:kworker.0 00010000:00080000:0.0:1789785183.059767:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb414380 x1876725549070080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785183.059783:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549070080:0@lo:400:kworker.0 00000100:00100000:1.0:1789785183.062136:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf42f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549069056:0@lo:400:kworker.0 00010000:00080000:1.0:1789785183.062156:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb415c00 x1876725549069568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785183.062166:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725549069568:0@lo:400:kworker.0 00010000:00010000:2.0:1789785183.249185:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789785184.073836:0:12715:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789785184.074113:0:12715:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789785184.261785:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785184.578691:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789785184.578715:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549070720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789785184.578781:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785184.578845:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549070720 00000100:00100000:2.0:1789785184.578852:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549070720 00000100:00100000:2.0:1789785184.580100:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789785184.580115:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549070720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789785184.580153:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789785184.580229:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549070720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785184.580237:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789785184.580295:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549070720:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789785184.580378:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789785184.580389:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549070848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789785184.580438:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785184.580678:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549070848 00000100:00100000:2.0:1789785184.580685:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549070848 00000100:00100000:2.0:1789785184.580767:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789785184.580776:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549070848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789785184.580796:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785184.580844:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549070848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785184.580851:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789785184.582467:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb5ee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549070976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789785184.582522:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789785184.587312:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb415c00 x1876725549070848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785200 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785184.587357:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549070848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789785184.591448:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549070976 00000100:00100000:3.0:1789785184.591592:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549070976 00000100:00100000:3.0:1789785184.591650:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789785184.591660:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549070976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789785184.591687:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785184.591769:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549070976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (9245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785184.591787:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:0.0:1789785184.592018:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb5ee6a00 x1876725549070976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785200 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785184.592038:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb5ee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549070976:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789785185.285639:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785186.306525:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789785186.550567:0:12812:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789785186.550804:0:12812:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789785186.800752:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785186.800797:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785186.800825:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785186.800842:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785186.800860:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785186.800881:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785186.800903:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785186.800928:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530117248 00000100:00100000:0.0:1789785186.800936:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530117248 00000100:00100000:0.0:1789785186.800998:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530117504 00000100:00100000:0.0:1789785186.801001:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530117504 00000100:00100000:0.0:1789785186.801013:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530117376 00000100:00100000:0.0:1789785186.801015:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530117376 00000100:00100000:0.0:1789785186.801027:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530117632 00000100:00100000:0.0:1789785186.801030:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530117632 00000100:00100000:0.0:1789785186.801044:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 171 00000100:00100000:0.0:1789785186.801053:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+6:2397:x1876725530117248:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785186.801129:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+6:2397:x1876725530117248:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 76us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785186.801137:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 171 00000100:00100000:0.0:1789785186.801154:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 172 00000100:00100000:0.0:1789785186.801160:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2397:x1876725530117504:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785186.801208:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2397:x1876725530117504:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 47us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785186.801214:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 172 00000100:00100000:0.0:1789785186.801227:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 173 00000100:00100000:0.0:1789785186.801234:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530117376:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785186.801258:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530117376:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 25us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785186.801264:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 173 00000100:00100000:0.0:1789785186.801275:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 174 00000100:00100000:0.0:1789785186.801281:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2397:x1876725530117632:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785186.801303:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2397:x1876725530117632:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 23us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785186.801309:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 174 00000100:00100000:0.0:1789785186.801326:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530117120 00000100:00100000:0.0:1789785186.801330:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530117120 00000100:00100000:0.0:1789785186.801377:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 311 00000100:00100000:0.0:1789785186.801384:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2397:x1876725530117120:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785186.801409:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2397:x1876725530117120:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 26us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785186.801421:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 311 00000100:00100000:0.0:1789785186.801456:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530117760 00000100:00100000:0.0:1789785186.801459:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530117760 00000100:00100000:0.0:1789785186.801483:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530117888 00000100:00100000:0.0:1789785186.801485:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530117888 00000100:00100000:0.0:1789785186.801503:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 22 00000100:00100000:0.0:1789785186.801510:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2396:x1876725530117760:12345-192.168.203.46@tcp:9:kworker.0 00000020:00000080:0.0:1789785186.801526:0:8449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c39a 00000100:00080000:0.0:1789785186.801534:0:8449:0:(import.c:65:import_set_state_nolock()) ffff9dae836f9000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789785186.801573:0:8449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789785186.801687:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+2:2396:x1876725530117760:12345-192.168.203.46@tcp:9:kworker.0 Request processed in 176us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785186.801694:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 22 00000100:00100000:0.0:1789785186.801707:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 23 00000100:00100000:0.0:1789785186.801713:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2396:x1876725530117888:12345-192.168.203.46@tcp:9:kworker.0 00000020:00000080:0.0:1789785186.801725:0:8449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c3a1 00000100:00080000:0.0:1789785186.801730:0:8449:0:(import.c:65:import_set_state_nolock()) ffff9dae836fb800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789785186.801755:0:8449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789785186.801824:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+2:2396:x1876725530117888:12345-192.168.203.46@tcp:9:kworker.0 Request processed in 111us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785186.801831:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 23 00000100:00080000:0.0:1789785186.801849:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789785186.801852:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789785186.801855:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789785186.801857:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789785186.802006:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785186.802019:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785187.333859:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785188.168243:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf42f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549071104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789785188.168309:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785188.168408:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549071104 00000100:00100000:0.0:1789785188.168415:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549071104 00000100:00100000:0.0:1789785188.168462:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789785188.168471:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549071104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789785188.168645:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785188.168687:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549071104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 217us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785188.168694:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1789785188.168715:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789785188.168811:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf42f800 x1876725549071104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785188.168830:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf42f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549071104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789785188.169240:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549071360:0@lo:400:kworker.0 00000100:00100000:1.0:1789785188.169276:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785188.169298:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549071872:0@lo:400:kworker.0 00000100:00100000:1.0:1789785188.169420:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785188.169444:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549072384:0@lo:400:kworker.0 00000100:00100000:1.0:1789785188.169464:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785188.169484:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789785188.169623:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549071488:0@lo:400:kworker.0 00000100:00100000:1.0:1789785188.169650:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785188.169703:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549072000:0@lo:400:kworker.0 00000100:00100000:1.0:1789785188.169725:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785188.169741:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1876725549072512:0@lo:400:kworker.0 00000100:00100000:1.0:1789785188.169771:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785188.169798:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549071360 00000100:00100000:1.0:1789785188.169803:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549071360 00000100:00100000:1.0:1789785188.169829:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549071872 00000100:00100000:1.0:1789785188.169832:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549071872 00000100:00100000:1.0:1789785188.169849:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549072384 00000100:00100000:1.0:1789785188.169851:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549072384 00000100:00100000:1.0:1789785188.169861:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549072000 00000100:00100000:1.0:1789785188.169862:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549072000 00000100:00100000:1.0:1789785188.169871:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549072512 00000100:00100000:1.0:1789785188.169873:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549072512 00000100:00100000:1.0:1789785188.169888:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789785188.170008:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549071360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785188.170054:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549071360:12345-0@lo:400:kworker.0 Request processed in 159us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785188.170061:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789785188.170074:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789785188.170090:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549071872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785188.170129:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549071872:12345-0@lo:400:kworker.0 Request processed in 39us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785188.170135:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789785188.170146:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789785188.170151:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549072384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785188.170173:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549072384:12345-0@lo:400:kworker.0 Request processed in 22us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785188.170189:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789785188.170201:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789785188.170207:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549072000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785188.170232:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549072000:12345-0@lo:400:kworker.0 Request processed in 26us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785188.170237:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789785188.170246:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789785188.170252:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876725549072512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785188.170276:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876725549072512:12345-0@lo:400:kworker.0 Request processed in 25us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785188.170281:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00010000:00080000:1.0:1789785188.170352:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83b59f80 x1876725549072000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785188.170365:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549072000:0@lo:400:kworker.0 00010000:00080000:1.0:1789785188.170377:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83b59c00 x1876725549072512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785188.170386:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1876725549072512:0@lo:400:kworker.0 00000100:00100000:1.0:1789785188.170404:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549071360:0@lo:400:kworker.0 00000100:00100000:1.0:1789785188.170413:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549071872:0@lo:400:kworker.0 00000100:00100000:1.0:1789785188.170421:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549072384:0@lo:400:kworker.0 00000100:00080000:1.0:1789785188.170447:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789785188.170452:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789785188.170463:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549071616:0@lo:400:kworker.0 00000100:00100000:1.0:1789785188.170505:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785188.170538:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549072128:0@lo:400:kworker.0 00000100:00100000:3.0:1789785188.170546:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb5ee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549071232:0@lo:400:kworker.0 00000100:00100000:1.0:1789785188.170563:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785188.170592:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549072640:0@lo:400:kworker.0 00000100:00100000:3.0:1789785188.170609:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785188.170621:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785188.170645:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549071744:0@lo:400:kworker.0 00000100:00100000:1.0:1789785188.170664:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549072896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789785188.170673:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785188.170695:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549072128 00000100:00100000:1.0:1789785188.170700:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549072128 00000100:00100000:2.0:1789785188.170725:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549071616 00000100:00100000:2.0:1789785188.170731:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549071616 00000100:00100000:1.0:1789785188.170733:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549072640 00000100:00100000:1.0:1789785188.170738:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549072640 00000100:00100000:2.0:1789785188.170763:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789785188.170778:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549071616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785188.170818:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549071616:12345-0@lo:400:kworker.0 Request processed in 42us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785188.170825:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789785188.171275:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789785188.171283:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549072128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785188.171319:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549072128:12345-0@lo:400:kworker.0 Request processed in 37us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785188.171401:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789785188.171415:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789785188.171421:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549072640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785188.171451:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549072640:12345-0@lo:400:kworker.0 Request processed in 31us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785188.171464:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1789785188.171560:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789785188.171564:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789785188.171590:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549071616:0@lo:400:kworker.0 00010000:00080000:1.0:1789785188.171603:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83b59880 x1876725549072128/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785188.171613:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549072128:0@lo:400:kworker.0 00010000:00080000:1.0:1789785188.171623:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83b58380 x1876725549072640/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785188.171631:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549072640:0@lo:400:kworker.0 00000100:00100000:2.0:1789785188.172400:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549071232 00000100:00100000:2.0:1789785188.172408:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549071232 00000100:00100000:2.0:1789785188.172441:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1789785188.172448:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:3662:x1876725549071232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785188.172495:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:3662:x1876725549071232:12345-0@lo:400:kworker.0 Request processed in 47us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785188.172503:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1789785188.177812:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785188.185166:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549071488 00000100:00100000:2.0:1789785188.185192:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549071488 00000100:00100000:2.0:1789785188.185249:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549071744 00000100:00100000:2.0:1789785188.185252:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549071744 00000100:00100000:2.0:1789785188.185264:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549072896 00000100:00100000:2.0:1789785188.185266:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549072896 00000100:00100000:2.0:1789785188.185279:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789785188.185290:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549071488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785188.185420:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549071488:12345-0@lo:400:kworker.0 Request processed in 130us (15768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785188.185428:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789785188.185451:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789785188.185460:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789785188.185465:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3662:x1876725549071744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785188.185474:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549071488:0@lo:400:kworker.0 00000100:00100000:2.0:1789785188.185474:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3659:x1876725549072896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789785188.185506:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789785188.185519:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3662:x1876725549071744:12345-0@lo:400:kworker.0 Request processed in 59us (14845us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785188.185528:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789785188.185556:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549072896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (7751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785188.185591:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789785188.185613:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549072896:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789785188.185632:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549071744:0@lo:400:kworker.0 00000100:00100000:2.0:1789785188.185644:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549072256:0@lo:400:kworker.0 00000100:00100000:2.0:1789785188.186073:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785188.186111:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549072768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789785188.186153:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785188.186162:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549072256 00000100:00100000:1.0:1789785188.186168:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549072256 00000100:00100000:2.0:1789785188.186217:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb5ee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549071232:0@lo:400:kworker.0 00000100:00100000:1.0:1789785188.186225:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789785188.186235:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb539c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549072256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785188.186284:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb539c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549072256:12345-0@lo:400:kworker.0 Request processed in 52us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785188.186290:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1789785188.186306:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789785188.186565:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83b5aa00 x1876725549072256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785188.186576:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549072256:0@lo:400:kworker.0 00000100:00100000:3.0:1789785188.188790:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549072768 00000100:00100000:3.0:1789785188.188803:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549072768 00000100:00100000:3.0:1789785188.188852:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789785188.188861:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb53a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549072768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789785188.188883:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785188.188960:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb53a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549072768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (2806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785188.188968:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:1.0:1789785188.189014:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf446680 x1876725549072768/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785188.189045:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549072768:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789785188.365436:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789785188.570164:0:12909:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789785188.571562:0:12909:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789785189.378564:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785189.702645:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549073152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789785189.702649:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789785189.702668:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf42f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549073024:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789785189.705445:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf42ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549073280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789785189.705646:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785189.705656:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785189.705716:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549073152 00000100:00100000:3.0:1789785189.705725:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549073152 00000100:00100000:0.0:1789785189.705814:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549073024 00000100:00100000:0.0:1789785189.705819:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549073024 00000100:00100000:3.0:1789785189.705829:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789785189.705841:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549073152:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789785189.705853:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789785189.705863:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549073024:12345-0@lo:41:osp-pre-0-1.0 00002000:00000024:3.0:1789785189.705870:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000004:00000024:0.0:1789785189.705887:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789785189.705942:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549073024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785189.705949:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549073152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785189.705952:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789785189.705960:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789785189.706029:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf42f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549073024:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1789785189.706081:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb113ea00 x1876725549073152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785189.706097:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549073152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789785189.708143:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785189.709462:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549073280 00000100:00100000:0.0:1789785189.709474:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549073280 00000100:00100000:0.0:1789785189.711428:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789785189.711444:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb53bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549073280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789785189.711469:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785189.711549:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb53bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549073280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (3413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785189.711557:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:1.0:1789785189.713434:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf42ea00 x1876725549073280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785189.713460:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf42ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549073280:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789785190.403335:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785191.426583:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785191.916689:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785191.916732:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785191.916763:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785191.916898:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530118016 00000100:00100000:1.0:1789785191.916908:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530118016 00000100:00100000:1.0:1789785191.916959:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 313 00000100:00100000:1.0:1789785191.916970:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2397:x1876725530118016:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785191.917037:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2397:x1876725530118016:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 69us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785191.917044:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 313 00000100:00100000:3.0:1789785191.918016:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785191.921209:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785191.921297:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530118272 00000100:00100000:2.0:1789785191.921307:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530118272 00000100:00100000:2.0:1789785191.921847:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530118528 00000100:00100000:2.0:1789785191.921852:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530118528 00000100:00100000:2.0:1789785191.921884:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530118144 00000100:00100000:2.0:1789785191.921887:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530118144 00000100:00100000:2.0:1789785191.921905:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 181 00000100:00100000:2.0:1789785191.921913:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530118272:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785191.921983:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530118272:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 70us (5250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785191.922004:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 181 00000100:00100000:2.0:1789785191.922022:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 182 00000100:00100000:2.0:1789785191.922029:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2397:x1876725530118528:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785191.922054:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2397:x1876725530118528:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 26us (5290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785191.922059:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 182 00000100:00100000:2.0:1789785191.922071:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 183 00000100:00100000:2.0:1789785191.922079:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+6:2397:x1876725530118144:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785191.922101:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+6:2397:x1876725530118144:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 24us (4090us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785191.922107:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 183 00000100:00080000:2.0:1789785191.922126:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789785191.922129:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789785191.923285:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530118400 00000100:00100000:3.0:1789785191.923294:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530118400 00000100:00100000:3.0:1789785191.923446:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 184 00000100:00100000:3.0:1789785191.923457:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf446a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2397:x1876725530118400:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785191.923515:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf446a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2397:x1876725530118400:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 60us (2316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785191.923523:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 184 00000100:00080000:1.0:1789785191.923661:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1789785192.423267:0:13054:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789785192.450537:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789785192.773556:0:8445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 12a32a3b-e9e7-466a-b40d-7d74895946de 00000020:00000080:2.0:1789785192.773566:0:8445:0:(genops.c:885:class_export_put()) final put ffff9dae836fb000/12a32a3b-e9e7-466a-b40d-7d74895946de 00000020:00000080:3.0:1789785192.773846:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae836fb000/12a32a3b-e9e7-466a-b40d-7d74895946de for lustre-OST0000 00000020:00000080:3.0:1789785192.773905:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dae836f9000 for lustre-OST0000 00000001:00100000:3.0:1789785192.774440:0:9529:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 12a32a3b-e9e7-466a-b40d-7d74895946de 00000020:00000080:3.0:1789785192.774445:0:9529:0:(genops.c:885:class_export_put()) final put ffff9dae836fc000/12a32a3b-e9e7-466a-b40d-7d74895946de 00000020:00000080:2.0:1789785192.774505:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae836fc000/12a32a3b-e9e7-466a-b40d-7d74895946de for lustre-OST0001 00000020:00000080:2.0:1789785192.774539:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dae836fb800 for lustre-OST0001 00000100:00100000:1.0:1789785193.283367:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549073664:0@lo:400:kworker.0 00000100:00100000:1.0:1789785193.283437:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785193.283494:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725549074176:0@lo:400:kworker.0 00000100:00100000:1.0:1789785193.283518:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785193.283538:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549074688:0@lo:400:kworker.0 00000100:00100000:1.0:1789785193.283576:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785193.283598:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789785193.283614:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549073792:0@lo:400:kworker.0 00000100:00100000:1.0:1789785193.283640:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785193.283662:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549074304:0@lo:400:kworker.0 00000100:00100000:1.0:1789785193.283683:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785193.283696:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549074816:0@lo:400:kworker.0 00000100:00100000:1.0:1789785193.283715:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785193.283749:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549074176 00000100:00100000:1.0:1789785193.283755:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549074176 00000100:00100000:1.0:1789785193.283799:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549074688 00000100:00100000:1.0:1789785193.283801:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549074688 00000100:00100000:1.0:1789785193.283814:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549073792 00000100:00100000:1.0:1789785193.283816:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549073792 00000100:00100000:1.0:1789785193.283828:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789785193.283835:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725549074176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785193.283880:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725549074176:12345-0@lo:400:kworker.0 Request processed in 44us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785193.283887:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789785193.283903:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789785193.283909:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549074688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785193.283999:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549074688:12345-0@lo:400:kworker.0 Request processed in 90us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785193.284006:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789785193.284018:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789785193.284024:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549073792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785193.284061:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549073792:12345-0@lo:400:kworker.0 Request processed in 37us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785193.284067:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789785193.284097:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549074304 00000100:00100000:1.0:1789785193.284100:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549074304 00000100:00100000:1.0:1789785193.284124:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549074816 00000100:00100000:1.0:1789785193.284126:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549074816 00000100:00100000:1.0:1789785193.284152:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789785193.284159:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549074304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785193.284187:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549074304:12345-0@lo:400:kworker.0 Request processed in 29us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785193.284193:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789785193.284204:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789785193.284209:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81eabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549074816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785193.284234:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81eabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549074816:12345-0@lo:400:kworker.0 Request processed in 25us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785193.284246:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1789785193.284266:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789785193.284269:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789785193.284272:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789785193.284307:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549073792:0@lo:400:kworker.0 00010000:00080000:1.0:1789785193.284321:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83b59180 x1876725549074304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785193.284331:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549074304:0@lo:400:kworker.0 00010000:00080000:1.0:1789785193.284368:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae81eaa300 x1876725549074816/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785193.284389:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549074816:0@lo:400:kworker.0 00010000:00080000:1.0:1789785193.284402:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83b5bb80 x1876725549074176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785193.284410:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725549074176:0@lo:400:kworker.0 00010000:00080000:1.0:1789785193.284419:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb113ea00 x1876725549074688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785193.284425:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549074688:0@lo:400:kworker.0 00000100:00100000:0.0:1789785193.285788:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549073408:0@lo:400:kworker.0 00000100:00100000:0.0:1789785193.285844:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785193.285880:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549073920:0@lo:400:kworker.0 00000100:00100000:0.0:1789785193.285904:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785193.285927:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549074432:0@lo:400:kworker.0 00000100:00100000:0.0:1789785193.285953:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785193.285968:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549074944:0@lo:400:kworker.0 00000100:00100000:0.0:1789785193.285985:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785193.286003:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789785193.286009:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549073536:0@lo:400:kworker.0 00000100:00100000:0.0:1789785193.286031:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785193.286049:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549074048:0@lo:400:kworker.0 00000100:00100000:0.0:1789785193.286069:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785193.286092:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549074560:0@lo:400:kworker.0 00000100:00100000:0.0:1789785193.286111:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785193.286162:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549073664 00000100:00100000:0.0:1789785193.286168:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549073664 00000100:00100000:0.0:1789785193.286201:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549073920 00000100:00100000:0.0:1789785193.286204:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549073920 00000100:00100000:0.0:1789785193.286219:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789785193.286227:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549073664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785193.286285:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549073664:12345-0@lo:400:kworker.0 Request processed in 59us (2848us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785193.286292:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789785193.286308:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789785193.286314:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549073920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785193.286366:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549073920:12345-0@lo:400:kworker.0 Request processed in 52us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785193.286373:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789785193.286401:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549073408 00000100:00100000:0.0:1789785193.286404:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549073408 00000100:00100000:0.0:1789785193.286428:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1789785193.286434:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:3659:x1876725549073408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785193.286462:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:3659:x1876725549073408:12345-0@lo:400:kworker.0 Request processed in 29us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785193.286468:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1789785193.286498:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549073536 00000100:00100000:0.0:1789785193.286502:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549073536 00000100:00100000:0.0:1789785193.286524:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549074048 00000100:00100000:0.0:1789785193.286527:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549074048 00000100:00100000:0.0:1789785193.286544:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549074560 00000100:00100000:0.0:1789785193.286546:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549074560 00000100:00100000:0.0:1789785193.286559:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789785193.286565:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549073536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785193.286602:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549073536:12345-0@lo:400:kworker.0 Request processed in 37us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785193.286620:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789785193.286639:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789785193.286645:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549074048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785193.286668:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549074048:12345-0@lo:400:kworker.0 Request processed in 24us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785193.286673:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789785193.286681:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789785193.286686:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549074560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785193.286775:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549074560:12345-0@lo:400:kworker.0 Request processed in 88us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785193.286781:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789785193.286798:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549074432 00000100:00100000:0.0:1789785193.286801:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549074432 00000100:00100000:0.0:1789785193.286822:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549074944 00000100:00100000:0.0:1789785193.286825:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549074944 00000100:00100000:0.0:1789785193.286848:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789785193.286854:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549074432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785193.286885:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549074432:12345-0@lo:400:kworker.0 Request processed in 31us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785193.286891:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789785193.286902:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789785193.286908:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549074944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785193.286934:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549074944:12345-0@lo:400:kworker.0 Request processed in 27us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785193.286949:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789785193.286995:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549073536:0@lo:400:kworker.0 00000100:00100000:0.0:1789785193.287005:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549074048:0@lo:400:kworker.0 00000100:00100000:0.0:1789785193.287014:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549074560:0@lo:400:kworker.0 00000100:00100000:0.0:1789785193.287021:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549073408:0@lo:400:kworker.0 00000100:00100000:0.0:1789785193.287029:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549073920:0@lo:400:kworker.0 00010000:00080000:0.0:1789785193.287040:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83b59c00 x1876725549074432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785193.287051:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549074432:0@lo:400:kworker.0 00010000:00080000:0.0:1789785193.287061:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae81eaaa00 x1876725549074944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785193.287069:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549074944:0@lo:400:kworker.0 00000100:00100000:0.0:1789785193.287106:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549073664:0@lo:400:kworker.0 00000100:00100000:2.0:1789785193.287408:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549075072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789785193.287442:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785193.287570:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549075200:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789785193.287598:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785193.287633:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789785193.287639:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549075328:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789785193.287661:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785193.287689:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549075072 00000100:00100000:3.0:1789785193.287702:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549075072 00000100:00100000:3.0:1789785193.287727:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549075200 00000100:00100000:3.0:1789785193.287730:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549075200 00000100:00100000:3.0:1789785193.287744:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789785193.287749:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb539f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549075072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789785193.287768:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785193.287829:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789785193.287836:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf445500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549075200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789785193.287845:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785193.287875:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf445500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549075200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785193.287881:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1789785193.287923:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789785193.287927:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789785193.287941:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789785193.287972:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549075328 00000100:00100000:0.0:1789785193.287976:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549075328 00000100:00100000:0.0:1789785193.287999:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789785193.288004:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549075328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789785193.288023:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789785193.288054:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549075328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785193.288060:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789785193.288229:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549075328:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1789785193.288240:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf445c00 x1876725549075200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785193.288252:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549075200:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1789785193.291766:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae81eaa300 x1876725549075072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785193.291790:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549075072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789785193.291931:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb539f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549075072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3510us (3817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785193.291941:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:2.0:1789785193.476521:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785194.500232:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785194.819680:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789785194.819711:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549075456:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789785194.819817:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785194.819912:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549075456 00000100:00100000:0.0:1789785194.819921:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549075456 00000100:00100000:0.0:1789785194.819982:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789785194.819993:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549075456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789785194.820037:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789785194.820093:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549075456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785194.820101:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789785194.820172:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549075456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789785194.821111:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789785194.821137:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae81eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549075584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789785194.821188:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785194.821241:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549075584 00000100:00100000:1.0:1789785194.821247:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549075584 00000100:00100000:1.0:1789785194.821287:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789785194.821295:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549075584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789785194.821321:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785194.821376:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549075584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785194.821382:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:1.0:1789785194.821435:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae81eaa300 x1876725549075584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785194.821454:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae81eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549075584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789785194.821571:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789785194.821581:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549075712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789785194.821609:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785194.822223:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549075712 00000100:00100000:3.0:1789785194.822229:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549075712 00000100:00100000:3.0:1789785194.822272:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789785194.822281:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549075712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789785194.822297:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785194.822365:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549075712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785194.822372:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1789785194.822558:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafaca25180 x1876725549075712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785194.822594:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549075712:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789785195.525064:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789785196.322509:0:13201:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb8dcaaf0 20000000:00000080:2.0:1789785196.322526:0:13201:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dafbf3ba400 uarg=0000000000000000 20000000:01000000:2.0:1789785196.322566:0:13201:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789785196.322572:0:13201:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789785196.322577:0:13201:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789785196.323150:0:13202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1789785196.323315:0:13201:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789785196.330461:0:13201:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789785196.330491:0:13201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dafc1b09e00/0x2f18ee3fd845c3a8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785196.330571:0:13201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dae81eac400/0x2f18ee3fd845c33f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c338 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785196.330580:0:13201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc1b09800/0x2f18ee3fd845c34d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c346 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785196.330590:0:13201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc1b09a00/0x2f18ee3fd845c354 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8560 expref: 12 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785196.330597:0:13201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc1b08400/0x2f18ee3fd845c362 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c35b expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785196.330604:0:13201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc2051600/0x2f18ee3fd845c370 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c369 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785196.330610:0:13201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc2051a00/0x2f18ee3fd845c385 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd859f expref: 12 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785196.330618:0:13201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dafc1b09e00/0x2f18ee3fd845c3a8 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785196.330767:0:13201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc2051a00/0x2f18ee3fd845c385 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd859f expref: 12 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785196.330798:0:13201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dafc2051a00/0x2f18ee3fd845c385 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd859f expref: 12 pid: 6527 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785196.330814:0:13201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13201:1876725549075840:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789785196.331198:0:13201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc2051600/0x2f18ee3fd845c370 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c369 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785196.331208:0:13201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dafc2051600/0x2f18ee3fd845c370 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c369 expref: 23 pid: 6528 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785196.331218:0:13201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13201:1876725549075968:0@lo:104: 00000100:00100000:2.0:1789785196.331261:0:13201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789785196.331381:0:13201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc1b08400/0x2f18ee3fd845c362 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c35b expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785196.331390:0:13201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dafc1b08400/0x2f18ee3fd845c362 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c35b expref: 23 pid: 6526 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785196.331398:0:13201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb538a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13201:1876725549076096:0@lo:104: 00000100:00100000:2.0:1789785196.331422:0:13201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785196.334175:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00010000:00010000:2.0:1789785196.334571:0:13201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc1b09a00/0x2f18ee3fd845c354 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8560 expref: 12 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785196.334586:0:13201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dafc1b09a00/0x2f18ee3fd845c354 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8560 expref: 12 pid: 6527 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785196.334599:0:13201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83875180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13201:1876725549076224:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789785196.334655:0:13201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc1b09800/0x2f18ee3fd845c34d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c346 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785196.334673:0:13201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dafc1b09800/0x2f18ee3fd845c34d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c346 expref: 23 pid: 6526 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785196.334682:0:13201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83877480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13201:1876725549076352:0@lo:104: 00000100:00100000:2.0:1789785196.334708:0:13201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785196.334810:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549075968 00000100:00100000:0.0:1789785196.334819:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549075968 00000100:00100000:1.0:1789785196.334983:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530118656 00000100:00100000:1.0:1789785196.334988:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530118656 00010000:00010000:1.0:1789785196.335017:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc2051a00/0x2f18ee3fd845c385 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd859f expref: 13 pid: 6527 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785196.335049:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 40 00000100:00100000:1.0:1789785196.335058:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf447b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2398:x1876725530118656:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789785196.335069:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785196.335075:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc2051a00/0x2f18ee3fd845c385 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd859f expref: 13 pid: 6527 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785196.335087:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc2051a00/0x2f18ee3fd845c385 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd859f expref: 13 pid: 6527 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785196.335105:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785196.335143:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf447b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2398:x1876725530118656:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 86us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785196.335150:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 40 00000100:00100000:0.0:1789785196.335324:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549076096 00000100:00100000:0.0:1789785196.335329:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549076096 00000100:00100000:0.0:1789785196.335361:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789785196.335369:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb53a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+4:13201:x1876725549075968:12345-0@lo:104: 00010000:00010000:0.0:1789785196.335381:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08800/0x2f18ee3fd845c369 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c370 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785196.335427:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789785196.335432:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb53a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+4:13201:x1876725549075968:12345-0@lo:104: Request processed in 65us (4173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785196.335439:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789785196.335452:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789785196.335459:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+3:13201:x1876725549076096:12345-0@lo:104: 00010000:00010000:0.0:1789785196.335466:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c35b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c362 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785196.335514:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789785196.335520:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+3:13201:x1876725549076096:12345-0@lo:104: Request processed in 62us (4098us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785196.335525:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:0.0:1789785196.335541:0:9538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789785196.335547:0:9538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08800/0x2f18ee3fd845c369 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c370 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785196.335566:0:9538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b08800 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:0.0:1789785196.335571:0:9538:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08800/0x2f18ee3fd845c369 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c370 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785196.335578:0:9538:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08800/0x2f18ee3fd845c369 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c370 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789785196.335584:0:9538:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08800/0x2f18ee3fd845c369 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c370 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785196.335589:0:9538:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789785196.335619:0:9538:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08800/0x2f18ee3fd845c369 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c370 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785196.335625:0:9538:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789785196.335644:0:9538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08800/0x2f18ee3fd845c369 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c370 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785196.335651:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08800/0x2f18ee3fd845c369 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c370 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785196.335662:0:9538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789785196.335665:0:9538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c35b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c362 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785196.335671:0:9538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b08a00 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:0.0:1789785196.335674:0:9538:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c35b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c362 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785196.335691:0:9538:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c35b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c362 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789785196.335698:0:9538:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c35b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c362 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785196.335702:0:9538:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789785196.335717:0:9538:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c35b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c362 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785196.335722:0:9538:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789785196.335732:0:9538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c35b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c362 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785196.335739:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc1b08a00/0x2f18ee3fd845c35b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c362 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785196.335747:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785196.335748:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785196.335750:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785196.335756:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785196.335766:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549076480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789785196.335794:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785196.335830:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549076480 00000100:00100000:0.0:1789785196.335848:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549076480 00010000:00010000:0.0:1789785196.335863:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc2051600/0x2f18ee3fd845c370 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c369 expref: 24 pid: 6528 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785196.335883:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789785196.335897:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e00759f-51ad-47f9-8892-382c83919083+24:3662:x1876725549076480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789785196.335905:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785196.335910:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc2051600/0x2f18ee3fd845c370 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c369 expref: 24 pid: 6528 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785196.335919:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc2051600/0x2f18ee3fd845c370 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c369 expref: 24 pid: 6528 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785196.335930:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785196.335939:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549076608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789785196.338698:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785196.338774:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549076608 00000100:00100000:1.0:1789785196.338783:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549076608 00010000:00010000:1.0:1789785196.338817:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc1b08400/0x2f18ee3fd845c362 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c35b expref: 25 pid: 6526 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785196.338862:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789785196.338871:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+25:3659:x1876725549076608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789785196.338885:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785196.338891:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc1b08400/0x2f18ee3fd845c362 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c35b expref: 25 pid: 6526 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785196.338904:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc1b08400/0x2f18ee3fd845c362 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c35b expref: 25 pid: 6526 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785196.338923:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785196.339362:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549076352 00000100:00100000:3.0:1789785196.339368:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549076352 00000100:00100000:3.0:1789785196.339402:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789785196.339410:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83875f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e00759f-51ad-47f9-8892-382c83919083+3:13201:x1876725549076352:12345-0@lo:104: 00010000:00010000:3.0:1789785196.339422:0:8466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c346 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c34d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785196.339465:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789785196.339471:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83875f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e00759f-51ad-47f9-8892-382c83919083+3:13201:x1876725549076352:12345-0@lo:104: Request processed in 63us (4763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785196.339486:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789785196.339687:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+25:3659:x1876725549076608:12345-0@lo:103:ldlm_bl.0 Request processed in 816us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785196.339695:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789785196.339740:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549076608:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789785196.340490:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789785196.340498:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c346 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c34d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785196.340507:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09000 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:1.0:1789785196.340511:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c346 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c34d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785196.340521:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c346 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c34d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789785196.340527:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c346 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c34d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785196.340548:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789785196.340580:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c346 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c34d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785196.340587:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789785196.340618:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789785196.340633:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549076736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789785196.340690:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789785196.341031:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c346 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c34d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785196.341041:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09000/0x2f18ee3fd845c346 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c34d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785196.341110:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785196.341111:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785196.341122:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785196.342591:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549076736 00000100:00100000:1.0:1789785196.342601:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549076736 00010000:00010000:1.0:1789785196.343135:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc1b09800/0x2f18ee3fd845c34d lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c346 expref: 25 pid: 6526 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785196.343172:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789785196.343181:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf447480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+25:3659:x1876725549076736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789785196.343195:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785196.343200:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc1b09800/0x2f18ee3fd845c34d lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c346 expref: 25 pid: 6526 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785196.343210:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc1b09800/0x2f18ee3fd845c34d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c346 expref: 25 pid: 6526 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785196.343229:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785196.343302:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf447480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+25:3659:x1876725549076736:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (2610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785196.343309:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:2.0:1789785196.343318:0:13201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dae81eac400/0x2f18ee3fd845c33f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c338 expref: 25 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785196.343376:0:13201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dae81eac400/0x2f18ee3fd845c33f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c338 expref: 24 pid: 6526 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785196.343387:0:13201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83876300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13201:1876725549076864:0@lo:104: 00000100:00100000:2.0:1789785196.343423:0:13201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785196.343439:0:13201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb409c00 going to sleep for 11 seconds 00010000:00010000:2.0:1789785196.343463:0:13201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc2051a00/0x2f18ee3fd845c385 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd859f expref: 12 pid: 6527 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785196.343474:0:13201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13201:1876725549075840:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789785196.343485:0:13201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc2051600/0x2f18ee3fd845c370 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c369 expref: 24 pid: 6528 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785196.343492:0:13201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13201:1876725549075968:0@lo:104: 00010000:00010000:2.0:1789785196.343501:0:13201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1b08400/0x2f18ee3fd845c362 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c35b expref: 23 pid: 6526 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785196.343508:0:13201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb538a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13201:1876725549076096:0@lo:104: 00010000:00010000:2.0:1789785196.343517:0:13201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1b09800/0x2f18ee3fd845c34d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c346 expref: 22 pid: 6526 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785196.343533:0:13201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83877480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13201:1876725549076352:0@lo:104: 00000100:00100000:3.0:1789785196.343660:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549076736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789785196.343915:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549076864 00000100:00100000:1.0:1789785196.343921:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549076864 00000100:00100000:1.0:1789785196.343957:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789785196.344625:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e00759f-51ad-47f9-8892-382c83919083+21:3662:x1876725549076480:12345-0@lo:103:ldlm_bl.0 Request processed in 8727us (8827us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785196.344634:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789785196.345838:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549076480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789785196.351146:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83876a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+3:13201:x1876725549076864:12345-0@lo:104: 00010000:00010000:1.0:1789785196.351169:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845c338 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c33f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785196.351368:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789785196.351375:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83876a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e00759f-51ad-47f9-8892-382c83919083+3:13201:x1876725549076864:12345-0@lo:104: Request processed in 264us (7952us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785196.351385:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1789785196.352050:0:9538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789785196.352059:0:9538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845c338 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c33f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785196.352068:0:9538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a64400 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:3.0:1789785196.352073:0:9538:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845c338 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c33f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785196.352083:0:9538:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845c338 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c33f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789785196.352091:0:9538:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845c338 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c33f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785196.352097:0:9538:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789785196.352155:0:9538:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845c338 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c33f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785196.352161:0:9538:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789785196.352188:0:9538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845c338 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c33f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785196.352195:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845c338 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c33f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785196.352238:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785196.352240:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785196.352242:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785196.352251:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789785196.352266:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549076992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789785196.352315:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785196.353145:0:7484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549076992 00000100:00100000:1.0:1789785196.353155:0:7484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549076992 00010000:00010000:1.0:1789785196.353189:0:7484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dae81eac400/0x2f18ee3fd845c33f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c338 expref: 21 pid: 6526 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785196.353228:0:7484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789785196.353237:0:7484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf444a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e00759f-51ad-47f9-8892-382c83919083+21:3662:x1876725549076992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789785196.353248:0:7484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785196.353254:0:7484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dae81eac400/0x2f18ee3fd845c33f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c338 expref: 21 pid: 6526 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785196.353263:0:7484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dae81eac400/0x2f18ee3fd845c33f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c338 expref: 21 pid: 6526 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785196.353280:0:7484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785196.353335:0:7484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf444a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e00759f-51ad-47f9-8892-382c83919083+21:3662:x1876725549076992:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785196.353363:0:7484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789785196.353404:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549076992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789785196.354603:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785196.355488:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530118784 00000100:00100000:1.0:1789785196.355497:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530118784 00010000:00010000:1.0:1789785196.355530:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc1b09a00/0x2f18ee3fd845c354 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8560 expref: 12 pid: 6527 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785196.355571:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 45 00000100:00100000:1.0:1789785196.355580:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9eac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dddf7d7-41ac-477b-b9db-b5e699635211+12:2397:x1876725530118784:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789785196.355595:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785196.355600:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc1b09a00/0x2f18ee3fd845c354 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8560 expref: 12 pid: 6527 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785196.355612:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc1b09a00/0x2f18ee3fd845c354 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8560 expref: 12 pid: 6527 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785196.355631:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dafc1b09e00/0x2f18ee3fd845c3a8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785196.355640:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1b09e00/0x2f18ee3fd845c3a8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785196.355656:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dafc1b09e00/0x2f18ee3fd845c3a8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785196.355663:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dafc1b09e00/0x2f18ee3fd845c3a8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785196.355686:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dafc1b09e00/0x2f18ee3fd845c3a8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785196.355693:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dafc1b09e00/0x2f18ee3fd845c3a8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785196.355699:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09e00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785196.355703:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dafc1b09e00/0x2f18ee3fd845c3a8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785196.355710:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dafc1b09e00/0x2f18ee3fd845c3a8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785196.355720:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dafc1b09e00/0x2f18ee3fd845c3a8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785196.355730:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785196.355782:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9eac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dddf7d7-41ac-477b-b9db-b5e699635211+12:2397:x1876725530118784:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 203us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785196.355790:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 45 00010000:00010000:0.0:1789785196.358257:0:13201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dae81eac400/0x2f18ee3fd845c33f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c338 expref: 20 pid: 6526 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785196.358278:0:13201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83876300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13201:1876725549076864:0@lo:104: 00010000:00010000:0.0:1789785196.358390:0:13201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1b09a00/0x2f18ee3fd845c354 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8560 expref: 11 pid: 6527 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785196.358404:0:13201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83875180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13201:1876725549076224:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789785196.358563:0:13201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dafc1b09e00/0x2f18ee3fd845c3a8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785196.358574:0:13201:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dafc1b09e00/0x2f18ee3fd845c3a8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785196.358580:0:13201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dafc1b09e00/0x2f18ee3fd845c3a8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785196.358586:0:13201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1b09e00/0x2f18ee3fd845c3a8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785196.546574:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785197.045578:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785197.045626:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785197.045704:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785197.045754:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530118912 00000100:00100000:2.0:1789785197.045764:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530118912 00000100:00100000:2.0:1789785197.045835:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 315 00000100:00100000:2.0:1789785197.045845:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+11:2398:x1876725530118912:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785197.045910:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+11:2398:x1876725530118912:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 66us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785197.045917:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 315 00000100:00100000:1.0:1789785197.048516:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785197.054033:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530119168 00000100:00100000:0.0:1789785197.054049:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530119168 00000100:00100000:0.0:1789785197.054257:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530119424 00000100:00100000:0.0:1789785197.054262:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530119424 00000100:00100000:0.0:1789785197.054297:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 191 00000100:00100000:0.0:1789785197.054307:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530119168:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785197.054581:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530119168:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 275us (8953us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785197.054590:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 191 00000100:00100000:0.0:1789785197.054608:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 192 00000100:00100000:0.0:1789785197.054616:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530119424:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785197.054640:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530119424:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 25us (8935us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785197.054646:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 192 00000100:00100000:1.0:1789785197.054990:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785197.055050:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530119040 00000100:00100000:0.0:1789785197.055055:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530119040 00000100:00100000:0.0:1789785197.055084:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530119296 00000100:00100000:0.0:1789785197.055087:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530119296 00000100:00080000:3.0:1789785197.056045:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789785197.056051:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789785197.060579:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 193 00000100:00100000:1.0:1789785197.060606:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+6:2398:x1876725530119040:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785197.061360:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 194 00000100:00100000:1.0:1789785197.061587:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+6:2398:x1876725530119040:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 993us (13079us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785197.061608:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 193 00000100:00100000:0.0:1789785197.061772:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530119296:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785197.061811:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530119296:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 444us (6823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785197.061823:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 194 00010000:00010000:2.0:1789785197.570727:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785197.996730:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785197.996974:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530119552 00000100:00100000:1.0:1789785197.996984:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530119552 00000100:00100000:1.0:1789785197.997042:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 316 00000100:00100000:1.0:1789785197.997054:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+11:6169:x1876725530119552:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789785197.997070:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785197.997089:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1a64600/0x2f18ee3fd845c3af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd85d0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785197.997129:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1a64600/0x2f18ee3fd845c3af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85d0 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785197.997142:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1a64600/0x2f18ee3fd845c3af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85d0 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785197.997151:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64600, rc 0) 00000100:00100000:1.0:1789785197.997210:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+12:6169:x1876725530119552:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 Request processed in 158us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785197.997218:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 316 00000100:00100000:2.0:1789785198.008026:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785198.008092:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530119680 00000100:00100000:3.0:1789785198.008111:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530119680 00000100:00100000:3.0:1789785198.008171:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 317 00000100:00100000:3.0:1789785198.008182:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+12:6169:x1876725530119680:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789785198.008407:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+12:6169:x1876725530119680:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 Request processed in 220us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785198.008415:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 317 00000100:00100000:3.0:1789785198.022459:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785198.023028:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530119808 00000100:00100000:2.0:1789785198.023039:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530119808 00000100:00100000:2.0:1789785198.023084:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 318 00000100:00100000:2.0:1789785198.023094:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+12:6169:x1876725530119808:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789785198.023237:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+12:6169:x1876725530119808:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 Request processed in 143us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785198.023246:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 318 00000100:00100000:3.0:1789785198.029848:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785198.033227:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530119936 00000100:00100000:1.0:1789785198.033241:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530119936 00000100:00100000:1.0:1789785198.034693:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 319 00000100:00100000:1.0:1789785198.034710:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+12:6169:x1876725530119936:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789785198.034727:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785198.034744:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1a64c00/0x2f18ee3fd845c3b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd85d7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785198.034785:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1a64c00/0x2f18ee3fd845c3b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85d7 expref: 13 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785198.034797:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1a64c00/0x2f18ee3fd845c3b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85d7 expref: 13 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785198.034806:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64c00, rc 0) 00000100:00100000:1.0:1789785198.038474:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+13:6169:x1876725530119936:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 Request processed in 3758us (8622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785198.038486:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 319 00000100:00100000:0.0:1789785198.042405:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785198.042500:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530120064 00000100:00100000:3.0:1789785198.042509:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530120064 00000100:00100000:3.0:1789785198.042565:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 320 00000100:00100000:3.0:1789785198.042574:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+13:6169:x1876725530120064:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789785198.042707:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+13:6169:x1876725530120064:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 Request processed in 134us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785198.042715:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 320 00000100:00100000:3.0:1789785198.045685:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785198.045746:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530120192 00000100:00100000:0.0:1789785198.045755:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530120192 00000100:00100000:0.0:1789785198.045804:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 321 00000100:00100000:0.0:1789785198.045813:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:6169:x1876725530120192:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789785198.045952:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:6169:x1876725530120192:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 Request processed in 139us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785198.045959:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 321 10000000:01000000:2.0:1789785198.086006:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789785198.086015:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dae829a7000 from 7 10000000:01000000:2.0:1789785198.086019:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789785198.086068:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c3bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785198.086098:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c3bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785198.086120:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c3bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785198.086144:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83874e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549077120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789785198.086216:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785198.086300:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb409000 going to sleep for 11 seconds 00000100:00100000:0.0:1789785198.088354:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549077120 00000100:00100000:0.0:1789785198.088369:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549077120 00000100:00100000:0.0:1789785198.088430:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1789785198.088441:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+20:6531:x1876725549077120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789785198.088458:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785198.088476:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dae81eac400/0x2f18ee3fd845c3c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c3bd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785198.089161:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dae81eac400/0x2f18ee3fd845c3c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c3bd expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785198.089176:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dae81eac400/0x2f18ee3fd845c3c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c3bd expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785198.089185:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eac400, rc 0) 00000100:00100000:0.0:1789785198.089267:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549077120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 828us (3051us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785198.089276:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1789785198.089385:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83874e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549077120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789785198.089405:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c3bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c3c4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785198.089416:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c3bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c3c4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785198.089514:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549077248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789785198.089550:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785198.089580:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae835af840 going to sleep for 11 seconds 00000100:00100000:3.0:1789785198.089708:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549077248 00000100:00100000:3.0:1789785198.089713:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549077248 00000100:00100000:3.0:1789785198.089750:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1789785198.089758:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549077248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789785198.089882:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549077248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785198.089889:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1789785198.090018:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549077248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789785198.090050:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549077376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789785198.090111:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785198.090130:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb448000 going to sleep for 11 seconds 00000100:00100000:0.0:1789785198.090143:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549077376 00000100:00100000:0.0:1789785198.090147:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549077376 00000100:00100000:0.0:1789785198.090179:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1789785198.090186:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549077376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789785198.090255:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549077376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785198.090262:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1789785198.090295:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549077376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789785198.091199:0:13246:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789785198.100467:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789785198.100515:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789785198.100527:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c3bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c3c4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785198.100539:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c3bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c3c4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785198.100675:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789785198.100679:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dafb5cd8800 from 7 10000000:01000000:0.0:1789785198.100683:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789785198.100721:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eacc00/0x2f18ee3fd845c3cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785198.100729:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dae81eacc00/0x2f18ee3fd845c3cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785198.100739:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dae81eacc00/0x2f18ee3fd845c3cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785198.100761:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549077504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789785198.100835:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785198.100882:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb448cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789785198.100985:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549077504 00000100:00100000:1.0:1789785198.100992:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549077504 00000100:00100000:1.0:1789785198.101041:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1789785198.101050:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549077504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789785198.101064:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785198.101077:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1a64200/0x2f18ee3fd845c3d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c3cb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785198.101098:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1a64200/0x2f18ee3fd845c3d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c3cb expref: 22 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785198.101119:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1a64200/0x2f18ee3fd845c3d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c3cb expref: 22 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785198.101127:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64200, rc 0) 00000100:00100000:1.0:1789785198.101173:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549077504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785198.101179:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1789785198.101497:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549077504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789785198.101512:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dae81eacc00/0x2f18ee3fd845c3cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c3d2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785198.101530:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dae81eacc00/0x2f18ee3fd845c3cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c3d2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785198.101590:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549077632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789785198.101620:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785198.101642:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb448cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789785198.108684:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549077632 00000100:00100000:1.0:1789785198.108700:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549077632 00000100:00100000:1.0:1789785198.108756:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1789785198.108765:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549077632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789785198.109066:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549077632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 301us (7443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785198.109074:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789785198.109218:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549077632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789785198.109268:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83874000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549077760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789785198.109317:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785198.109372:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb409780 going to sleep for 11 seconds 00000100:00100000:1.0:1789785198.110615:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549077760 00000100:00100000:1.0:1789785198.110630:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549077760 00000100:00100000:1.0:1789785198.110675:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1789785198.110683:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549077760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789785198.110805:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549077760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (1488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785198.110812:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1789785198.110991:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83874000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549077760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789785198.113444:0:13250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789785198.115738:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789785198.115769:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789785198.115782:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eacc00/0x2f18ee3fd845c3cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c3d2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785198.115795:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dae81eacc00/0x2f18ee3fd845c3cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c3d2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785198.115806:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789785198.115809:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dafc189c800 from 7 10000000:01000000:2.0:1789785198.115812:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789785198.115860:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09e00/0x2f18ee3fd845c3d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785198.115881:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09e00/0x2f18ee3fd845c3d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785198.115893:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09e00/0x2f18ee3fd845c3d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785198.115917:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83874000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549077888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789785198.115993:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785198.116040:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb409780 going to sleep for 11 seconds 00000100:00100000:1.0:1789785198.116600:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549077888 00000100:00100000:1.0:1789785198.116609:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549077888 00000100:00100000:1.0:1789785198.116657:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1789785198.116666:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549077888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789785198.116681:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785198.116694:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1a64000/0x2f18ee3fd845c3e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c3d9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785198.116715:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1a64000/0x2f18ee3fd845c3e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c3d9 expref: 23 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785198.116725:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1a64000/0x2f18ee3fd845c3e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c3d9 expref: 23 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785198.116734:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64000, rc 0) 00000100:00100000:1.0:1789785198.116782:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549077888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785198.116789:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1789785198.116953:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83874000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549077888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789785198.116968:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09e00/0x2f18ee3fd845c3d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785198.116978:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09e00/0x2f18ee3fd845c3d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785198.117039:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549078016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789785198.117068:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785198.117095:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549078016 00000100:00100000:0.0:1789785198.117099:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549078016 00000100:00100000:0.0:1789785198.117133:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1789785198.117140:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549078016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789785198.117245:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549078016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785198.117252:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1789785198.117279:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb448000 going to sleep for 11 seconds 00000100:00100000:0.0:1789785198.117289:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549078016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789785198.117313:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549078144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789785198.117376:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785198.117395:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549078144 00000100:00100000:0.0:1789785198.117398:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549078144 00000100:00100000:0.0:1789785198.117416:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1789785198.117422:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549078144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789785198.117679:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549078144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785198.117686:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1789785198.117721:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb448000 going to sleep for 11 seconds 00000100:00100000:0.0:1789785198.117732:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549078144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789785198.134589:0:13251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789785198.135083:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789785198.135121:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789785198.135134:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09e00/0x2f18ee3fd845c3d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785198.135145:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09e00/0x2f18ee3fd845c3d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785198.135156:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789785198.135158:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9daf89061800 from 7 10000000:01000000:2.0:1789785198.135161:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789785198.135200:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09a00/0x2f18ee3fd845c3e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785198.135209:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09a00/0x2f18ee3fd845c3e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785198.135221:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09a00/0x2f18ee3fd845c3e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785198.135259:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83874380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549078272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789785198.135326:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785198.136700:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb409a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789785198.138018:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549078272 00000100:00100000:1.0:1789785198.138030:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549078272 00000100:00100000:1.0:1789785198.138084:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1789785198.138113:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549078272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789785198.138134:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785198.138153:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1a65200/0x2f18ee3fd845c3ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c3e7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785198.138179:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1a65200/0x2f18ee3fd845c3ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c3e7 expref: 24 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785198.138191:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1a65200/0x2f18ee3fd845c3ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c3e7 expref: 24 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785198.138200:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a65200, rc 0) 00000100:00100000:1.0:1789785198.138273:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:6531:x1876725549078272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (2946us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785198.138280:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789785198.138402:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83874380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549078272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789785198.138421:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09a00/0x2f18ee3fd845c3e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c3ee expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785198.138431:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09a00/0x2f18ee3fd845c3e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c3ee expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785198.138510:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83874380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549078400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789785198.138544:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785198.138576:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb409a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789785198.138684:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549078400 00000100:00100000:0.0:1789785198.138689:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549078400 00000100:00100000:0.0:1789785198.138750:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1789785198.138758:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:6531:x1876725549078400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789785198.138879:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:6531:x1876725549078400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785198.138886:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1789785198.139040:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83874380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549078400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789785198.139070:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83874380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549078528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789785198.139120:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785198.139148:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb409a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789785198.139193:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549078528 00000100:00100000:1.0:1789785198.139196:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549078528 00000100:00100000:1.0:1789785198.139223:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1789785198.139229:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:6531:x1876725549078528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789785198.139302:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:6531:x1876725549078528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785198.139308:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1789785198.139409:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83874380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549078528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789785198.140685:0:13255:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789785198.140913:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789785198.140995:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789785198.141005:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09a00/0x2f18ee3fd845c3e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c3ee expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785198.141017:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09a00/0x2f18ee3fd845c3e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c3ee expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785198.402542:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549078656:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789785198.402615:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785198.402876:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549078656 00000100:00100000:0.0:1789785198.402884:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549078656 00000100:00100000:0.0:1789785198.402937:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789785198.402947:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549078656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789785198.402978:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789785198.403023:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549078656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785198.403030:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789785198.403052:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549078912:0@lo:400:kworker.0 00000100:00100000:0.0:1789785198.403077:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785198.403112:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb538a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549079424:0@lo:400:kworker.0 00000100:00100000:0.0:1789785198.403136:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785198.403158:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549079936:0@lo:400:kworker.0 00000100:00100000:0.0:1789785198.403177:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785198.403199:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789785198.403205:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876725549078784:0@lo:400:kworker.0 00000100:00100000:0.0:1789785198.403227:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785198.403243:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549079296:0@lo:400:kworker.0 00000100:00100000:0.0:1789785198.403262:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785198.403274:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1876725549079808:0@lo:400:kworker.0 00000100:00100000:0.0:1789785198.403293:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785198.403332:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549078912 00000100:00100000:0.0:1789785198.403336:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549078912 00000100:00100000:0.0:1789785198.403379:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789785198.403385:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549078912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785198.403424:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549078912:12345-0@lo:400:kworker.0 Request processed in 39us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785198.403440:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789785198.403464:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549079424 00000100:00100000:0.0:1789785198.403468:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549079424 00000100:00100000:0.0:1789785198.403497:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549079936 00000100:00100000:0.0:1789785198.403500:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549079936 00000100:00100000:0.0:1789785198.403518:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789785198.403525:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549079424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785198.403557:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549079424:12345-0@lo:400:kworker.0 Request processed in 33us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785198.403563:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789785198.403574:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789785198.403579:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549079936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785198.403604:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549079936:12345-0@lo:400:kworker.0 Request processed in 25us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785198.403609:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789785198.403635:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549079040:0@lo:400:kworker.0 00000100:00100000:0.0:1789785198.403659:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785198.403677:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549079552:0@lo:400:kworker.0 00000100:00100000:0.0:1789785198.403696:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785198.403710:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549080064:0@lo:400:kworker.0 00000100:00100000:0.0:1789785198.403729:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785198.403745:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789785198.403751:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1876725549079168:0@lo:400:kworker.0 00000100:00100000:0.0:1789785198.403771:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785198.403790:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1876725549079680:0@lo:400:kworker.0 00000100:00100000:0.0:1789785198.403833:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785198.403854:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549078784 00000100:00100000:0.0:1789785198.403858:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549078784 00000100:00100000:0.0:1789785198.403876:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549079296 00000100:00100000:0.0:1789785198.403879:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549079296 00000100:00100000:0.0:1789785198.403891:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549079808 00000100:00100000:0.0:1789785198.403893:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549079808 00000100:00100000:0.0:1789785198.403904:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549079040 00000100:00100000:0.0:1789785198.403906:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549079040 00000100:00100000:0.0:1789785198.403916:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549079168 00000100:00100000:0.0:1789785198.403917:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549079168 00000100:00100000:0.0:1789785198.403928:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549079680 00000100:00100000:0.0:1789785198.403930:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549079680 00000100:00100000:0.0:1789785198.403943:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789785198.403950:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876725549078784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785198.403983:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876725549078784:12345-0@lo:400:kworker.0 Request processed in 33us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785198.403988:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789785198.404001:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789785198.404007:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1876725549079296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785198.404033:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1876725549079296:12345-0@lo:400:kworker.0 Request processed in 27us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785198.404038:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789785198.404049:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789785198.404054:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1876725549079808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785198.404078:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1876725549079808:12345-0@lo:400:kworker.0 Request processed in 24us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785198.404084:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789785198.404117:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789785198.404123:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549079040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785198.404161:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549079040:12345-0@lo:400:kworker.0 Request processed in 38us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785198.404167:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789785198.404176:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789785198.404181:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1876725549079168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785198.404205:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1876725549079168:12345-0@lo:400:kworker.0 Request processed in 24us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785198.404210:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789785198.404222:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789785198.404228:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1876725549079680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785198.404253:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1876725549079680:12345-0@lo:400:kworker.0 Request processed in 25us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785198.404258:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789785198.404278:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549079552 00000100:00100000:0.0:1789785198.404282:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549079552 00000100:00100000:0.0:1789785198.404301:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549080064 00000100:00100000:0.0:1789785198.404304:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549080064 00000100:00100000:0.0:1789785198.404320:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789785198.404326:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549079552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785198.404375:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549079552:12345-0@lo:400:kworker.0 Request processed in 49us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785198.404381:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789785198.404392:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789785198.404398:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549080064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785198.404439:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549080064:12345-0@lo:400:kworker.0 Request processed in 42us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785198.404446:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789785198.404490:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549078656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789785198.404529:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1876725549079168:0@lo:400:kworker.0 00000100:00100000:0.0:1789785198.404539:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1876725549079680:0@lo:400:kworker.0 00000100:00100000:0.0:1789785198.404548:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549079040:0@lo:400:kworker.0 00010000:00080000:0.0:1789785198.404558:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb539500 x1876725549079552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785198.404568:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549079552:0@lo:400:kworker.0 00010000:00080000:0.0:1789785198.404578:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3f2a00 x1876725549080064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785198.404587:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549080064:0@lo:400:kworker.0 00000100:00100000:0.0:1789785198.404619:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876725549078784:0@lo:400:kworker.0 00010000:00080000:0.0:1789785198.404630:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafaca25880 x1876725549079296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785198.404639:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549079296:0@lo:400:kworker.0 00010000:00080000:0.0:1789785198.404648:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3f3480 x1876725549079808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785198.404656:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1876725549079808:0@lo:400:kworker.0 00000100:00100000:0.0:1789785198.404667:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549078912:0@lo:400:kworker.0 00010000:00080000:0.0:1789785198.404687:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb538a80 x1876725549079424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785198.404695:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb538a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549079424:0@lo:400:kworker.0 00010000:00080000:0.0:1789785198.404703:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3f1880 x1876725549079936/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785198.404711:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549079936:0@lo:400:kworker.0 00000100:00080000:3.0:1789785198.405114:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789785198.405119:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789785198.405122:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789785198.405124:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789785198.405169:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789785198.405182:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549080192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789785198.405219:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785198.405433:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549080192 00000100:00100000:3.0:1789785198.405440:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549080192 00000100:00100000:3.0:1789785198.405478:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789785198.405487:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549080192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789785198.405510:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785198.406136:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549080192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 648us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785198.406145:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:1.0:1789785198.408095:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf444700 x1876725549080192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785198.408131:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549080192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789785198.410172:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549080320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789785198.410234:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785198.410333:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549080320 00000100:00100000:0.0:1789785198.410370:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549080320 00000100:00100000:0.0:1789785198.410411:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789785198.410420:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549080320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789785198.410439:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785198.410480:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549080320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785198.410487:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:1.0:1789785198.410621:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae828fce00 x1876725549080320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785198.410639:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549080320:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789785198.594480:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785199.618691:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785199.938790:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae828ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549080448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789785199.938855:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785199.939065:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549080448 00000100:00100000:0.0:1789785199.939073:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549080448 00000100:00100000:0.0:1789785199.939143:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789785199.939154:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549080448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789785199.939182:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785199.939417:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549080576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789785199.939447:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785199.939485:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549080576 00000100:00100000:1.0:1789785199.939488:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549080576 00000100:00100000:1.0:1789785199.939512:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789785199.939518:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549080576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789785199.939529:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785199.939564:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549080576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785199.939571:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789785199.939604:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549080704:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1789785199.939605:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83b59180 x1876725549080576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785199.939622:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549080576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789785199.939630:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785199.939660:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549080704 00000100:00100000:2.0:1789785199.939663:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549080704 00000100:00100000:2.0:1789785199.939689:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789785199.939705:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549080704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789785199.939727:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789785199.939830:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549080704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785199.939837:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789785199.939933:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549080448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 781us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785199.939940:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:2.0:1789785199.940058:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae828ff100 x1876725549080448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785199.940073:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae828ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549080448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789785199.943007:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549080704:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789785200.642631:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789785201.108095:0:13400:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789785201.669765:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785202.163737:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785202.163792:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785202.163847:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785202.163877:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785202.163909:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785202.163913:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530120320 00000100:00100000:3.0:1789785202.163924:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530120320 00000100:00100000:0.0:1789785202.163933:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530120448 00000100:00100000:0.0:1789785202.163939:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530120448 00000100:00100000:3.0:1789785202.163979:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 334 00000100:00100000:0.0:1789785202.163983:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530120704 00000100:00100000:0.0:1789785202.163988:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530120704 00000100:00100000:3.0:1789785202.163992:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2399:x1876725530120320:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785202.164004:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530120576 00000100:00100000:0.0:1789785202.164008:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530120576 00000100:00100000:0.0:1789785202.164031:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530120832 00000100:00100000:0.0:1789785202.164034:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530120832 00000100:00100000:0.0:1789785202.164051:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 201 00000100:00100000:0.0:1789785202.164060:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+6:2399:x1876725530120448:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785202.164068:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2399:x1876725530120320:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 76us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785202.164093:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 334 00000100:00100000:0.0:1789785202.164109:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+6:2399:x1876725530120448:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 49us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785202.164117:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 201 00000100:00080000:3.0:1789785202.164127:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789785202.164133:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789785202.164136:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 202 00000100:00100000:0.0:1789785202.164145:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2399:x1876725530120704:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785202.164171:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2399:x1876725530120704:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 27us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785202.164191:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 202 00000100:00100000:0.0:1789785202.164204:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 203 00000100:00100000:0.0:1789785202.164210:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+5:2399:x1876725530120576:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785202.164234:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+5:2399:x1876725530120576:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 25us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785202.164241:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 203 00000100:00100000:0.0:1789785202.164263:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 204 00000100:00100000:0.0:1789785202.164271:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2399:x1876725530120832:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785202.164303:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2399:x1876725530120832:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 34us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785202.164309:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 204 00010000:00010000:0.0:1789785202.690599:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785203.522768:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549080832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789785203.522839:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785203.522876:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549080960:0@lo:400:kworker.0 00000100:00100000:1.0:1789785203.522887:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876725549081344:0@lo:400:kworker.0 00000100:00100000:0.0:1789785203.523048:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb538a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549081216:0@lo:400:kworker.0 00000100:00100000:3.0:1789785203.527145:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549080832 00000100:00100000:3.0:1789785203.527160:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549080832 00000100:00100000:3.0:1789785203.527233:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789785203.527246:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549080832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789785203.527279:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785203.527447:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785203.527510:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549081856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789785203.527548:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785203.527573:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549081856 00000100:00100000:1.0:1789785203.527577:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549081856 00000100:00100000:1.0:1789785203.527606:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789785203.527614:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549081856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789785203.527636:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789785203.527685:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549081856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785203.527692:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789785203.527734:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549081856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789785203.527754:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1876725549082368:0@lo:400:kworker.0 00000100:00100000:1.0:1789785203.527779:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785203.527802:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549081344 00000100:00100000:1.0:1789785203.527805:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549081344 00000100:00100000:1.0:1789785203.527829:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549082368 00000100:00100000:1.0:1789785203.527832:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549082368 00000100:00100000:1.0:1789785203.527853:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789785203.527859:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876725549081344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785203.527891:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876725549081344:12345-0@lo:400:kworker.0 Request processed in 32us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785203.527914:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789785203.527927:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789785203.527933:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876725549082368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785203.527962:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876725549082368:12345-0@lo:400:kworker.0 Request processed in 30us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785203.527967:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00010000:00080000:1.0:1789785203.527999:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3eaa00 x1876725549082368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785203.528012:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1876725549082368:0@lo:400:kworker.0 00000100:00100000:1.0:1789785203.528024:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876725549081344:0@lo:400:kworker.0 00000100:00100000:1.0:1789785203.528048:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789785203.528054:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549081984:0@lo:400:kworker.0 00000100:00100000:1.0:1789785203.528091:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785203.528114:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549081984 00000100:00100000:1.0:1789785203.528117:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549081984 00000100:00100000:1.0:1789785203.528145:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789785203.528153:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549081984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785203.528184:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549081984:12345-0@lo:400:kworker.0 Request processed in 33us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785203.528190:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:1.0:1789785203.528223:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafaca24e00 x1876725549081984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785203.528232:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549081984:0@lo:400:kworker.0 00000100:00100000:1.0:1789785203.528238:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549082496:0@lo:400:kworker.0 00000100:00100000:2.0:1789785203.528248:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785203.528268:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785203.528287:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549082496 00000100:00100000:1.0:1789785203.528291:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549082496 00000100:00100000:1.0:1789785203.528316:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789785203.528322:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549082496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785203.528373:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549082496:12345-0@lo:400:kworker.0 Request processed in 51us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785203.528380:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:1.0:1789785203.528409:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3e9880 x1876725549082496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785203.528419:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549082496:0@lo:400:kworker.0 00000100:00100000:1.0:1789785203.528451:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725549081088:0@lo:400:kworker.0 00000100:00100000:1.0:1789785203.528476:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785203.528495:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1876725549081600:0@lo:400:kworker.0 00000100:00100000:1.0:1789785203.528514:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785203.528528:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549082112:0@lo:400:kworker.0 00000100:00100000:1.0:1789785203.528547:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785203.528561:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549082624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789785203.528581:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785203.528608:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549081088 00000100:00100000:1.0:1789785203.528611:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549081088 00000100:00100000:1.0:1789785203.528627:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549081600 00000100:00100000:1.0:1789785203.528629:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549081600 00000100:00100000:1.0:1789785203.528642:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789785203.528647:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725549081088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785203.528689:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725549081088:12345-0@lo:400:kworker.0 Request processed in 40us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785203.528695:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789785203.528707:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789785203.528713:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1876725549081600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785203.528740:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1876725549081600:12345-0@lo:400:kworker.0 Request processed in 27us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785203.528745:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789785203.528760:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549082112 00000100:00100000:1.0:1789785203.528764:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549082112 00000100:00100000:1.0:1789785203.528785:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789785203.528791:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549082112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785203.528818:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549082112:12345-0@lo:400:kworker.0 Request processed in 27us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785203.528823:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789785203.528853:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725549081088:0@lo:400:kworker.0 00000100:00100000:1.0:1789785203.528862:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1876725549081600:0@lo:400:kworker.0 00010000:00080000:1.0:1789785203.528871:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafaca27100 x1876725549082112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785203.528879:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549082112:0@lo:400:kworker.0 00000100:00100000:1.0:1789785203.528916:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549082624 00000100:00100000:1.0:1789785203.528920:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549082624 00000100:00100000:1.0:1789785203.528941:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789785203.528947:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549082624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789785203.528969:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785203.529002:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549082624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785203.529008:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:1.0:1789785203.529035:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83b58700 x1876725549082624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785203.529049:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549082624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789785203.529094:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549080960 00000100:00100000:1.0:1789785203.529098:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549080960 00000100:00100000:1.0:1789785203.529126:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1789785203.529132:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:3660:x1876725549080960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785203.529162:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:3660:x1876725549080960:12345-0@lo:400:kworker.0 Request processed in 31us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785203.529167:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00080000:1.0:1789785203.529207:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789785203.529212:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789785203.529214:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789785203.529216:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789785203.532959:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549080960:0@lo:400:kworker.0 00000100:00100000:2.0:1789785203.532976:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549081472:0@lo:400:kworker.0 00000100:00100000:2.0:1789785203.533039:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785203.533136:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549081472 00000100:00100000:1.0:1789785203.533144:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549081472 00000100:00100000:1.0:1789785203.533192:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789785203.533201:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549081472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785203.533252:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549081472:12345-0@lo:400:kworker.0 Request processed in 53us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785203.533259:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789785203.533267:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549081472:0@lo:400:kworker.0 00000100:00100000:0.0:1789785203.536193:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785203.536232:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1876725549081728:0@lo:400:kworker.0 00000100:00100000:0.0:1789785203.536259:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785203.536298:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549081728 00000100:00100000:0.0:1789785203.536305:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549081728 00000100:00100000:0.0:1789785203.536374:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789785203.536383:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1876725549081728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785203.536393:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549081216 00000100:00100000:1.0:1789785203.536407:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549081216 00000100:00100000:0.0:1789785203.536429:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1876725549081728:12345-0@lo:400:kworker.0 Request processed in 48us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785203.536433:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789785203.536436:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789785203.536440:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549081216:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789785203.536456:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789785203.536476:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549081216:12345-0@lo:400:kworker.0 Request processed in 38us (290us total) trans 0 rc 0/0 00010000:00080000:0.0:1789785203.536482:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafaca25880 x1876725549081728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785203.536483:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789785203.536495:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1876725549081728:0@lo:400:kworker.0 00000100:00100000:0.0:1789785203.536503:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1876725549082240:0@lo:400:kworker.0 00000100:00100000:0.0:1789785203.536525:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785203.536570:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb538a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549081216:0@lo:400:kworker.0 00000100:00100000:1.0:1789785203.536852:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549082240 00000100:00100000:1.0:1789785203.536856:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549082240 00000100:00100000:1.0:1789785203.536892:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789785203.536898:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1876725549082240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785203.536931:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1876725549082240:12345-0@lo:400:kworker.0 Request processed in 33us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785203.536937:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789785203.541232:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549080832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 13982us (18383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785203.541248:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:2.0:1789785203.541405:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3f1880 x1876725549080832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785203.541430:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549080832:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789785203.544893:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789785203.544972:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1876725549082240:0@lo:400:kworker.0 00010000:00010000:3.0:1789785203.715598:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785204.739761:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785205.058850:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789785205.058874:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549082880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789785205.058946:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785205.059006:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549082880 00000100:00100000:3.0:1789785205.059012:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549082880 00000100:00100000:3.0:1789785205.059068:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789785205.059076:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf444700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549082880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789785205.059103:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785205.059141:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf444700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549082880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785205.059147:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1789785205.059164:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789785205.059189:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf446300 x1876725549082880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785221 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785205.059207:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549082880:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789785205.059280:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549082752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789785205.059310:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785205.061523:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549083008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789785205.061585:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785205.061640:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549083008 00000100:00100000:2.0:1789785205.061647:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549083008 00000100:00100000:2.0:1789785205.061694:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789785205.061711:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549083008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789785205.061733:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785205.061774:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549083008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785205.061781:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1789785205.061802:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789785205.061828:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3f1880 x1876725549083008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785221 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785205.061845:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549083008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789785205.062211:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549082752 00000100:00100000:0.0:1789785205.062216:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549082752 00000100:00100000:0.0:1789785205.062253:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789785205.062261:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549082752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789785205.062285:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789785205.062357:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549082752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (3024us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785205.062364:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789785205.062534:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549082752:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789785205.762689:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785206.786526:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789785206.886596:0:13549:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 22:33:24 (1789785204) === 00000100:00100000:0.0:1789785207.106450:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785207.106554:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530120960 00000100:00100000:1.0:1789785207.106567:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530120960 00000100:00100000:1.0:1789785207.106648:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 22 00000100:00100000:1.0:1789785207.106660:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+6:2397:x1876725530120960:12345-192.168.203.46@tcp:41:mkdir.0 00000004:00000024:1.0:1789785207.106707:0:7896:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789785207.106806:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+6:2397:x1876725530120960:12345-192.168.203.46@tcp:41:mkdir.0 Request processed in 148us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785207.106813:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 22 00000100:00080000:2.0:1789785207.108131:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789785207.109075:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785207.109158:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530121088 00000100:00100000:0.0:1789785207.109168:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530121088 00000100:00100000:0.0:1789785207.109223:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 2 00000100:00100000:0.0:1789785207.109235:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:026b2112-ee35-499c-8d01-18663664f08e+6:10496:x1876725530121088:12345-192.168.203.46@tcp:700:mkdir.0 00000100:00100000:0.0:1789785207.109414:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:026b2112-ee35-499c-8d01-18663664f08e+6:10496:x1876725530121088:12345-192.168.203.46@tcp:700:mkdir.0 Request processed in 180us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785207.109431:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 2 00000100:00100000:3.0:1789785207.112258:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785207.112399:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530121344 00000100:00100000:0.0:1789785207.112411:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530121344 00000100:00100000:0.0:1789785207.112696:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 23 00000100:00100000:0.0:1789785207.112708:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+6:10496:x1876725530121344:12345-192.168.203.46@tcp:36:mkdir.0 00010000:00010000:0.0:1789785207.112792:0:6535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785207.113085:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d2000/0x2f18ee3fd845c297 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd854b expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.113262:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafac970e00) 00010000:00010000:0.0:1789785207.113274:0:6535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789785207.113412:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c3f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.113425:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c3f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.113435:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c3f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.113471:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c3fc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.113479:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c3fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.113486:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c3fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.113982:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c403 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.113992:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c403 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.114000:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c403 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789785207.114016:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8b16f53 reply state 000000003acf589f transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c403 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.114055:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c403 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.114063:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dafbb1b9a00) 00010000:00010000:0.0:1789785207.114065:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789785207.114068:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789785207.114075:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789785207.114084:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c3f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.114090:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c3f5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.119136:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c3f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.119156:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eace00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785207.119162:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c3f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.119173:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c3f5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.119195:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafbb1b9f00) 00010000:00010000:0.0:1789785207.119198:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785207.119203:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c3f5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.119210:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c3f5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789785207.119260:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8b16f53 reply state 000000003acf589f transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c3fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.119272:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c3fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.119280:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9dafbb1b9c00) 00010000:00010000:0.0:1789785207.119282:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789785207.119285:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789785207.119425:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+7:10496:x1876725530121344:12345-192.168.203.46@tcp:36:mkdir.0 Request processed in 6716us (7178us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789785207.119435:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 23 00000100:00100000:3.0:1789785207.134898:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785207.135083:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530121472 00000100:00100000:1.0:1789785207.135103:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530121472 00000100:00100000:1.0:1789785207.135190:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 24 00000100:00100000:1.0:1789785207.135293:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+7:10497:x1876725530121472:12345-192.168.203.46@tcp:101:chmod.0 00010000:00010000:1.0:1789785207.135326:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785207.135742:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c40a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd85de expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.135900:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845c411 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.135918:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845c411 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.135933:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845c411 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789785207.136000:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789785207.136004:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789785207.136068:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845c411 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.136102:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c40a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85de expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.136125:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845c411 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85de expref: 8 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.136135:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dae827c0200) 00010000:00010000:1.0:1789785207.136140:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789785207.136159:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a65400, rc 0) 00000100:00100000:1.0:1789785207.136305:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+8:10497:x1876725530121472:12345-192.168.203.46@tcp:101:chmod.0 Request processed in 1103us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785207.136315:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 24 00000100:00100000:2.0:1789785207.139893:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785207.140001:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530121728 00000100:00100000:0.0:1789785207.140011:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530121728 00000100:00100000:0.0:1789785207.140081:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 25 00000100:00100000:0.0:1789785207.140092:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+8:10497:x1876725530121728:12345-192.168.203.46@tcp:36:chmod.0 00010000:00010000:0.0:1789785207.140158:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785207.140184:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845c411 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85de expref: 8 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.140206:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dae827c0200) 00010000:00010000:0.0:1789785207.140217:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789785207.140245:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c418 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.140257:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c418 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.140266:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c418 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789785207.140507:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a38a0dee reply state 000000009b58e45c transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c418 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.140519:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c418 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.140526:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafbb1b9f00) 00010000:00010000:0.0:1789785207.140529:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789785207.140532:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789785207.140540:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789785207.140625:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+9:10497:x1876725530121728:12345-192.168.203.46@tcp:36:chmod.0 Request processed in 534us (741us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789785207.140632:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 25 00000100:00100000:3.0:1789785207.159893:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785207.160102:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530121856 00000100:00100000:0.0:1789785207.160116:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530121856 00000100:00100000:0.0:1789785207.160261:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 26 00000100:00100000:0.0:1789785207.160275:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+9:10498:x1876725530121856:12345-192.168.203.46@tcp:101:chown.0 00010000:00010000:0.0:1789785207.160310:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785207.160386:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c41f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd85e5 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.161176:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050400/0x2f18ee3fd845c426 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.161195:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050400/0x2f18ee3fd845c426 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.161210:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050400/0x2f18ee3fd845c426 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785207.161271:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789785207.161275:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789785207.161321:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050400/0x2f18ee3fd845c426 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.161380:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c41f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85e5 expref: 11 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.161404:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050400/0x2f18ee3fd845c426 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85e5 expref: 10 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.161414:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafbb1b9f00) 00010000:00010000:3.0:1789785207.161417:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789785207.161420:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc2050400, rc 0) 00000100:00100000:3.0:1789785207.162132:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+10:10498:x1876725530121856:12345-192.168.203.46@tcp:101:chown.0 Request processed in 1856us (2251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785207.162142:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 26 00000100:00100000:3.0:1789785207.167095:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785207.167202:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530121984 00000100:00100000:1.0:1789785207.167216:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530121984 00000100:00100000:1.0:1789785207.167295:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 27 00000100:00100000:1.0:1789785207.167307:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+10:10498:x1876725530121984:12345-192.168.203.46@tcp:101:chown.0 00010000:00010000:1.0:1789785207.167358:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785207.167387:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c42d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd85ec expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.167492:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c434 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.167510:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c434 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.167525:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c434 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.167539:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c43b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.167547:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c43b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.167554:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c43b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.168022:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845c442 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.168054:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845c442 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.168063:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845c442 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789785207.168119:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789785207.168123:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789785207.168149:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845c442 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.168163:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c434 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.168171:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c434 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.168179:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c434 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.168185:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785207.168190:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c434 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.168198:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c434 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.168213:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafbb1b9f00) 00010000:00010000:1.0:1789785207.168217:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785207.168222:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c434 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.168240:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c434 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.168257:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c43b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.168265:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c43b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.168271:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c43b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.168276:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785207.168280:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c43b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.168286:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c43b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.168294:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9dafbb1b9c00) 00010000:00010000:1.0:1789785207.168296:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785207.168300:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c43b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.168306:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c43b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.168365:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c42d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85ec expref: 12 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.168381:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845c442 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85ec expref: 11 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.168396:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dafbb1b9a00) 00010000:00010000:1.0:1789785207.168398:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789785207.168401:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64a00, rc 0) 00000100:00100000:1.0:1789785207.169236:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+11:10498:x1876725530121984:12345-192.168.203.46@tcp:101:chown.0 Request processed in 1925us (2150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785207.169246:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 27 00000100:00100000:3.0:1789785207.171978:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785207.172090:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530122112 00000100:00100000:0.0:1789785207.172101:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530122112 00000100:00100000:0.0:1789785207.172167:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00100000:0.0:1789785207.172179:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:026b2112-ee35-499c-8d01-18663664f08e+11:10498:x1876725530122112:12345-192.168.203.46@tcp:900:chown.0 00000100:00100000:0.0:1789785207.172276:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:026b2112-ee35-499c-8d01-18663664f08e+11:10498:x1876725530122112:12345-192.168.203.46@tcp:900:chown.0 Request processed in 98us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785207.172303:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00100000:1.0:1789785207.176663:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785207.176827:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530122368 00000100:00100000:2.0:1789785207.176840:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530122368 00000100:00100000:2.0:1789785207.177009:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 28 00000100:00100000:2.0:1789785207.177023:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+11:10498:x1876725530122368:12345-192.168.203.46@tcp:36:chown.0 00010000:00010000:2.0:1789785207.177103:0:11254:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785207.177141:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845c442 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85ec expref: 11 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.177164:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dafbb1b9a00) 00010000:00010000:2.0:1789785207.177170:0:11254:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789785207.177202:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09c00/0x2f18ee3fd845c449 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.177240:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09c00/0x2f18ee3fd845c449 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.177253:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09c00/0x2f18ee3fd845c449 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789785207.182010:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:2.0:1789785207.182948:0:11254:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082807985 reply state 000000003e6770e9 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09c00/0x2f18ee3fd845c449 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.182981:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09c00/0x2f18ee3fd845c449 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.182991:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dafbb1b9a00) 00010000:00010000:2.0:1789785207.182995:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789785207.183000:0:11254:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789785207.183017:0:11254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1789785207.183158:0:11254:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789785207.183180:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+9:10498:x1876725530122368:12345-192.168.203.46@tcp:36:chown.0 Request processed in 6155us (6588us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789785207.183191:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 28 00010000:00010000:0.0:1789785207.184677:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09c00/0x2f18ee3fd845c449 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.184698:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09c00/0x2f18ee3fd845c449 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.184706:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09c00/0x2f18ee3fd845c449 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.184712:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785207.184717:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09c00/0x2f18ee3fd845c449 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.184726:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09c00/0x2f18ee3fd845c449 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.184743:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dafbb1b9a00) 00010000:00010000:0.0:1789785207.184746:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789785207.184751:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09c00/0x2f18ee3fd845c449 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.184757:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09c00/0x2f18ee3fd845c449 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.191889:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c3fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.191914:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c3fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.191923:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c3fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.191931:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81ead400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785207.191937:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c3fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.191946:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c3fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.191979:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9dafbb1b9c00) 00010000:00010000:1.0:1789785207.191982:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785207.191988:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c3fc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.191995:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c3fc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.192049:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c403 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.192057:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c403 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.192063:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c403 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.192069:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eac800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785207.192072:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c403 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.192078:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c403 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.192086:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dafbb1b9a00) 00010000:00010000:1.0:1789785207.192089:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785207.192092:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c403 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.192098:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c403 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.192115:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c418 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.192121:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c418 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.192128:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c418 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.192151:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eace00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785207.192155:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c418 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.192160:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c418 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.192169:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafbb1b9f00) 00010000:00010000:1.0:1789785207.192171:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789785207.192174:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c418 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.192179:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c418 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785207.203678:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785207.203780:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530122496 00000100:00100000:3.0:1789785207.203793:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530122496 00000100:00100000:3.0:1789785207.203867:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 29 00000100:00100000:3.0:1789785207.203880:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+6:10499:x1876725530122496:12345-192.168.203.46@tcp:101:touch.500 00010000:00010000:3.0:1789785207.203914:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785207.203940:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050200/0x2f18ee3fd845c450 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd85f3 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789785207.206059:0:6535:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2047us 00010000:00010000:3.0:1789785207.221140:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050e00/0x2f18ee3fd845c457 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.221171:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050e00/0x2f18ee3fd845c457 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.221185:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050e00/0x2f18ee3fd845c457 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.221214:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051e00/0x2f18ee3fd845c45e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.221222:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051e00/0x2f18ee3fd845c45e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.221228:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051e00/0x2f18ee3fd845c45e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.221418:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051600/0x2f18ee3fd845c465 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.221434:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051600/0x2f18ee3fd845c465 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.221443:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051600/0x2f18ee3fd845c465 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785207.221485:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789785207.221489:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789785207.221537:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051600/0x2f18ee3fd845c465 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.221552:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050e00/0x2f18ee3fd845c457 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.221560:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050e00/0x2f18ee3fd845c457 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.221568:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050e00/0x2f18ee3fd845c457 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.221574:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc2050e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785207.221579:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050e00/0x2f18ee3fd845c457 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.221587:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050e00/0x2f18ee3fd845c457 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.221603:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafbb1b9f00) 00010000:00010000:3.0:1789785207.221606:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785207.221612:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050e00/0x2f18ee3fd845c457 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.221629:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050e00/0x2f18ee3fd845c457 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.221642:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051e00/0x2f18ee3fd845c45e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.221648:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051e00/0x2f18ee3fd845c45e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.221654:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051e00/0x2f18ee3fd845c45e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.221659:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc2051e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785207.221662:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051e00/0x2f18ee3fd845c45e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.221667:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051e00/0x2f18ee3fd845c45e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.221674:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9daf94af3700) 00010000:00010000:3.0:1789785207.221677:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785207.221679:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051e00/0x2f18ee3fd845c45e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.221685:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051e00/0x2f18ee3fd845c45e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.221728:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050200/0x2f18ee3fd845c450 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85f3 expref: 8 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.221741:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051600/0x2f18ee3fd845c465 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85f3 expref: 7 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.221755:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9daf94af3300) 00010000:00010000:3.0:1789785207.221757:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789785207.221760:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc2051600, rc 0) 00000100:00100000:3.0:1789785207.221933:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+7:10499:x1876725530122496:12345-192.168.203.46@tcp:101:touch.500 Request processed in 18053us (18273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785207.221942:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 29 00000100:00100000:3.0:1789785207.234402:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785207.234472:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530122752 00000100:00100000:1.0:1789785207.234487:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530122752 00000100:00100000:1.0:1789785207.234574:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 30 00000100:00100000:1.0:1789785207.234586:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+7:10499:x1876725530122752:12345-192.168.203.46@tcp:101:touch.500 00010000:00010000:1.0:1789785207.234606:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785207.234624:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c46c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd85fa expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.234728:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c473 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.234742:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c473 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.234759:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c473 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.234787:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c47a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.234794:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c47a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.234802:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c47a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789785207.235260:0:6534:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1789785207.235443:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c481 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.235453:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c481 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.235461:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c481 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.235494:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c473 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.235500:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c473 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.235507:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c473 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.235512:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785207.235516:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c473 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.235534:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c473 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.235546:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9daf94af3300) 00010000:00010000:1.0:1789785207.235549:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785207.235553:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c473 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.235559:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c473 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789785207.235572:0:6534:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de299c3b reply state 00000000a833f681 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c47a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.235582:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c47a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.235587:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff9dae827c0f00) 00010000:00010000:1.0:1789785207.235589:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789785207.235592:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789785207.235624:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c46c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85fa expref: 10 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.235636:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c481 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85fa expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.235642:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9dae827c0000) 00010000:00010000:1.0:1789785207.235644:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789785207.235646:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64400, rc 0) 00000100:00100000:1.0:1789785207.235714:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+10:10499:x1876725530122752:12345-192.168.203.46@tcp:101:touch.500 Request processed in 1130us (1326us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789785207.235733:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 30 00000100:00100000:0.0:1789785207.239495:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785207.239588:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530123008 00000100:00100000:2.0:1789785207.239602:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530123008 00000100:00100000:2.0:1789785207.239683:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 31 00000100:00100000:2.0:1789785207.239696:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+10:10499:x1876725530123008:12345-192.168.203.46@tcp:36:touch.500 00010000:00010000:2.0:1789785207.239751:0:11254:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785207.239776:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c481 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85fa expref: 10 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.239816:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9dae827c0000) 00010000:00010000:2.0:1789785207.239827:0:11254:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789785207.239883:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08200/0x2f18ee3fd845c48f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.239896:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08200/0x2f18ee3fd845c48f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.239906:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08200/0x2f18ee3fd845c48f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789785207.240017:0:11254:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006457429 reply state 00000000dcd7ca1d transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08200/0x2f18ee3fd845c48f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.240030:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08200/0x2f18ee3fd845c48f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.240049:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9daf87d6e800) 00010000:00010000:2.0:1789785207.240051:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789785207.240054:0:11254:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789785207.240151:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+11:10499:x1876725530123008:12345-192.168.203.46@tcp:36:touch.500 Request processed in 457us (669us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789785207.240158:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 31 00000100:00100000:3.0:1789785207.243305:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785207.244185:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530123136 00000100:00100000:1.0:1789785207.244201:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530123136 00000100:00100000:1.0:1789785207.244269:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 32 00000100:00100000:1.0:1789785207.244279:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+11:10499:x1876725530123136:12345-192.168.203.46@tcp:101:touch.500 00010000:00010000:1.0:1789785207.244301:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785207.244320:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845c496 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8601 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.244420:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845c496 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8601 expref: 12 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.244435:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845c496 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8601 expref: 12 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.244455:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9daf87d6e800) 00010000:00010000:1.0:1789785207.244458:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789785207.244461:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64a00, rc 0) 00000100:00100000:1.0:1789785207.244518:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+12:10499:x1876725530123136:12345-192.168.203.46@tcp:101:touch.500 Request processed in 241us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785207.244526:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 32 00000100:00100000:3.0:1789785207.246970:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785207.247071:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530123264 00000100:00100000:1.0:1789785207.247084:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530123264 00000100:00100000:1.0:1789785207.247143:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 24 00000100:00100000:1.0:1789785207.247151:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2396:x1876725530123264:12345-192.168.203.46@tcp:8:touch.500 00010000:00080000:1.0:1789785207.247185:0:8451:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp t0 exp 0000000000000000 cur 315 last 0 00000020:00000080:1.0:1789785207.247232:0:8451:0:(genops.c:1385:class_connect()) connect: client 026b2112-ee35-499c-8d01-18663664f08e, cookie 0x2f18ee3fd845c49d 00002000:00100000:1.0:1789785207.247243:0:8451:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 026b2112-ee35-499c-8d01-18663664f08e/ffff9dafbf3c2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789785207.247261:0:8451:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789785207.247393:0:8451:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789785207.247451:0:8451:0:(import.c:65:import_set_state_nolock()) ffff9dafbf439000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789785207.247521:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+6:2396:x1876725530123264:12345-192.168.203.46@tcp:8:touch.500 Request processed in 368us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785207.247529:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 24 00000100:00100000:0.0:1789785207.249956:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785207.250195:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530123392 00000100:00100000:1.0:1789785207.250204:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530123392 00000100:00100000:1.0:1789785207.250332:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 25 00000100:00100000:1.0:1789785207.250381:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+6:0:x1876725530123392:12345-192.168.203.46@tcp:2:touch.500 00000100:00080000:2.0:1789785207.250765:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789785207.260644:0:8445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:1.0:1789785207.260656:0:8445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 026b2112-ee35-499c-8d01-18663664f08e 00000100:00100000:2.0:1789785207.260923:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+5:0:x1876725530123392:12345-192.168.203.46@tcp:2:touch.500 Request processed in 10540us (10970us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789785207.260934:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 25 00000100:00100000:3.0:1789785207.269399:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785207.269551:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530123648 00000100:00100000:2.0:1789785207.269560:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530123648 00000100:00100000:2.0:1789785207.269633:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 2 00000100:00100000:2.0:1789785207.269642:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+12:10499:x1876725530123648:12345-192.168.203.46@tcp:35:touch.500 00000100:00100000:2.0:1789785207.269922:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+13:10499:x1876725530123648:12345-192.168.203.46@tcp:35:touch.500 Request processed in 280us (531us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789785207.269930:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 2 00000100:00100000:3.0:1789785207.276944:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785207.276986:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785207.277019:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785207.277061:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785207.277181:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530124032 00000100:00100000:0.0:1789785207.277190:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530124032 00000100:00100000:0.0:1789785207.277246:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530123904 00000100:00100000:0.0:1789785207.277260:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530123904 00000100:00100000:0.0:1789785207.277297:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530124160 00000100:00100000:0.0:1789785207.277300:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530124160 00000100:00100000:0.0:1789785207.277317:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 211 00000100:00100000:0.0:1789785207.277326:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2399:x1876725530124032:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785207.277433:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2399:x1876725530124032:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 108us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785207.277441:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 211 00000100:00100000:0.0:1789785207.277468:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 212 00000100:00100000:0.0:1789785207.277476:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+5:2399:x1876725530123904:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785207.277503:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+5:2399:x1876725530123904:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 28us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785207.277509:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 212 00000100:00100000:0.0:1789785207.277520:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 213 00000100:00100000:0.0:1789785207.277526:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2399:x1876725530124160:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785207.277549:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2399:x1876725530124160:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 23us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785207.277555:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 213 00000100:00080000:3.0:1789785207.277980:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789785207.277985:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789785207.278047:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530123776 00000100:00100000:2.0:1789785207.278053:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530123776 00000100:00100000:2.0:1789785207.278093:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 336 00000100:00100000:2.0:1789785207.278102:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2399:x1876725530123776:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785207.278143:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2399:x1876725530123776:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 43us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785207.278149:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 336 00000100:00100000:3.0:1789785207.305050:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785207.305220:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530124288 00000100:00100000:0.0:1789785207.305234:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530124288 00000100:00100000:0.0:1789785207.305316:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 33 00000100:00100000:0.0:1789785207.305330:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+13:10500:x1876725530124288:12345-192.168.203.46@tcp:101:rm.0 00010000:00010000:0.0:1789785207.305420:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785207.305449:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c4a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8608 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.305566:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c4ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.305584:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c4ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.305597:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c4ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785207.305654:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789785207.305658:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789785207.305702:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c4ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.305732:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c4a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8608 expref: 15 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.305935:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c4ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8608 expref: 14 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.305947:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9daf94af3300) 00010000:00010000:0.0:1789785207.305950:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789785207.305955:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81ead400, rc 0) 00000100:00100000:0.0:1789785207.306045:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+14:10500:x1876725530124288:12345-192.168.203.46@tcp:101:rm.0 Request processed in 707us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785207.306054:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 33 00000100:00100000:0.0:1789785207.312499:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785207.312643:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530124544 00000100:00100000:2.0:1789785207.312656:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530124544 00000100:00100000:2.0:1789785207.312735:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 34 00000100:00100000:2.0:1789785207.312748:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+14:10500:x1876725530124544:12345-192.168.203.46@tcp:101:rm.0 00010000:00010000:2.0:1789785207.313040:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785207.313068:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845c4b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd860f expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789785207.313202:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789785207.313704:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845c4b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd860f expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.313723:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafbb1b9f00) 00010000:00010000:2.0:1789785207.313726:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789785207.313741:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845c4b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd860f expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.313826:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b08000, rc 0) 00000100:00100000:2.0:1789785207.314099:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+15:10500:x1876725530124544:12345-192.168.203.46@tcp:101:rm.0 Request processed in 1351us (1612us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1789785207.314109:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 34 00000100:00100000:3.0:1789785207.319704:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785207.319855:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530124672 00000100:00100000:2.0:1789785207.319869:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530124672 00000100:00100000:2.0:1789785207.319948:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 3 00000100:00100000:2.0:1789785207.319960:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+15:10500:x1876725530124672:12345-192.168.203.46@tcp:37:rm.0 00000100:00100000:1.0:1789785207.324939:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+15:10500:x1876725530124672:12345-192.168.203.46@tcp:37:rm.0 Request processed in 4965us (5235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785207.324962:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 3 00000100:00100000:0.0:1789785207.329325:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785207.329636:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530124928 00000100:00100000:3.0:1789785207.329650:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530124928 00000100:00100000:2.0:1789785207.330057:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 4 00000100:00100000:2.0:1789785207.330072:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf88777450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+15:10500:x1876725530124928:12345-192.168.203.46@tcp:35:rm.0 00000100:00100000:2.0:1789785207.330449:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf88777450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+16:10500:x1876725530124928:12345-192.168.203.46@tcp:35:rm.0 Request processed in 379us (1138us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789785207.330458:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 4 00000100:00100000:3.0:1789785207.333967:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785207.334221:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530125184 00000100:00100000:1.0:1789785207.334235:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530125184 00000100:00100000:1.0:1789785207.334313:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 35 00000100:00100000:1.0:1789785207.334326:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+16:10500:x1876725530125184:12345-192.168.203.46@tcp:101:rm.0 00010000:00010000:1.0:1789785207.334391:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785207.334419:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c4c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8616 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.334578:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845c4c7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.334608:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845c4c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.334622:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845c4c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789785207.334636:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789785207.334784:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c4c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8616 expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.334807:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845c4c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8616 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.334817:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9daf94af3300) 00010000:00010000:1.0:1789785207.334820:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789785207.334825:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a65400, rc 0) 00000100:00100000:1.0:1789785207.335192:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+18:10500:x1876725530125184:12345-192.168.203.46@tcp:101:rm.0 Request processed in 580us (952us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789785207.335203:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 35 00000100:00100000:3.0:1789785207.339090:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785207.339390:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530125312 00000100:00100000:0.0:1789785207.339402:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530125312 00000100:00100000:0.0:1789785207.339481:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 36 00000100:00100000:0.0:1789785207.339494:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+18:10500:x1876725530125312:12345-192.168.203.46@tcp:41:rm.0 00000004:00000024:0.0:1789785207.339578:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1789785207.339670:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+18:10500:x1876725530125312:12345-192.168.203.46@tcp:41:rm.0 Request processed in 178us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785207.339680:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 36 00000100:00100000:2.0:1789785207.343652:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785207.343811:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530125440 00000100:00100000:0.0:1789785207.343824:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530125440 00000100:00100000:0.0:1789785207.344092:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 37 00000100:00100000:0.0:1789785207.344105:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+18:10500:x1876725530125440:12345-192.168.203.46@tcp:101:rm.0 00010000:00010000:0.0:1789785207.344131:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785207.344155:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c4d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd861d expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.344263:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c4dc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.344281:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c4dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.344295:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c4dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.344308:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c4e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.344315:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.344329:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.344599:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845c4ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.344608:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845c4ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.344615:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845c4ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785207.344660:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789785207.344665:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789785207.344685:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845c4ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.344697:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845c4ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.344707:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c4dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.344713:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c4dc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.344720:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c4dc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.344725:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eace00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785207.344730:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c4dc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.344747:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c4dc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.344830:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9daf94af3300) 00010000:00010000:0.0:1789785207.344834:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785207.344976:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c4dc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.344985:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c4dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.345001:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.345006:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c4e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.345013:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c4e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.345018:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eada00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785207.345020:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c4e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.345027:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c4e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.345048:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff9dae827c0f00) 00010000:00010000:0.0:1789785207.345050:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785207.345054:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c4e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.345070:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c4e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.345105:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c4d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd861d expref: 20 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.345120:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845c4ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd861d expref: 19 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785207.345127:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9daf87d6e800) 00010000:00010000:0.0:1789785207.345130:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789785207.345133:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf80031a00, rc 0) 00000100:00100000:0.0:1789785207.345285:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+19:10500:x1876725530125440:12345-192.168.203.46@tcp:101:rm.0 Request processed in 1181us (1645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785207.345294:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 37 00000100:00100000:2.0:1789785207.349220:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785207.349303:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530125696 00000100:00100000:1.0:1789785207.349315:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530125696 00000100:00100000:1.0:1789785207.349410:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 38 00000100:00100000:1.0:1789785207.349434:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+19:10500:x1876725530125696:12345-192.168.203.46@tcp:36:rm.0 00010000:00010000:1.0:1789785207.349540:0:11254:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789785207.349574:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845c4ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd861d expref: 19 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.349617:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845c496 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8601 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.349630:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9daf87d6e800) 00010000:00010000:1.0:1789785207.349641:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c4ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8608 expref: 17 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.349650:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9daf94af3300) 00010000:00010000:1.0:1789785207.349654:0:11254:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789785207.349681:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c4f1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.349695:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c4f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.349705:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c4f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.349718:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c4f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.349725:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c4f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.349731:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c4f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.349915:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c4ff lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.349935:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c4ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.349942:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c4ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789785207.350240:0:11254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1789785207.350252:0:11254:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 315603912702ns, next at 316603909879ns, rc = 0 00010000:00010000:1.0:1789785207.350310:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845c506 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.350319:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845c506 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.350327:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845c506 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.350334:0:11254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845c506 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.350373:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845c506 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.350380:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845c506 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.350400:0:11254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789785207.350422:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c4ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.350428:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c4ff lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.350443:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c4ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.350449:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a64400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785207.350454:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c4ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.350464:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c4ff lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.350475:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9daf87d6e800) 00010000:00010000:1.0:1789785207.350478:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789785207.350482:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c4ff lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.350489:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c4ff lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.350509:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c4f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.350516:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c4f1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.350521:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c4f1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.350526:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785207.350529:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c4f1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.350544:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c4f1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.350553:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9daf94af3300) 00010000:00010000:1.0:1789785207.350556:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785207.350559:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c4f1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.350565:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845c4f1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789785207.350576:0:11254:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051ba13d3 reply state 0000000083c0bad7 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c4f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.350589:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c4f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785207.350595:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff9dae827c0f00) 00010000:00010000:1.0:1789785207.350598:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789785207.350600:0:11254:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789785207.351232:0:9538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789785207.351243:0:9538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845c506 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.351250:0:9538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc21cb800 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:3.0:1789785207.351264:0:9538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845c506 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.351272:0:9538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845c506 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.351283:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9daf87d6e800) 00010000:00010000:3.0:1789785207.351286:0:9538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789785207.351290:0:9538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845c506 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.351296:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845c506 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785207.351312:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785207.351314:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785207.351316:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785207.351975:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+18:10500:x1876725530125696:12345-192.168.203.46@tcp:36:rm.0 Request processed in 2546us (2760us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789785207.351987:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 38 00000100:00100000:2.0:1789785207.355251:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785207.355620:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530125952 00000100:00100000:1.0:1789785207.355632:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530125952 00000100:00100000:1.0:1789785207.355725:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:1.0:1789785207.355737:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+18:10500:x1876725530125952:12345-192.168.203.46@tcp:35:rm.0 00000100:00100000:1.0:1789785207.356230:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+19:10500:x1876725530125952:12345-192.168.203.46@tcp:35:rm.0 Request processed in 493us (989us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789785207.356254:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:0.0:1789785207.359561:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785207.359664:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530126208 00000100:00100000:2.0:1789785207.359678:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530126208 00000100:00100000:2.0:1789785207.359760:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 39 00000100:00100000:2.0:1789785207.359773:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+19:10500:x1876725530126208:12345-192.168.203.46@tcp:36:rm.0 00010000:00010000:2.0:1789785207.359855:0:7896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789785207.359889:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845c4c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8616 expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.359952:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051600/0x2f18ee3fd845c465 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85f3 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.359964:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9daf94af3300) 00010000:00010000:2.0:1789785207.359981:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050400/0x2f18ee3fd845c426 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85e5 expref: 17 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.359991:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafbb1b9f00) 00010000:00010000:2.0:1789785207.359998:0:7896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789785207.360029:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845c50d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.360057:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845c50d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.360068:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845c50d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.360083:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c514 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.360089:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c514 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.360096:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c514 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.360204:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09c00/0x2f18ee3fd845c51b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.360223:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09c00/0x2f18ee3fd845c51b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.360231:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09c00/0x2f18ee3fd845c51b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789785207.360582:0:7896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789785207.360603:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09c00/0x2f18ee3fd845c51b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.360610:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09c00/0x2f18ee3fd845c51b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.360617:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09c00/0x2f18ee3fd845c51b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.360622:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785207.360628:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09c00/0x2f18ee3fd845c51b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.360636:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09c00/0x2f18ee3fd845c51b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.360646:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9daf87d6ee00) 00010000:00010000:2.0:1789785207.360648:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789785207.360652:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09c00/0x2f18ee3fd845c51b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.360657:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09c00/0x2f18ee3fd845c51b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.360676:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845c50d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.360689:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845c50d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.360694:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845c50d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.360699:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b08000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785207.360702:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845c50d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.360707:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845c50d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.360715:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9daf87d6ec00) 00010000:00010000:2.0:1789785207.360718:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785207.360721:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845c50d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.360727:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845c50d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789785207.360739:0:7896:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e67378f3 reply state 00000000d192abad transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c514 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.360750:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c514 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785207.360756:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9daf87d6eb00) 00010000:00010000:2.0:1789785207.360758:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789785207.360761:0:7896:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789785207.360852:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+18:10500:x1876725530126208:12345-192.168.203.46@tcp:36:rm.0 Request processed in 1081us (1303us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789785207.360868:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 39 00010000:00010000:0.0:1789785207.812382:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785208.643416:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549083136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789785208.643488:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785208.643550:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789785208.643557:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549083264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789785208.643583:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785208.643618:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549083264 00000100:00100000:1.0:1789785208.643625:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549083264 00000100:00100000:1.0:1789785208.643670:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789785208.643679:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549083264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789785208.643725:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789785208.643769:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549083264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785208.643777:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789785208.644312:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549083392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789785208.644354:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785208.644389:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549083136 00000100:00100000:0.0:1789785208.644392:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549083136 00000100:00100000:0.0:1789785208.644422:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549083392 00000100:00100000:0.0:1789785208.644424:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549083392 00000100:00100000:0.0:1789785208.644437:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789785208.644442:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549083136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789785208.644460:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785208.644487:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549083136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785208.644499:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789785208.644511:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789785208.644516:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549083392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789785208.644524:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785208.644552:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549083392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785208.644558:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:0.0:1789785208.644590:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3e8700 x1876725549083392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785208.644607:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549083392:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789785208.646155:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789785208.649122:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725549083648:0@lo:400:kworker.0 00000100:00100000:1.0:1789785208.649198:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785208.649244:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725549084160:0@lo:400:kworker.0 00000100:00100000:1.0:1789785208.649266:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785208.649290:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549084672:0@lo:400:kworker.0 00000100:00100000:1.0:1789785208.649311:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785208.649369:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549083264:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1789785208.649387:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3f2a00 x1876725549083136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785208.649401:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549083136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789785208.649432:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789785208.649439:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549083776:0@lo:400:kworker.0 00000100:00100000:1.0:1789785208.649465:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785208.649491:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549084288:0@lo:400:kworker.0 00000100:00100000:1.0:1789785208.649514:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785208.649541:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549083648 00000100:00100000:1.0:1789785208.649547:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549083648 00000100:00100000:1.0:1789785208.649589:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549084160 00000100:00100000:1.0:1789785208.649592:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549084160 00000100:00100000:1.0:1789785208.649620:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549084672 00000100:00100000:1.0:1789785208.649623:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549084672 00000100:00100000:1.0:1789785208.649638:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789785208.649646:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725549083648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785208.649697:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725549083648:12345-0@lo:400:kworker.0 Request processed in 51us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785208.649704:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789785208.649718:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789785208.649723:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725549084160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785208.649744:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725549084160:12345-0@lo:400:kworker.0 Request processed in 22us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785208.649749:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789785208.649758:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789785208.649764:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549084672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785208.649783:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549084672:12345-0@lo:400:kworker.0 Request processed in 20us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785208.649788:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789785208.649812:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549083776 00000100:00100000:1.0:1789785208.649815:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549083776 00000100:00100000:1.0:1789785208.649834:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789785208.649841:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549083776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785208.649866:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549083776:12345-0@lo:400:kworker.0 Request processed in 27us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785208.649872:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789785208.649886:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549084288 00000100:00100000:1.0:1789785208.649889:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549084288 00000100:00100000:1.0:1789785208.649914:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789785208.649920:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb73a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549084288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785208.649946:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb73a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549084288:12345-0@lo:400:kworker.0 Request processed in 27us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785208.649952:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789785208.650138:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549083776:0@lo:400:kworker.0 00010000:00080000:1.0:1789785208.650148:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae8393f800 x1876725549084288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785208.650156:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549084288:0@lo:400:kworker.0 00000100:00100000:1.0:1789785208.650164:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725549083648:0@lo:400:kworker.0 00010000:00080000:1.0:1789785208.650171:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83981500 x1876725549084160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785208.650177:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725549084160:0@lo:400:kworker.0 00010000:00080000:1.0:1789785208.650184:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae8393ed80 x1876725549084672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785208.650190:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549084672:0@lo:400:kworker.0 00000100:00100000:3.0:1789785208.651202:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549083520:0@lo:400:kworker.0 00000100:00100000:3.0:1789785208.651256:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785208.651299:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1876725549084032:0@lo:400:kworker.0 00000100:00100000:3.0:1789785208.651327:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785208.651368:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1876725549084544:0@lo:400:kworker.0 00000100:00100000:3.0:1789785208.651391:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785208.651417:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789785208.651423:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1876725549083904:0@lo:400:kworker.0 00000100:00100000:3.0:1789785208.651442:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785208.651458:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549084416:0@lo:400:kworker.0 00000100:00100000:3.0:1789785208.651480:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785208.651570:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549084032 00000100:00100000:3.0:1789785208.651575:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549084032 00000100:00100000:3.0:1789785208.651602:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549084544 00000100:00100000:3.0:1789785208.651604:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549084544 00000100:00100000:3.0:1789785208.651614:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549083904 00000100:00100000:3.0:1789785208.651616:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549083904 00000100:00100000:3.0:1789785208.651629:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789785208.651637:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8393ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1876725549084032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785208.651679:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8393ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1876725549084032:12345-0@lo:400:kworker.0 Request processed in 42us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785208.651686:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789785208.651700:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789785208.651706:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8393dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1876725549084544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785208.651734:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8393dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1876725549084544:12345-0@lo:400:kworker.0 Request processed in 28us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785208.651741:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789785208.651753:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789785208.651757:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8393e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1876725549083904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785208.651777:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8393e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1876725549083904:12345-0@lo:400:kworker.0 Request processed in 20us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785208.651782:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:3.0:1789785208.651796:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789785208.651812:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789785208.651814:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789785208.651827:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549084416 00000100:00100000:3.0:1789785208.651830:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549084416 00000100:00100000:3.0:1789785208.651865:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789785208.651872:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8393fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549084416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785208.651910:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8393fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549084416:12345-0@lo:400:kworker.0 Request processed in 39us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785208.651916:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789785208.651943:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1876725549083904:0@lo:400:kworker.0 00010000:00080000:3.0:1789785208.651955:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae8393d880 x1876725549084416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785208.651965:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549084416:0@lo:400:kworker.0 00000100:00100000:3.0:1789785208.651979:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1876725549084032:0@lo:400:kworker.0 00000100:00100000:3.0:1789785208.651989:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1876725549084544:0@lo:400:kworker.0 00000100:00080000:3.0:1789785208.652010:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789785208.652463:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549083520 00000100:00100000:1.0:1789785208.652468:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549083520 00000100:00100000:1.0:1789785208.652542:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1789785208.652551:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:3660:x1876725549083520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785208.652600:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:3660:x1876725549083520:12345-0@lo:400:kworker.0 Request processed in 51us (1344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785208.652607:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1789785208.652664:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549083520:0@lo:400:kworker.0 00010000:00010000:3.0:1789785208.835587:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785209.859598:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789785210.178958:0:8817:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 318432615310ns, next at 319432611193ns, rc = 0 00000100:00100000:0.0:1789785210.179049:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549084928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789785210.179150:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785210.179450:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549084928 00000100:00100000:1.0:1789785210.179460:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549084928 00000100:00100000:1.0:1789785210.179535:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789785210.179559:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549084928:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789785210.179676:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549084800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789785210.179719:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1789785210.179769:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785210.179806:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549084800 00000100:00100000:3.0:1789785210.179810:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549084800 00000100:00100000:1.0:1789785210.179818:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549084928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 264us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785210.179826:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789785210.179842:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789785210.179849:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8393c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549084800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789785210.179876:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00010000:00080000:1.0:1789785210.179892:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3f1180 x1876725549084928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785226 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785210.179913:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8393c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549084800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785210.179913:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549084928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789785210.179919:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789785210.179936:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549085056:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789785210.179981:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785210.180042:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549084800:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1789785210.180076:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789785210.180090:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549085056 00000100:00100000:0.0:1789785210.180097:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549085056 00000100:00100000:0.0:1789785210.180141:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789785210.180148:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8393ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549085056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789785210.180159:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785210.180192:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8393ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549085056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785210.180199:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1789785210.181560:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789785210.181620:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae8393d880 x1876725549085056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785226 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785210.181646:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549085056:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789785210.884840:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789785211.501837:0:13696:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1789785211.907702:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785212.394868:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785212.394915:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785212.394942:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785212.394975:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785212.395009:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785212.395034:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785212.395061:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530126336 00000100:00100000:3.0:1789785212.395070:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530126336 00000100:00100000:3.0:1789785212.395119:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 338 00000100:00100000:3.0:1789785212.395128:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2400:x1876725530126336:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785212.395192:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2400:x1876725530126336:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 64us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785212.395200:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 338 00000100:00100000:3.0:1789785212.395234:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530126464 00000100:00100000:3.0:1789785212.395237:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530126464 00000100:00100000:3.0:1789785212.395273:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530126976 00000100:00100000:3.0:1789785212.395275:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530126976 00000100:00100000:3.0:1789785212.395287:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530126592 00000100:00100000:3.0:1789785212.395289:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530126592 00000100:00100000:3.0:1789785212.395299:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530126848 00000100:00100000:3.0:1789785212.395314:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530126848 00000100:00100000:3.0:1789785212.395334:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 220 00000100:00100000:3.0:1789785212.395375:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8393d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+18:2400:x1876725530126464:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785212.395422:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8393d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+18:2400:x1876725530126464:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 48us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785212.395428:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 220 00000100:00100000:3.0:1789785212.395441:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 221 00000100:00100000:3.0:1789785212.395447:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8393d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2400:x1876725530126976:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785212.395470:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8393d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2400:x1876725530126976:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 23us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785212.395475:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 221 00000100:00100000:3.0:1789785212.395488:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 222 00000100:00100000:3.0:1789785212.395493:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8393c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530126592:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785212.395516:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8393c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530126592:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 23us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785212.395522:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 222 00000100:00100000:3.0:1789785212.395533:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 223 00000100:00100000:3.0:1789785212.395539:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8393c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2400:x1876725530126848:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785212.395560:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8393c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2400:x1876725530126848:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 22us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785212.395565:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 223 00000100:00080000:3.0:1789785212.395587:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789785212.395591:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789785212.397397:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530126720 00000100:00100000:1.0:1789785212.397410:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530126720 00000100:00100000:1.0:1789785212.397466:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 92 00000100:00100000:1.0:1789785212.397474:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8393df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530126720:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785212.397533:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8393df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530126720:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 59us (2617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785212.397555:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 92 00000100:00080000:3.0:1789785212.399122:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1789785212.616325:0:13745:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde8d652b0 20000000:00000080:1.0:1789785212.616809:0:13745:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dae839a1c00 uarg=0000000000000000 20000000:01000000:1.0:1789785212.616851:0:13745:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789785212.616856:0:13745:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789785212.616861:0:13745:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1789785212.625231:0:13746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1789785212.628620:0:13745:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789785212.636916:0:13745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000004:00080000:1.0:1789785212.641115:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1789785212.641152:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:1.0:1789785212.641162:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:1.0:1789785212.641192:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c47a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.641204:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c47a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.641211:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c47a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.641218:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785212.641222:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c47a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.641230:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c47a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.641245:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff9dae827c0f00) 00010000:00010000:1.0:1789785212.641249:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785212.641254:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c47a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.641273:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c47a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.641292:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08200/0x2f18ee3fd845c48f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.641298:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08200/0x2f18ee3fd845c48f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.641304:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08200/0x2f18ee3fd845c48f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.641308:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b08200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785212.641311:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08200/0x2f18ee3fd845c48f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.641317:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08200/0x2f18ee3fd845c48f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.641325:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9daf87d6e800) 00010000:00010000:1.0:1789785212.641327:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785212.641330:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08200/0x2f18ee3fd845c48f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.641365:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08200/0x2f18ee3fd845c48f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.641392:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c4f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.641400:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c4f8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785212.641587:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789785212.641605:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549085184:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789785212.641667:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785212.641736:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549085184 00000100:00100000:3.0:1789785212.641743:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549085184 00000100:00100000:3.0:1789785212.641791:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789785212.641801:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8393ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549085184:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789785212.641828:0:8449:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1789785212.641858:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aadf476, atime: 0x6aadf476, ctime: 0x6aadf476, blocks: 0x0 00010000:00010000:3.0:1789785212.641864:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000217b4880/0x2f18ee3fd845c522 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785212.641879:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=320s v=(0 0) 00010000:00010000:3.0:1789785212.641883:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785212.641889:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000217b4880/0x2f18ee3fd845c522 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785212.641905:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000217b4880/0x2f18ee3fd845c522 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785212.641913:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000217b4880/0x2f18ee3fd845c522 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785212.641921:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000217b4880/0x2f18ee3fd845c522 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785212.641938:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789785212.642276:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c4f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.642283:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785212.642286:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c4f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.642292:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c4f8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.642302:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff9dae827c0f00) 00010000:00010000:1.0:1789785212.642305:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785212.642308:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c4f8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.642314:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c4f8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.642333:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c514 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789785212.642395:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789785212.642603:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c514 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.642610:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c514 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.642616:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785212.642619:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c514 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.642637:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c514 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.642645:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9daf87d6eb00) 00010000:00010000:1.0:1789785212.642648:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785212.642651:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c514 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.642656:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c514 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789785212.642768:0:13745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789785212.642800:0:13745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789785212.642819:0:13745:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789785212.642836:0:13745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845c529 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785212.642849:0:13745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc1a64600/0x2f18ee3fd845c3af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85d0 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785212.642858:0:13745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc1a64c00/0x2f18ee3fd845c3b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85d7 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785212.642866:0:13745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dae81eac400/0x2f18ee3fd845c3c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c3bd expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785212.642872:0:13745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc1a64200/0x2f18ee3fd845c3d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c3cb expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785212.642879:0:13745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc1a64000/0x2f18ee3fd845c3e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c3d9 expref: 23 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785212.642887:0:13745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc1a65200/0x2f18ee3fd845c3ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c3e7 expref: 23 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785212.642894:0:13745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845c529 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785212.642919:0:13745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc1a65200/0x2f18ee3fd845c3ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c3e7 expref: 23 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785212.642931:0:13745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dafc1a65200/0x2f18ee3fd845c3ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c3e7 expref: 23 pid: 6527 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785212.642942:0:13745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13745:1876725549085312:0@lo:104: 00000100:00100000:0.0:1789785212.642992:0:13745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785212.643149:0:6516:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1789785212.643204:0:13745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc1a64000/0x2f18ee3fd845c3e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c3d9 expref: 23 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785212.643213:0:13745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dafc1a64000/0x2f18ee3fd845c3e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c3d9 expref: 23 pid: 6527 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785212.643221:0:13745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13745:1876725549085440:0@lo:104: 00000100:00100000:2.0:1789785212.643366:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549085312 00000100:00100000:2.0:1789785212.643372:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549085312 00000100:00100000:2.0:1789785212.643427:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789785212.643436:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+3:13745:x1876725549085312:12345-0@lo:104: 00010000:00010000:2.0:1789785212.643446:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09a00/0x2f18ee3fd845c3e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c3ee expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.643488:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789785212.643494:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+3:13745:x1876725549085312:12345-0@lo:104: Request processed in 60us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785212.643501:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1789785212.643539:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789785212.643545:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09a00/0x2f18ee3fd845c3e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c3ee expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.643551:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09a00 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:2.0:1789785212.643555:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09a00/0x2f18ee3fd845c3e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c3ee expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.643562:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09a00/0x2f18ee3fd845c3e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c3ee expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789785212.643570:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09a00/0x2f18ee3fd845c3e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c3ee expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785212.643581:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789785212.643606:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09a00/0x2f18ee3fd845c3e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c3ee expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.643613:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789785212.643629:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09a00/0x2f18ee3fd845c3e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c3ee expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.643636:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09a00/0x2f18ee3fd845c3e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c3ee expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.643647:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789785212.643651:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000217b4880/0x2f18ee3fd845c522 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.643659:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc2051e00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:2.0:1789785212.643663:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000217b4880/0x2f18ee3fd845c522 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.643671:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000217b4880/0x2f18ee3fd845c522 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.643687:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000217b4880/0x2f18ee3fd845c522 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.643694:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000217b4880/0x2f18ee3fd845c522 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.643735:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785212.643737:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785212.643739:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785212.643754:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789785212.643765:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549085568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789785212.643791:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785212.644166:0:13745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789785212.644213:0:13745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc1a64200/0x2f18ee3fd845c3d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c3cb expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785212.644223:0:13745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dafc1a64200/0x2f18ee3fd845c3d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c3cb expref: 23 pid: 6528 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785212.644233:0:13745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3ea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13745:1876725549085696:0@lo:104: 00000100:00100000:0.0:1789785212.644254:0:13745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789785212.644281:0:13745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dae81eac400/0x2f18ee3fd845c3c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845c3bd expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785212.644289:0:13745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dae81eac400/0x2f18ee3fd845c3c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845c3bd expref: 23 pid: 6528 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785212.644297:0:13745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13745:1876725549085824:0@lo:104: 00000100:00100000:0.0:1789785212.644316:0:13745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789785212.644359:0:13745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc1a64c00/0x2f18ee3fd845c3b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85d7 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785212.644370:0:13745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dafc1a64c00/0x2f18ee3fd845c3b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85d7 expref: 12 pid: 6528 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785212.644404:0:13745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13745:1876725549085952:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789785212.644518:0:13745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc1a64600/0x2f18ee3fd845c3af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85d0 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785212.644526:0:13745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dafc1a64600/0x2f18ee3fd845c3af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85d0 expref: 12 pid: 6528 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785212.644533:0:13745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13745:1876725549086080:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789785212.644553:0:13745:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafac82f480 going to sleep for 11 seconds 00000100:00100000:0.0:1789785212.644572:0:13745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13745:1876725549085312:0@lo:104: 00000100:00100000:2.0:1789785212.644652:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549085440 00000100:00100000:2.0:1789785212.644657:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549085440 00000100:00100000:2.0:1789785212.644677:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549085696 00000100:00100000:2.0:1789785212.644680:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549085696 00000100:00100000:2.0:1789785212.644689:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549085824 00000100:00100000:2.0:1789785212.644690:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549085824 00000100:00100000:2.0:1789785212.644700:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789785212.644706:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+5:13745:x1876725549085440:12345-0@lo:104: 00010000:00010000:2.0:1789785212.644725:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09e00/0x2f18ee3fd845c3d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.644764:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789785212.644770:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+5:13745:x1876725549085440:12345-0@lo:104: Request processed in 64us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785212.644776:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789785212.644789:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789785212.644795:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+4:13745:x1876725549085696:12345-0@lo:104: 00010000:00010000:2.0:1789785212.644802:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dae81eacc00/0x2f18ee3fd845c3cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c3d2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.644834:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789785212.644844:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+4:13745:x1876725549085696:12345-0@lo:104: Request processed in 50us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785212.644850:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789785212.644861:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789785212.644867:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+3:13745:x1876725549085824:12345-0@lo:104: 00010000:00010000:2.0:1789785212.644874:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c3bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c3c4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.644900:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789785212.644905:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e00759f-51ad-47f9-8892-382c83919083+3:13745:x1876725549085824:12345-0@lo:104: Request processed in 39us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785212.644910:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1789785212.644923:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789785212.644927:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09e00/0x2f18ee3fd845c3d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.644934:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09e00 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:2.0:1789785212.644937:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09e00/0x2f18ee3fd845c3d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.644945:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09e00/0x2f18ee3fd845c3d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789785212.644952:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09e00/0x2f18ee3fd845c3d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785212.644958:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789785212.644979:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09e00/0x2f18ee3fd845c3d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.645005:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789785212.645136:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09e00/0x2f18ee3fd845c3d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.645144:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09e00/0x2f18ee3fd845c3d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.645154:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789785212.645158:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dae81eacc00/0x2f18ee3fd845c3cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c3d2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.645163:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eacc00 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:2.0:1789785212.645166:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dae81eacc00/0x2f18ee3fd845c3cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c3d2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.645172:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dae81eacc00/0x2f18ee3fd845c3cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c3d2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789785212.645179:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dae81eacc00/0x2f18ee3fd845c3cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c3d2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785212.645184:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789785212.645198:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dae81eacc00/0x2f18ee3fd845c3cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c3d2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.645204:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789785212.645210:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dae81eacc00/0x2f18ee3fd845c3cb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c3d2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.645216:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dae81eacc00/0x2f18ee3fd845c3cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c3d2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.645229:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789785212.645232:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c3bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845c3c4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.645238:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09800 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:2.0:1789785212.645241:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c3bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845c3c4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.645247:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c3bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845c3c4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789785212.645254:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c3bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845c3c4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785212.645259:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789785212.645271:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c3bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c3c4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.645276:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789785212.645286:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c3bd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c3c4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.645292:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09800/0x2f18ee3fd845c3bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845c3c4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.645303:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785212.645305:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785212.645307:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785212.645317:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549086208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789785212.645366:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785212.645388:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789785212.645393:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549086336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789785212.645475:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785212.645503:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549085568 00000100:00100000:2.0:1789785212.645507:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549085568 00010000:00010000:2.0:1789785212.645523:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc1a65200/0x2f18ee3fd845c3ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c3e7 expref: 24 pid: 6527 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785212.645543:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549086208 00000100:00100000:2.0:1789785212.645546:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549086208 00010000:00010000:2.0:1789785212.645558:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc1a64000/0x2f18ee3fd845c3e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c3d9 expref: 25 pid: 6527 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785212.645569:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549086336 00000100:00100000:2.0:1789785212.645571:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549086336 00010000:00010000:2.0:1789785212.645580:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc1a64200/0x2f18ee3fd845c3d2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c3cb expref: 26 pid: 6528 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785212.645591:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789785212.645597:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+26:3661:x1876725549085568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789785212.645606:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785212.645611:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc1a65200/0x2f18ee3fd845c3ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c3e7 expref: 26 pid: 6527 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.645621:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc1a65200/0x2f18ee3fd845c3ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c3e7 expref: 26 pid: 6527 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.645636:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1a65200/0x2f18ee3fd845c3ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c3e7 expref: 26 pid: 6527 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.645657:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785212.645678:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+25:3661:x1876725549085568:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785212.645684:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789785212.645698:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789785212.645704:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+24:3659:x1876725549086208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789785212.645831:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785212.645837:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc1a64000/0x2f18ee3fd845c3e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c3d9 expref: 24 pid: 6527 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.645846:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc1a64000/0x2f18ee3fd845c3e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c3d9 expref: 24 pid: 6527 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.645855:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785212.645882:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+24:3659:x1876725549086208:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785212.645889:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789785212.645901:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789785212.645907:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+23:3659:x1876725549086336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789785212.645914:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785212.645918:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc1a64200/0x2f18ee3fd845c3d2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c3cb expref: 23 pid: 6528 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.645926:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc1a64200/0x2f18ee3fd845c3d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c3cb expref: 23 pid: 6528 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785212.645935:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785212.645962:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+23:3659:x1876725549086336:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785212.645968:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789785212.646010:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549086464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789785212.646164:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785212.646204:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549085568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789785212.646234:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549086336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789785212.646241:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549086208:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789785212.646311:0:13745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1a64000/0x2f18ee3fd845c3e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c3d9 expref: 22 pid: 6527 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785212.646322:0:13745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13745:1876725549085440:0@lo:104: 00010000:00010000:0.0:1789785212.646332:0:13745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1a64200/0x2f18ee3fd845c3d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c3cb expref: 21 pid: 6528 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785212.646375:0:13745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3ea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13745:1876725549085696:0@lo:104: 00000100:00100000:0.0:1789785212.646396:0:13745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13745:1876725549085824:0@lo:104: 00000100:00100000:1.0:1789785212.646625:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549086464 00000100:00100000:1.0:1789785212.646630:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549086464 00010000:00010000:1.0:1789785212.646647:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dae81eac400/0x2f18ee3fd845c3c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c3bd expref: 21 pid: 6528 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785212.646672:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789785212.646678:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+21:3661:x1876725549086464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789785212.646686:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785212.646690:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dae81eac400/0x2f18ee3fd845c3c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845c3bd expref: 21 pid: 6528 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.646699:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dae81eac400/0x2f18ee3fd845c3c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845c3bd expref: 21 pid: 6528 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.646710:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dae81eac400/0x2f18ee3fd845c3c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845c3bd expref: 21 pid: 6528 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.646730:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785212.646775:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e00759f-51ad-47f9-8892-382c83919083+20:3661:x1876725549086464:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785212.646782:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789785212.646882:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549086464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789785212.646988:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8393ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3662:x1876725549085184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5187us (5319us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789785212.647007:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1789785212.647093:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785212.647447:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789785212.647474:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dae8393f480/2, rc 0, transno 4294967301 00000100:00100000:0.0:1789785212.647481:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549085184:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789785212.651884:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785212.651924:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785212.652045:0:13745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13745:1876725549085952:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789785212.652059:0:13745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13745:1876725549086080:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789785212.652095:0:13745:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845c529 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785212.652219:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530127232 00000100:00100000:3.0:1789785212.652227:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530127232 00010000:00010000:3.0:1789785212.652260:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc1a64600/0x2f18ee3fd845c3af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85d0 expref: 13 pid: 6528 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785212.652293:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530127104 00000100:00100000:3.0:1789785212.652297:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530127104 00010000:00010000:3.0:1789785212.652309:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc1a64c00/0x2f18ee3fd845c3b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85d7 expref: 14 pid: 6528 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785212.652358:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 50 00000100:00100000:3.0:1789785212.652367:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf44b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dddf7d7-41ac-477b-b9db-b5e699635211+14:2398:x1876725530127232:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789785212.652380:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785212.652394:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc1a64600/0x2f18ee3fd845c3af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85d0 expref: 14 pid: 6528 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785212.652404:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc1a64600/0x2f18ee3fd845c3af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85d0 expref: 14 pid: 6528 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785212.652606:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1a64600/0x2f18ee3fd845c3af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85d0 expref: 14 pid: 6528 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785212.652624:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785212.652676:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf44b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2398:x1876725530127232:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 309us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785212.652683:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 50 00000100:00100000:3.0:1789785212.652724:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 51 00000100:00100000:3.0:1789785212.652731:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf448e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dddf7d7-41ac-477b-b9db-b5e699635211+12:2398:x1876725530127104:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789785212.652739:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785212.652744:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc1a64c00/0x2f18ee3fd845c3b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85d7 expref: 12 pid: 6528 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785212.652753:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc1a64c00/0x2f18ee3fd845c3b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85d7 expref: 12 pid: 6528 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785212.652763:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1a64c00/0x2f18ee3fd845c3b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd85d7 expref: 12 pid: 6528 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785212.652774:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845c529 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785212.652782:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845c529 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785212.652795:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845c529 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785212.652802:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845c529 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785212.652809:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845c529 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785212.652814:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845c529 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785212.652820:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf80030800 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:3.0:1789785212.652830:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845c529 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785212.652839:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845c529 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785212.652854:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845c529 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785212.652863:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785212.652883:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf448e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dddf7d7-41ac-477b-b9db-b5e699635211+11:2398:x1876725530127104:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 153us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785212.652889:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 51 00010000:00010000:3.0:1789785212.653013:0:13745:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845c529 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785212.654009:0:13745:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845c529 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785212.654020:0:13745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9daf80030800/0x2f18ee3fd845c529 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785212.932923:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789785213.543309:0:13794:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcbbfc5d50 20000000:00000080:3.0:1789785213.543326:0:13794:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dafbf41ec00 uarg=0000000000000000 20000000:01000000:3.0:1789785213.543613:0:13794:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1789785213.543620:0:13794:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1789785213.543625:0:13794:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1789785213.544103:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1789785213.544260:0:13794:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1789785213.544335:0:13794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1789785213.544433:0:13794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1789785213.544448:0:13794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1789785213.544472:0:13794:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789785213.544490:0:13794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dafc2050200/0x2f18ee3fd845c530 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785213.544507:0:13794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc2050200/0x2f18ee3fd845c530 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785213.544517:0:13794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dafc2050200/0x2f18ee3fd845c530 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785213.544524:0:13794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dafc2050200/0x2f18ee3fd845c530 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785213.544531:0:13794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dafc2050200/0x2f18ee3fd845c530 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785213.544538:0:13794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dafc2050200/0x2f18ee3fd845c530 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785213.544544:0:13794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc2050200 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:3.0:1789785213.544548:0:13794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dafc2050200/0x2f18ee3fd845c530 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785213.544556:0:13794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dafc2050200/0x2f18ee3fd845c530 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785213.544569:0:13794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dafc2050200/0x2f18ee3fd845c530 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785213.544576:0:13794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dafc2050200/0x2f18ee3fd845c530 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785213.544583:0:13794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc2050200/0x2f18ee3fd845c530 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785213.698406:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789785213.698415:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dae829a7000 from 7 10000000:01000000:2.0:1789785213.698420:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789785213.698463:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845c537 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785213.698475:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845c537 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785213.698486:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845c537 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785213.698510:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549086592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789785213.698954:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785213.699020:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf88110cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785213.699428:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549086592 00000100:00100000:3.0:1789785213.699437:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549086592 00000100:00100000:3.0:1789785213.699659:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1789785213.699670:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+20:6531:x1876725549086592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789785213.699687:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785213.699715:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc2050200/0x2f18ee3fd845c53e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c537 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785213.699741:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc2050200/0x2f18ee3fd845c53e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c537 expref: 21 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785213.699752:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc2050200/0x2f18ee3fd845c53e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c537 expref: 21 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785213.699762:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc2050200, rc 0) 00000100:00100000:3.0:1789785213.699818:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549086592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785213.699825:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1789785213.699900:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549086592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789785213.699915:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845c537 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c53e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785213.699923:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845c537 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c53e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785213.699998:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549086720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789785213.700030:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785213.700318:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc19c4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789785213.701048:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549086720 00000100:00100000:0.0:1789785213.701055:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549086720 00000100:00100000:0.0:1789785213.701087:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1789785213.701096:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549086720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789785213.701581:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549086720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 484us (1548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785213.701590:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1789785213.701818:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549086720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789785213.701876:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549086848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789785213.701920:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785213.701953:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf881106c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789785213.702034:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549086848 00000100:00100000:0.0:1789785213.702039:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549086848 00000100:00100000:0.0:1789785213.702080:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1789785213.702089:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549086848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789785213.702179:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549086848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785213.702186:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789785213.702388:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549086848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789785213.702635:0:13806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf449500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:13806:1876725549086976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789785213.702679:0:13806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785213.702705:0:13806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafb62266c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789785213.702788:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549086976 00000100:00100000:2.0:1789785213.702793:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549086976 00000100:00100000:2.0:1789785213.702822:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1789785213.702830:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+21:13806:x1876725549086976:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789785213.702935:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+21:13806:x1876725549086976:12345-0@lo:502:llog_process_th.0 Request processed in 106us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785213.702942:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1789785213.703008:0:13806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf449500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:13806:1876725549086976:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789785213.703030:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789785213.703040:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785213.703042:0:13806:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789785213.703049:0:13806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dae829a7000 00000020:00000080:0.0:1789785213.703051:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789785213.703164:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785213.703168:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785213.703170:0:13806:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789785213.703172:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789785213.703180:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785213.703182:0:13806:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789785213.703186:0:13806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dae829a7000 00000020:00000080:0.0:1789785213.703188:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789785213.704325:0:13806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf449500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:13806:1876725549087104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789785213.704409:0:13806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785213.704454:0:13806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafb62266c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785213.707512:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549087104 00000100:00100000:3.0:1789785213.707523:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549087104 00000100:00100000:3.0:1789785213.708245:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1789785213.708258:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+21:13806:x1876725549087104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789785213.708439:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+21:13806:x1876725549087104:12345-0@lo:502:llog_process_th.0 Request processed in 185us (4032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785213.708447:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1789785213.708516:0:13806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf449500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:13806:1876725549087104:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789785213.709741:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789785213.709751:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789785213.709753:0:13806:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789785213.709758:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789785213.710520:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789785213.710546:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789785213.710557:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845c537 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c53e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785213.710569:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845c537 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c53e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785213.710580:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789785213.710582:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dafb5cd8800 from 7 10000000:01000000:0.0:1789785213.710585:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789785213.710618:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf80031600/0x2f18ee3fd845c545 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785213.710626:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9daf80031600/0x2f18ee3fd845c545 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785213.710637:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9daf80031600/0x2f18ee3fd845c545 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785213.710662:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf44b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549087232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789785213.710726:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785213.710772:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafb6226d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789785213.711873:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549087232 00000100:00100000:3.0:1789785213.711884:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549087232 00000100:00100000:3.0:1789785213.714010:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789785213.714026:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+21:6531:x1876725549087232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789785213.714044:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785213.714060:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc2050e00/0x2f18ee3fd845c54c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c545 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785213.714086:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc2050e00/0x2f18ee3fd845c54c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c545 expref: 22 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785213.714097:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc2050e00/0x2f18ee3fd845c54c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c545 expref: 22 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785213.714105:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc2050e00, rc 0) 00000100:00100000:3.0:1789785213.714185:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549087232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (3461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785213.714192:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1789785213.716141:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf44b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549087232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789785213.716166:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9daf80031600/0x2f18ee3fd845c545 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c54c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785213.716181:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9daf80031600/0x2f18ee3fd845c545 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c54c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785213.716251:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549087360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789785213.716305:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785213.716354:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc19c4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789785213.716813:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549087360 00000100:00100000:3.0:1789785213.716824:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549087360 00000100:00100000:3.0:1789785213.716869:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1789785213.716879:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549087360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789785213.717010:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549087360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785213.717026:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1789785213.717235:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549087360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789785213.717270:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549087488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789785213.717308:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785213.717331:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc19c4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789785213.717363:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549087488 00000100:00100000:1.0:1789785213.717366:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549087488 00000100:00100000:1.0:1789785213.717383:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1789785213.717389:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549087488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789785213.717465:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549087488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785213.717474:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1789785213.717508:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549087488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789785213.718062:0:13810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:13810:1876725549087616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789785213.718104:0:13810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785213.718122:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549087616 00000100:00100000:1.0:1789785213.718126:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549087616 00000100:00100000:1.0:1789785213.718145:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789785213.718153:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+22:13810:x1876725549087616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789785213.718221:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+22:13810:x1876725549087616:12345-0@lo:502:llog_process_th.0 Request processed in 69us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785213.718227:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789785213.718263:0:13810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc19c4180 going to sleep for 11 seconds 00000100:00100000:1.0:1789785213.718273:0:13810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:13810:1876725549087616:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789785213.718298:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789785213.718305:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785213.718307:0:13810:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789785213.718313:0:13810:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dafb5cd8800 00000020:00000080:1.0:1789785213.718315:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789785213.718377:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785213.718381:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785213.718382:0:13810:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789785213.718385:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789785213.718387:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785213.718389:0:13810:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789785213.718392:0:13810:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dafb5cd8800 00000020:00000080:1.0:1789785213.718394:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789785213.718422:0:13810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:13810:1876725549087744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789785213.718456:0:13810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785213.718478:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549087744 00000100:00100000:1.0:1789785213.718481:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549087744 00000100:00100000:1.0:1789785213.718496:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789785213.718500:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+22:13810:x1876725549087744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789785213.718556:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+22:13810:x1876725549087744:12345-0@lo:502:llog_process_th.0 Request processed in 54us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785213.718562:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789785213.718587:0:13810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc19c4180 going to sleep for 11 seconds 00000100:00100000:1.0:1789785213.718598:0:13810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:13810:1876725549087744:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789785213.718691:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785213.718695:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785213.718697:0:13810:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789785213.718700:0:13810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789785213.718746:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789785213.718762:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789785213.718770:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf80031600/0x2f18ee3fd845c545 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c54c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785213.718781:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9daf80031600/0x2f18ee3fd845c545 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c54c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785213.718791:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789785213.718793:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dafc189c800 from 7 10000000:01000000:1.0:1789785213.718796:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789785213.718818:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21caa00/0x2f18ee3fd845c553 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785213.718825:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc21caa00/0x2f18ee3fd845c553 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785213.718834:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc21caa00/0x2f18ee3fd845c553 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785213.719222:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549087872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789785213.719250:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785213.719321:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc19c4180 going to sleep for 11 seconds 00000100:00100000:3.0:1789785213.719790:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549087872 00000100:00100000:3.0:1789785213.719796:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549087872 00000100:00100000:3.0:1789785213.719833:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1789785213.719840:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+22:6531:x1876725549087872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789785213.719850:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785213.719925:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc2051a00/0x2f18ee3fd845c55a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c553 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785213.719947:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc2051a00/0x2f18ee3fd845c55a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c553 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785213.719958:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc2051a00/0x2f18ee3fd845c55a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c553 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785213.719965:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc2051a00, rc 0) 00000100:00100000:3.0:1789785213.720015:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549087872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785213.720021:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1789785213.720061:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549087872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789785213.720073:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc21caa00/0x2f18ee3fd845c553 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c55a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785213.720083:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc21caa00/0x2f18ee3fd845c553 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c55a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785213.720137:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549088000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789785213.720171:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785213.720192:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab2180 going to sleep for 11 seconds 00000100:00100000:1.0:1789785213.720731:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549088000 00000100:00100000:1.0:1789785213.720737:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549088000 00000100:00100000:1.0:1789785213.720769:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1789785213.720778:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549088000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789785213.720876:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549088000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785213.720882:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1789785213.722565:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549088000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789785213.722622:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549088128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789785213.722683:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785213.722787:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab2180 going to sleep for 11 seconds 00000100:00100000:3.0:1789785213.722807:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549088128 00000100:00100000:3.0:1789785213.722812:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549088128 00000100:00100000:3.0:1789785213.722854:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1789785213.722929:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549088128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789785213.723036:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549088128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785213.723043:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1789785213.723095:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549088128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789785213.723641:0:13811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:13811:1876725549088256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789785213.723682:0:13811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785213.723811:0:13811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789785213.723845:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549088256 00000100:00100000:1.0:1789785213.723850:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549088256 00000100:00100000:1.0:1789785213.723994:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1789785213.724003:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+23:13811:x1876725549088256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789785213.724097:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+23:13811:x1876725549088256:12345-0@lo:502:llog_process_th.0 Request processed in 95us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785213.724104:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1789785213.724171:0:13811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:13811:1876725549088256:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789785213.724196:0:13811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789785213.724205:0:13811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789785213.724207:0:13811:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789785213.724214:0:13811:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dafc189c800 00000020:00000080:3.0:1789785213.724217:0:13811:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789785213.724271:0:13811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789785213.724275:0:13811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789785213.724281:0:13811:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789785213.724285:0:13811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789785213.724287:0:13811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789785213.724288:0:13811:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789785213.724293:0:13811:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dafc189c800 00000020:00000080:3.0:1789785213.724295:0:13811:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789785213.724360:0:13811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:13811:1876725549088384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789785213.724409:0:13811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785213.724432:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549088384 00000100:00100000:3.0:1789785213.724436:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549088384 00000100:00100000:3.0:1789785213.724456:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1789785213.724461:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+23:13811:x1876725549088384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789785213.724519:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+23:13811:x1876725549088384:12345-0@lo:502:llog_process_th.0 Request processed in 57us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785213.724525:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1789785213.724555:0:13811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785213.724567:0:13811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:13811:1876725549088384:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789785213.724583:0:13811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789785213.724587:0:13811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789785213.724588:0:13811:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789785213.724591:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789785213.724820:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789785213.724844:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789785213.724853:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21caa00/0x2f18ee3fd845c553 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c55a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785213.724924:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc21caa00/0x2f18ee3fd845c553 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c55a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785213.724935:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789785213.724938:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9daf89061800 from 7 10000000:01000000:1.0:1789785213.724941:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789785213.724962:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c561 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785213.724969:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c561 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785213.724978:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c561 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785213.725002:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549088512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789785213.725029:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785213.725088:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc19c4780 going to sleep for 11 seconds 00000100:00100000:3.0:1789785213.725121:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549088512 00000100:00100000:3.0:1789785213.725125:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549088512 00000100:00100000:3.0:1789785213.725179:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1789785213.725186:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+23:6531:x1876725549088512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789785213.725194:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785213.725204:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc2051e00/0x2f18ee3fd845c568 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845c561 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785213.725234:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc2051e00/0x2f18ee3fd845c568 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845c561 expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785213.725244:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc2051e00/0x2f18ee3fd845c568 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845c561 expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785213.725252:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc2051e00, rc 0) 00000100:00100000:3.0:1789785213.725283:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:6531:x1876725549088512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785213.725288:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1789785213.725356:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549088512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789785213.725369:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c561 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c568 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785213.725389:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c561 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c568 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785213.725435:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549088640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789785213.725458:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785213.725471:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc19c4780 going to sleep for 11 seconds 00000100:00100000:1.0:1789785213.725482:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549088640 00000100:00100000:1.0:1789785213.725485:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549088640 00000100:00100000:1.0:1789785213.725506:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789785213.725512:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:6531:x1876725549088640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789785213.725596:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:6531:x1876725549088640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785213.725602:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789785213.725631:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549088640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789785213.725654:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549088768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789785213.725689:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785213.725715:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc19c4780 going to sleep for 11 seconds 00000100:00100000:1.0:1789785213.725727:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549088768 00000100:00100000:1.0:1789785213.725730:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549088768 00000100:00100000:1.0:1789785213.725751:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789785213.725758:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:6531:x1876725549088768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789785213.725842:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:6531:x1876725549088768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785213.725848:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789785213.725960:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e00759f-51ad-47f9-8892-382c83919083:6531:1876725549088768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789785213.726134:0:13812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:13812:1876725549088896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789785213.726167:0:13812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785213.726183:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549088896 00000100:00100000:1.0:1789785213.726187:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549088896 00000100:00100000:1.0:1789785213.726208:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789785213.726213:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:13812:x1876725549088896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789785213.726278:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:13812:x1876725549088896:12345-0@lo:502:llog_process_th.0 Request processed in 64us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785213.726286:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789785213.726312:0:13812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc19c4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789785213.726325:0:13812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:13812:1876725549088896:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789785213.726765:0:13812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789785213.726774:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785213.726777:0:13812:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789785213.726784:0:13812:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9daf89061800 00000020:00000080:1.0:1789785213.726786:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789785213.726835:0:13812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785213.726838:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785213.726840:0:13812:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789785213.726842:0:13812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789785213.726844:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785213.726846:0:13812:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789785213.727061:0:13812:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9daf89061800 00000020:00000080:1.0:1789785213.727066:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789785213.727104:0:13812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:13812:1876725549089024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789785213.727144:0:13812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785213.727171:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549089024 00000100:00100000:1.0:1789785213.727176:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549089024 00000100:00100000:1.0:1789785213.727202:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789785213.727208:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:13812:x1876725549089024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789785213.727281:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:13812:x1876725549089024:12345-0@lo:502:llog_process_th.0 Request processed in 72us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785213.727290:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789785213.727328:0:13812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb40ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1789785213.727359:0:13812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e00759f-51ad-47f9-8892-382c83919083:13812:1876725549089024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789785213.727445:0:13812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785213.727450:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785213.727452:0:13812:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789785213.727456:0:13812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789785213.727504:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789785213.727523:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789785213.727531:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c561 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c568 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785213.727542:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c561 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c568 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789785213.731309:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789785213.748416:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789785213.764286:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549089152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789785213.764367:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785213.764477:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549089280:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789785213.764509:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785213.764542:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876725549089792:0@lo:400:kworker.0 00000100:00100000:2.0:1789785213.764567:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785213.764583:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549090304:0@lo:400:kworker.0 00000100:00100000:2.0:1789785213.764605:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785213.764624:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549090816:0@lo:400:kworker.0 00000100:00100000:2.0:1789785213.764641:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785213.764947:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549089792 00000100:00100000:3.0:1789785213.764953:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549089792 00000100:00100000:0.0:1789785213.765101:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549089664:0@lo:400:kworker.0 00000100:00100000:0.0:1789785213.765124:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785213.765150:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789785213.765160:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876725549089792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785213.765208:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876725549089792:12345-0@lo:400:kworker.0 Request processed in 50us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785213.765216:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789785213.766170:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876725549089792:0@lo:400:kworker.0 00000100:00100000:2.0:1789785213.766186:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1789785213.766193:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549089408:0@lo:400:kworker.0 00000100:00100000:2.0:1789785213.766224:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785213.766247:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549089920:0@lo:400:kworker.0 00000100:00100000:0.0:1789785213.766919:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1876725549090176:0@lo:400:kworker.0 00000100:00100000:0.0:1789785213.766948:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785213.766965:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1876725549090688:0@lo:400:kworker.0 00000100:00100000:0.0:1789785213.766984:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785213.767028:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1789785213.767035:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1876725549089536:0@lo:400:kworker.0 00000100:00100000:0.0:1789785213.767056:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785213.767072:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1876725549090048:0@lo:400:kworker.0 00000100:00100000:0.0:1789785213.767091:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785213.767107:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1876725549090560:0@lo:400:kworker.0 00000100:00100000:0.0:1789785213.767129:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785213.767145:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549091072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789785213.767164:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785213.767195:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549089152 00000100:00100000:0.0:1789785213.767200:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549089152 00000100:00100000:0.0:1789785213.767240:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549091072 00000100:00100000:0.0:1789785213.767243:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549091072 00000100:00100000:0.0:1789785213.767259:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789785213.767268:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549089152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789785213.767294:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785213.767334:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549089152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (2965us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785213.767374:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789785213.767389:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789785213.767395:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549091072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789785213.767406:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785213.767430:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549091072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785213.767435:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789785213.767453:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549090304 00000100:00100000:0.0:1789785213.767457:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549090304 00000100:00100000:0.0:1789785213.767481:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549090816 00000100:00100000:0.0:1789785213.767484:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549090816 00000100:00100000:0.0:1789785213.767500:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789785213.767506:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549090304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785213.767538:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549090304:12345-0@lo:400:kworker.0 Request processed in 31us (2931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785213.767544:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789785213.767555:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789785213.767560:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549090816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785213.767587:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549090816:12345-0@lo:400:kworker.0 Request processed in 27us (2945us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785213.767592:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789785213.768707:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549089280 00000100:00100000:2.0:1789785213.768720:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549089280 00000100:00100000:2.0:1789785213.768756:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549089664 00000100:00100000:2.0:1789785213.768759:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549089664 00000100:00100000:2.0:1789785213.768775:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789785213.768781:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549089280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789785213.768806:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789785213.768817:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789785213.768826:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549089664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785213.768846:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549089280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (4336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785213.768853:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789785213.768855:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549089664:12345-0@lo:400:kworker.0 Request processed in 31us (3730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785213.768872:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789785213.768876:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549089408 00000100:00100000:2.0:1789785213.768879:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549089408 00000100:00100000:2.0:1789785213.768911:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1789785213.768917:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:3659:x1876725549089408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785213.768947:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:3659:x1876725549089408:12345-0@lo:400:kworker.0 Request processed in 30us (2722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785213.768952:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1789785213.770586:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549090176 00000100:00100000:2.0:1789785213.770596:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549090176 00000100:00100000:2.0:1789785213.770699:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549090688 00000100:00100000:2.0:1789785213.770703:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549090688 00000100:00100000:2.0:1789785213.770720:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549089536 00000100:00100000:2.0:1789785213.770723:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549089536 00000100:00100000:2.0:1789785213.770733:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549090048 00000100:00100000:2.0:1789785213.770736:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549090048 00000100:00100000:2.0:1789785213.770746:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549090560 00000100:00100000:2.0:1789785213.770749:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549090560 00000100:00100000:2.0:1789785213.770766:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789785213.770774:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1876725549090176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785213.770837:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1876725549090176:12345-0@lo:400:kworker.0 Request processed in 64us (3887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785213.770850:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789785213.770865:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789785213.770872:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacaebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1876725549090688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785213.770903:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacaebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1876725549090688:12345-0@lo:400:kworker.0 Request processed in 32us (3918us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785213.770909:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789785213.770921:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789785213.770926:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacaeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1876725549089536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785213.770951:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacaeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1876725549089536:12345-0@lo:400:kworker.0 Request processed in 25us (3894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785213.770956:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789785213.770966:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789785213.770971:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacaeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1876725549090048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785213.771009:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacaeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1876725549090048:12345-0@lo:400:kworker.0 Request processed in 37us (3916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785213.771015:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789785213.771025:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789785213.771031:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1876725549090560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785213.771056:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1876725549090560:12345-0@lo:400:kworker.0 Request processed in 26us (3927us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785213.771062:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789785213.771095:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785213.771127:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549090432:0@lo:400:kworker.0 00000100:00100000:2.0:1789785213.771156:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785213.771181:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549090944:0@lo:400:kworker.0 00000100:00100000:2.0:1789785213.771201:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785213.771238:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549089280:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789785213.771253:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549090304:0@lo:400:kworker.0 00010000:00080000:2.0:1789785213.771267:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb620df80 x1876725549090816/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785213.771278:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549090816:0@lo:400:kworker.0 00000100:00100000:2.0:1789785213.771306:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549089408:0@lo:400:kworker.0 00000100:00100000:2.0:1789785213.771323:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549090432 00000100:00100000:2.0:1789785213.771326:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549090432 00000100:00100000:2.0:1789785213.771370:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549090944 00000100:00100000:2.0:1789785213.772030:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549090944 00000100:00100000:2.0:1789785213.772057:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789785213.772063:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3659:x1876725549090432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785213.772108:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3659:x1876725549090432:12345-0@lo:400:kworker.0 Request processed in 45us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785213.772114:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789785213.772125:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789785213.772131:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549090944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785213.772154:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549090944:12345-0@lo:400:kworker.0 Request processed in 24us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785213.772159:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789785213.772187:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549089920 00000100:00100000:2.0:1789785213.772190:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549089920 00000100:00100000:2.0:1789785213.772214:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789785213.772229:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549089920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785213.772263:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549089920:12345-0@lo:400:kworker.0 Request processed in 36us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785213.772269:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789785213.772304:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549089920:0@lo:400:kworker.0 00000100:00100000:2.0:1789785213.772315:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549090432:0@lo:400:kworker.0 00010000:00080000:2.0:1789785213.772325:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb620fb80 x1876725549090944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785213.772334:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549090944:0@lo:400:kworker.0 00000100:00080000:0.0:1789785213.774312:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789785213.774322:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789785213.774326:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789785213.774329:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789785213.774438:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1876725549089536:0@lo:400:kworker.0 00000100:00100000:0.0:1789785213.774466:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1876725549090048:0@lo:400:kworker.0 00000100:00100000:0.0:1789785213.774477:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1876725549090560:0@lo:400:kworker.0 00010000:00080000:0.0:1789785213.774490:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb620c700 x1876725549091072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785213.774508:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549091072:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789785213.774519:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3f0a80 x1876725549089152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785213.774531:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549089152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789785213.774542:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549089664:0@lo:400:kworker.0 00010000:00080000:0.0:1789785213.774553:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83ad4700 x1876725549090176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785213.774562:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1876725549090176:0@lo:400:kworker.0 00010000:00080000:0.0:1789785213.774573:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb620ce00 x1876725549090688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785213.774580:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1876725549090688:0@lo:400:kworker.0 00000100:00100000:3.0:1789785213.932200:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785213.932323:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530127360 00000100:00100000:0.0:1789785213.932333:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530127360 00000100:00100000:2.0:1789785213.932755:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 360 00000100:00100000:2.0:1789785213.932766:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+11:6169:x1876725530127360:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789785213.932783:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785213.932800:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1b08000/0x2f18ee3fd845c56f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8624 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785213.932827:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1b08000/0x2f18ee3fd845c56f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8624 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785213.932838:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1b08000/0x2f18ee3fd845c56f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8624 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785213.932847:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b08000, rc 0) 00000100:00100000:2.0:1789785213.932901:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+12:6169:x1876725530127360:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 Request processed in 138us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785213.932909:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 360 00000100:00100000:2.0:1789785213.945716:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785213.945765:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530127488 00000100:00100000:1.0:1789785213.945776:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530127488 00000100:00100000:1.0:1789785213.945846:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 361 00000100:00100000:1.0:1789785213.945997:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+12:6169:x1876725530127488:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789785213.946157:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+12:6169:x1876725530127488:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 Request processed in 284us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785213.946165:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 361 00000100:00100000:0.0:1789785213.949862:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785213.950135:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530127616 00000100:00100000:2.0:1789785213.950144:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530127616 00000100:00100000:2.0:1789785213.950282:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 362 00000100:00100000:2.0:1789785213.950294:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+12:6169:x1876725530127616:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789785213.950464:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+12:6169:x1876725530127616:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 Request processed in 173us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785213.950473:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 362 00010000:00010000:3.0:1789785213.954520:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785213.956383:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785213.956821:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530127744 00000100:00100000:1.0:1789785213.956832:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530127744 00000100:00100000:1.0:1789785213.956897:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 363 00000100:00100000:1.0:1789785213.956908:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+12:10784:x1876725530127744:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789785213.957189:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+12:10784:x1876725530127744:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 281us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785213.957199:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 363 00000100:00100000:0.0:1789785213.970110:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785213.971307:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530127872 00000100:00100000:2.0:1789785213.971319:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530127872 00000100:00100000:2.0:1789785213.971425:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 364 00000100:00100000:2.0:1789785213.971436:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+12:10784:x1876725530127872:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789785213.971787:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+12:10784:x1876725530127872:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 351us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785213.971796:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 364 00000100:00100000:0.0:1789785213.981739:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785213.982655:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530128000 00000100:00100000:2.0:1789785213.982667:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530128000 00000100:00100000:2.0:1789785213.982733:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 365 00000100:00100000:2.0:1789785213.982744:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+12:6169:x1876725530128000:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789785213.982762:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785213.982778:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1b08800/0x2f18ee3fd845c576 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd862b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785213.982806:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1b08800/0x2f18ee3fd845c576 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd862b expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785213.982816:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1b08800/0x2f18ee3fd845c576 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd862b expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785213.982840:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b08800, rc 0) 00000100:00100000:2.0:1789785213.982914:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+13:6169:x1876725530128000:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 Request processed in 172us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785213.982921:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 365 00000100:00100000:3.0:1789785214.000452:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785214.000863:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530128128 00000100:00100000:1.0:1789785214.000882:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530128128 00000100:00100000:1.0:1789785214.000942:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 366 00000100:00100000:1.0:1789785214.000952:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:6169:x1876725530128128:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789785214.001119:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:6169:x1876725530128128:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 Request processed in 167us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785214.001127:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 366 00000100:00100000:0.0:1789785214.004689:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785214.004823:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530128256 00000100:00100000:3.0:1789785214.004834:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530128256 00000100:00100000:3.0:1789785214.004892:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 367 00000100:00100000:3.0:1789785214.004903:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+13:6169:x1876725530128256:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789785214.005068:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+13:6169:x1876725530128256:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 Request processed in 166us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785214.005075:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 367 00000100:00100000:0.0:1789785214.009515:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785214.009629:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530128384 00000100:00100000:3.0:1789785214.009638:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530128384 00000100:00100000:3.0:1789785214.009696:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 368 00000100:00100000:3.0:1789785214.009712:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+13:10787:x1876725530128384:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789785214.009854:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+13:10787:x1876725530128384:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 149us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785214.009862:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 368 00000100:00100000:0.0:1789785214.016943:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785214.017166:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530128512 00000100:00100000:1.0:1789785214.017176:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530128512 00000100:00100000:1.0:1789785214.017242:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 369 00000100:00100000:1.0:1789785214.017253:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:10787:x1876725530128512:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789785214.017438:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:10787:x1876725530128512:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 186us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785214.017455:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 369 00000040:00080000:2.0:1789785214.787156:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789785214.787299:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789785214.978957:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785215.298533:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789785215.298556:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549091200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789785215.298624:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785215.298669:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549091200 00000100:00100000:1.0:1789785215.298676:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549091200 00000100:00100000:1.0:1789785215.298731:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789785215.298741:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1876725549091200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789785215.298768:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785215.298822:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1876725549091200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785215.298829:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1789785215.298850:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789785215.298971:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789785215.298991:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549091328:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789785215.299020:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785215.299051:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549091328 00000100:00100000:3.0:1789785215.299055:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549091328 00000100:00100000:3.0:1789785215.299084:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789785215.299091:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549091328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789785215.299101:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785215.299132:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549091328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785215.299155:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789785215.299204:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549091328:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789785215.299222:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789785215.299543:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549091456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789785215.299572:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785215.299678:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549091456 00000100:00100000:1.0:1789785215.299682:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549091456 00000100:00100000:1.0:1789785215.299717:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789785215.299724:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549091456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789785215.299746:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789785215.299864:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549091456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785215.299872:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789785215.300305:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549091456:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789785215.300928:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549091200:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789785216.002507:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785217.028959:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785217.530452:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785217.530555:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785217.530663:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785217.530694:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785217.530741:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530129024 00000100:00100000:1.0:1789785217.530750:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530129024 00000100:00100000:1.0:1789785217.530807:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 97 00000100:00100000:1.0:1789785217.530817:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530129024:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785217.530885:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530129024:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 70us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785217.530892:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 97 00000100:00080000:1.0:1789785217.530926:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789785217.534718:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530128640 00000100:00100000:3.0:1789785217.534733:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530128640 00000100:00100000:3.0:1789785217.534801:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 370 00000100:00100000:3.0:1789785217.534811:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2397:x1876725530128640:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785217.534894:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2397:x1876725530128640:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 85us (4338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785217.534902:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 370 00000100:00100000:2.0:1789785217.548522:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530128768 00000100:00100000:2.0:1789785217.548534:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530128768 00000100:00100000:2.0:1789785217.548591:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530129280 00000100:00100000:2.0:1789785217.548594:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530129280 00000100:00100000:2.0:1789785217.548611:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 230 00000100:00100000:2.0:1789785217.548620:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530128768:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785217.548681:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530128768:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 63us (18240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785217.548687:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 230 00000100:00100000:2.0:1789785217.548699:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 231 00000100:00100000:2.0:1789785217.548704:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530129280:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785217.548719:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530129280:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 16us (18025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785217.548723:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 231 00000100:00080000:2.0:1789785217.548740:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789785217.548753:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789785217.548891:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785217.548936:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785217.549185:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530128896 00000100:00100000:2.0:1789785217.549191:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530128896 00000100:00100000:2.0:1789785217.549239:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530129152 00000100:00100000:2.0:1789785217.549242:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530129152 00000100:00100000:2.0:1789785217.549265:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 232 00000100:00100000:2.0:1789785217.549272:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530128896:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785217.549307:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530128896:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 35us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785217.549313:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 232 00000100:00100000:2.0:1789785217.549325:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 233 00000100:00100000:2.0:1789785217.549330:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2397:x1876725530129152:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785217.549379:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2397:x1876725530129152:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 49us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785217.549386:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 233 00000100:00080000:1.0:1789785217.549485:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789785217.549489:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789785218.053888:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785218.882667:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789785218.882690:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549091584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789785218.882753:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785218.883052:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549091712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789785218.883079:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785218.883119:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549091584 00000100:00100000:2.0:1789785218.883127:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549091584 00000100:00100000:2.0:1789785218.883177:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549091712 00000100:00100000:2.0:1789785218.883181:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549091712 00000100:00100000:2.0:1789785218.883199:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789785218.883208:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549091584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789785218.883240:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785218.883291:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549091584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785218.883297:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789785218.883315:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789785218.883320:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549091712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789785218.883331:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785218.883372:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549091712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785218.883378:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1789785218.883392:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789785218.883671:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf4e1500 x1876725549091712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785218.883690:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549091712:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789785218.883701:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf4e3480 x1876725549091584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785218.883712:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549091584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789785218.884263:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876725549091968:0@lo:400:kworker.0 00000100:00100000:2.0:1789785218.884818:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785218.885039:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1876725549092480:0@lo:400:kworker.0 00000100:00100000:2.0:1789785218.885067:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785218.885085:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1876725549092992:0@lo:400:kworker.0 00000100:00100000:2.0:1789785218.885110:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785218.885140:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789785218.885147:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549091840:0@lo:400:kworker.0 00000100:00100000:2.0:1789785218.885184:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785218.885205:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549092352:0@lo:400:kworker.0 00000100:00100000:2.0:1789785218.885228:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785218.885245:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549092864:0@lo:400:kworker.0 00000100:00100000:2.0:1789785218.885267:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785218.885296:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549091968 00000100:00100000:2.0:1789785218.885302:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549091968 00000100:00100000:2.0:1789785218.885363:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549092480 00000100:00100000:2.0:1789785218.885367:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549092480 00000100:00100000:2.0:1789785218.885390:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549092992 00000100:00100000:2.0:1789785218.885392:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549092992 00000100:00100000:2.0:1789785218.885405:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789785218.885412:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8393d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876725549091968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785218.885690:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8393d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876725549091968:12345-0@lo:400:kworker.0 Request processed in 276us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785218.885698:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789785218.885715:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789785218.885722:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8393ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1876725549092480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785218.885749:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8393ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1876725549092480:12345-0@lo:400:kworker.0 Request processed in 28us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785218.885755:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789785218.886176:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789785218.886184:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1876725549092992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785218.886222:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1876725549092992:12345-0@lo:400:kworker.0 Request processed in 39us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785218.886229:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789785218.886250:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549091840 00000100:00100000:2.0:1789785218.886255:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549091840 00000100:00100000:2.0:1789785218.886280:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1789785218.886286:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:3660:x1876725549091840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785218.886325:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549092864 00000100:00100000:2.0:1789785218.886327:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:3660:x1876725549091840:12345-0@lo:400:kworker.0 Request processed in 41us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785218.886329:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549092864 00000100:00100000:2.0:1789785218.886334:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1789785218.886382:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789785218.886388:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3660:x1876725549092864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785218.886394:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549091840:0@lo:400:kworker.0 00000100:00100000:2.0:1789785218.886415:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876725549091968:0@lo:400:kworker.0 00000100:00100000:0.0:1789785218.886420:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3660:x1876725549092864:12345-0@lo:400:kworker.0 Request processed in 33us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785218.886580:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1876725549092480:0@lo:400:kworker.0 00000100:00100000:2.0:1789785218.886596:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1876725549092992:0@lo:400:kworker.0 00000100:00100000:2.0:1789785218.886621:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549092864:0@lo:400:kworker.0 00000100:00100000:0.0:1789785218.886777:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789785218.886799:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549092352 00000100:00100000:0.0:1789785218.886803:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549092352 00000100:00100000:0.0:1789785218.886827:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789785218.886833:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549092352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785218.886874:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549092352:12345-0@lo:400:kworker.0 Request processed in 41us (1645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785218.886880:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:0.0:1789785218.886913:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789785218.886917:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789785218.886944:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725549092224:0@lo:400:kworker.0 00000100:00100000:0.0:1789785218.886986:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785218.887014:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549092736:0@lo:400:kworker.0 00000100:00100000:0.0:1789785218.887040:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785218.887049:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549092352:0@lo:400:kworker.0 00000100:00100000:2.0:1789785218.887071:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549092224 00000100:00100000:2.0:1789785218.887075:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549092224 00000100:00100000:2.0:1789785218.887102:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789785218.887109:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725549092224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785218.887139:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549092096:0@lo:400:kworker.0 00000100:00100000:1.0:1789785218.887184:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549092736 00000100:00100000:1.0:1789785218.887189:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549092736 00000100:00100000:1.0:1789785218.887220:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789785218.887226:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81eabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549092736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785218.891421:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725549092224:12345-0@lo:400:kworker.0 Request processed in 4303us (4424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785218.891447:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:2.0:1789785218.891531:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789785218.896287:0:8445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1789785218.898257:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81eabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549092736:12345-0@lo:400:kworker.0 Request processed in 11021us (11207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785218.898271:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789785218.898903:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549092736:0@lo:400:kworker.0 00000100:00100000:0.0:1789785218.898932:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549093248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789785218.898985:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785218.899023:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725549092224:0@lo:400:kworker.0 00000100:00100000:2.0:1789785218.899638:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785218.901620:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725549092608:0@lo:400:kworker.0 00000100:00100000:2.0:1789785218.901695:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785218.901732:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549093120:0@lo:400:kworker.0 00000100:00100000:2.0:1789785218.901752:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785218.902271:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549092608 00000100:00100000:2.0:1789785218.902280:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549092608 00000100:00100000:2.0:1789785218.902328:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549093120 00000100:00100000:2.0:1789785218.902331:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549093120 00000100:00100000:2.0:1789785218.902382:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789785218.902391:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8393e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725549092608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785218.902471:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8393e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725549092608:12345-0@lo:400:kworker.0 Request processed in 81us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785218.902478:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789785218.902494:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789785218.902500:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549093120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785218.902526:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549093120:12345-0@lo:400:kworker.0 Request processed in 27us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785218.902531:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00080000:2.0:1789785218.902549:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789785218.902561:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549093248 00000100:00100000:2.0:1789785218.902564:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549093248 00000100:00100000:2.0:1789785218.902586:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549092096 00000100:00100000:2.0:1789785218.902589:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549092096 00000100:00100000:2.0:1789785218.902601:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789785218.902606:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb53a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549093248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789785218.902629:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00010000:00080000:3.0:1789785218.903049:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83ad6680 x1876725549092608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785218.903073:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb53a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549093248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 464us (4085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785218.903086:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789785218.903087:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725549092608:0@lo:400:kworker.0 00000100:00100000:2.0:1789785218.903105:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00010000:00080000:3.0:1789785218.903108:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae8393f800 x1876725549093120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785218.903117:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8393f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549092096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785218.903122:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549093120:0@lo:400:kworker.0 00000100:00100000:2.0:1789785218.903217:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8393f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549092096:12345-0@lo:400:kworker.0 Request processed in 103us (3579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785218.903224:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789785218.904489:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549092096:0@lo:400:kworker.0 00000100:00100000:0.0:1789785218.905529:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549093248:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789785219.074485:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785220.099468:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785220.418672:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789785220.418696:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549093376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789785220.418707:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789785220.418720:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549093504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789785220.420149:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549093632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789785220.420493:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785220.420559:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549093376 00000100:00100000:1.0:1789785220.420569:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549093376 00000100:00080000:2.0:1789785220.420608:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789785220.420631:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789785220.420643:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549093376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789785220.420672:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785220.420729:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549093376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785220.420736:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789785220.422256:0:3660:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1789785220.422266:0:3660:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dae8393f480, transno 4294967301 00000100:00100000:2.0:1789785220.422302:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549093376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789785220.426727:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785220.434510:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785220.435892:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549093632 00000100:00100000:3.0:1789785220.435907:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549093632 00000100:00100000:3.0:1789785220.435981:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789785220.435993:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb539c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549093632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789785220.436035:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789785220.436130:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb539c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549093632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785220.436137:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789785220.437044:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549093632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789785220.440349:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549093504 00000100:00100000:1.0:1789785220.440364:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549093504 00000100:00080000:2.0:1789785220.440529:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789785220.440586:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789785220.440599:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549093504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789785220.440624:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785220.440705:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549093504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (13984us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785220.440712:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789785220.440799:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549093504:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789785221.122740:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785222.146791:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785222.639599:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785222.639662:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785222.639692:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785222.639733:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785222.639756:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785222.639779:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785222.639809:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530129536 00000100:00100000:1.0:1789785222.639830:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530129536 00000100:00100000:1.0:1789785222.639884:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530130048 00000100:00100000:1.0:1789785222.639887:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530130048 00000100:00100000:1.0:1789785222.639901:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530129664 00000100:00100000:1.0:1789785222.639903:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530129664 00000100:00100000:1.0:1789785222.639914:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530129920 00000100:00100000:1.0:1789785222.639917:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530129920 00000100:00100000:1.0:1789785222.639943:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 240 00000100:00100000:1.0:1789785222.639953:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530129536:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785222.640020:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530129536:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 68us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785222.640027:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 240 00000100:00100000:1.0:1789785222.640044:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 241 00000100:00100000:1.0:1789785222.640050:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530130048:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785222.640081:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530130048:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 31us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785222.640086:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 241 00000100:00100000:1.0:1789785222.640097:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 242 00000100:00100000:1.0:1789785222.640103:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530129664:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785222.640124:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530129664:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 21us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785222.640129:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 242 00000100:00100000:1.0:1789785222.640140:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 243 00000100:00100000:1.0:1789785222.640146:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530129920:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785222.640171:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530129920:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 25us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785222.640183:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 243 00000100:00080000:1.0:1789785222.640202:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789785222.640206:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789785222.640215:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530129408 00000100:00100000:1.0:1789785222.640218:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530129408 00000100:00100000:1.0:1789785222.640241:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 372 00000100:00100000:1.0:1789785222.640247:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2398:x1876725530129408:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785222.640281:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2398:x1876725530129408:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 34us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785222.640287:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 372 00000100:00100000:3.0:1789785222.641370:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530129792 00000100:00100000:3.0:1789785222.641386:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530129792 00000100:00100000:3.0:1789785222.641428:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 100 00000100:00100000:3.0:1789785222.641435:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530129792:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785222.641473:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530129792:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 38us (1811us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785222.641480:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 100 00000100:00080000:1.0:1789785222.642087:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789785223.170551:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789785224.005360:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789785224.006906:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789785224.008982:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549093760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789785224.009243:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785224.015931:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549093760 00000100:00100000:0.0:1789785224.015942:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549093760 00000100:00100000:0.0:1789785224.016007:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789785224.016019:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb538a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549093760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789785224.016458:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785224.017464:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb538a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549093760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1444us (8216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785224.017475:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1789785224.017525:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789785224.017546:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549094272:0@lo:400:kworker.0 00000100:00100000:0.0:1789785224.017589:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785224.017624:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1876725549094784:0@lo:400:kworker.0 00000100:00100000:0.0:1789785224.017727:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785224.017750:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1876725549095296:0@lo:400:kworker.0 00000100:00100000:0.0:1789785224.017774:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789785224.017809:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb620fb80 x1876725549093760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785224.017830:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549093760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789785224.017851:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789785224.017857:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1876725549094144:0@lo:400:kworker.0 00000100:00100000:0.0:1789785224.017880:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785224.017899:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1876725549094656:0@lo:400:kworker.0 00000100:00100000:0.0:1789785224.017931:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785224.017949:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1876725549095168:0@lo:400:kworker.0 00000100:00100000:0.0:1789785224.017969:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785224.018003:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549094272 00000100:00100000:0.0:1789785224.018009:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549094272 00000100:00100000:0.0:1789785224.018890:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789785224.018902:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549094272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785224.018971:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549094272:12345-0@lo:400:kworker.0 Request processed in 72us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785224.018979:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789785224.019002:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549094784 00000100:00100000:0.0:1789785224.019013:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549094784 00000100:00100000:2.0:1789785224.019166:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549093888:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789785224.019197:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785224.019219:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876725549094400:0@lo:400:kworker.0 00000100:00100000:2.0:1789785224.019242:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785224.019253:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549094912:0@lo:400:kworker.0 00000100:00100000:2.0:1789785224.019273:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785224.019290:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549095424:0@lo:400:kworker.0 00000100:00100000:2.0:1789785224.019309:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785224.019331:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1789785224.019354:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549094016:0@lo:400:kworker.0 00000100:00100000:2.0:1789785224.019383:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785224.019405:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549094528:0@lo:400:kworker.0 00000100:00100000:2.0:1789785224.019425:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785224.019442:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549095040:0@lo:400:kworker.0 00000100:00100000:2.0:1789785224.019461:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785224.019478:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549095552:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789785224.019498:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785224.019549:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549093888 00000100:00100000:2.0:1789785224.019554:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549093888 00000100:00100000:2.0:1789785224.019575:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549094528 00000100:00100000:2.0:1789785224.019578:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549094528 00000100:00100000:2.0:1789785224.019591:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789785224.019597:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3659:x1876725549093888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789785224.019621:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789785224.020222:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549095296 00000100:00100000:0.0:1789785224.020228:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549095296 00000100:00100000:0.0:1789785224.020244:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549094144 00000100:00100000:0.0:1789785224.020246:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549094144 00000100:00100000:0.0:1789785224.020256:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549094656 00000100:00100000:0.0:1789785224.020258:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549094656 00000100:00100000:0.0:1789785224.020269:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549095168 00000100:00100000:0.0:1789785224.020271:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549095168 00000100:00100000:0.0:1789785224.020282:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549094400 00000100:00100000:0.0:1789785224.020285:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549094400 00000100:00100000:0.0:1789785224.020297:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789785224.020303:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1876725549094784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785224.020359:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1876725549094784:12345-0@lo:400:kworker.0 Request processed in 56us (2632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785224.020366:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789785224.020380:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789785224.020386:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1876725549095296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785224.020415:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1876725549095296:12345-0@lo:400:kworker.0 Request processed in 29us (2640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785224.020421:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789785224.020433:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789785224.020439:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1876725549094144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785224.020464:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1876725549094144:12345-0@lo:400:kworker.0 Request processed in 26us (2583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785224.020470:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789785224.020480:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789785224.020486:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1876725549094656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785224.020527:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1876725549094656:12345-0@lo:400:kworker.0 Request processed in 41us (2595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785224.020533:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789785224.020545:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789785224.020551:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1876725549095168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785224.020577:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1876725549095168:12345-0@lo:400:kworker.0 Request processed in 27us (2607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785224.020583:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789785224.020593:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789785224.020598:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876725549094400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785224.020887:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876725549094400:12345-0@lo:400:kworker.0 Request processed in 287us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785224.020894:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789785224.020959:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789785224.020967:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3659:x1876725549094528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785224.021001:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3659:x1876725549094528:12345-0@lo:400:kworker.0 Request processed in 35us (1575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785224.021008:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:0.0:1789785224.021026:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789785224.021257:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549093888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1659us (2058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785224.021264:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789785224.021286:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549094912 00000100:00100000:2.0:1789785224.021290:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549094912 00000100:00100000:2.0:1789785224.021318:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549095424 00000100:00100000:2.0:1789785224.021321:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549095424 00000100:00100000:2.0:1789785224.021334:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549095040 00000100:00100000:2.0:1789785224.021349:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549095040 00000100:00100000:2.0:1789785224.021365:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789785224.021371:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549094912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785224.021402:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549094912:12345-0@lo:400:kworker.0 Request processed in 31us (2128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785224.021408:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789785224.021419:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789785224.021425:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549095424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785224.021450:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549095424:12345-0@lo:400:kworker.0 Request processed in 26us (2140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785224.021455:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789785224.021465:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789785224.021471:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549095040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785224.021507:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549095040:12345-0@lo:400:kworker.0 Request processed in 37us (2044us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785224.021514:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789785224.021536:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549094016 00000100:00100000:2.0:1789785224.021539:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549094016 00000100:00100000:2.0:1789785224.021563:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1789785224.021569:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:3659:x1876725549094016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785224.021597:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:3659:x1876725549094016:12345-0@lo:400:kworker.0 Request processed in 28us (2214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785224.021603:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00080000:0.0:1789785224.022026:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789785224.022412:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789785224.022416:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789785224.022464:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1876725549094144:0@lo:400:kworker.0 00000100:00100000:0.0:1789785224.022479:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1876725549094656:0@lo:400:kworker.0 00000100:00100000:0.0:1789785224.022490:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1876725549095168:0@lo:400:kworker.0 00000100:00100000:0.0:1789785224.022516:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549094272:0@lo:400:kworker.0 00010000:00080000:0.0:1789785224.022529:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3e9500 x1876725549094784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785224.022539:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1876725549094784:0@lo:400:kworker.0 00010000:00080000:0.0:1789785224.022551:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf452a00 x1876725549095296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785224.022559:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1876725549095296:0@lo:400:kworker.0 00000100:00100000:2.0:1789785224.022765:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549094016:0@lo:400:kworker.0 00000100:00100000:2.0:1789785224.022778:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549094528:0@lo:400:kworker.0 00000100:00100000:2.0:1789785224.022788:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549095040:0@lo:400:kworker.0 00000100:00100000:2.0:1789785224.022804:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549093888:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789785224.022815:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876725549094400:0@lo:400:kworker.0 00000100:00100000:2.0:1789785224.022825:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549094912:0@lo:400:kworker.0 00010000:00080000:2.0:1789785224.022836:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf452d80 x1876725549095424/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785224.022845:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549095424:0@lo:400:kworker.0 00000100:00100000:2.0:1789785224.022887:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549095552 00000100:00100000:2.0:1789785224.022891:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549095552 00000100:00100000:2.0:1789785224.022938:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789785224.022947:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549095552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789785224.022973:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785224.023023:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549095552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (3524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785224.024718:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:2.0:1789785224.024782:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83ad6300 x1876725549095552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785224.024869:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549095552:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789785224.218789:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785225.218681:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785225.540055:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf451c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549095680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789785225.540126:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785225.540227:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549095680 00000100:00100000:2.0:1789785225.540235:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549095680 00000100:00100000:2.0:1789785225.540658:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789785225.540669:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549095680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789785225.540869:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789785225.540933:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549095680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 266us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785225.540940:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789785225.540986:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf451c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549095680:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789785225.541583:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789785225.541595:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549095936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789785225.542825:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785225.543907:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549095808:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789785225.543959:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785225.544425:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549095936 00000100:00100000:1.0:1789785225.544433:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549095936 00000100:00100000:1.0:1789785225.544481:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549095808 00000100:00100000:1.0:1789785225.544484:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549095808 00000100:00100000:1.0:1789785225.544500:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789785225.544508:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549095936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789785225.544533:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785225.544586:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549095936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (1764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785225.544593:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789785225.544607:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789785225.544613:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549095808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789785225.544631:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785225.544663:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549095808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785225.544693:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789785225.544735:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549095808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789785225.546864:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549095936:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789785226.243511:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785227.267069:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785227.756517:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785227.756620:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530130176 00000100:00100000:3.0:1789785227.756633:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530130176 00000100:00100000:3.0:1789785227.756704:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 374 00000100:00100000:3.0:1789785227.756716:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2397:x1876725530130176:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785227.756816:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2397:x1876725530130176:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 102us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785227.756824:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 374 00000100:00100000:0.0:1789785227.767947:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785227.768123:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530130304 00000100:00100000:3.0:1789785227.768138:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530130304 00000100:00100000:3.0:1789785227.768240:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 250 00000100:00100000:3.0:1789785227.768254:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530130304:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785227.768642:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530130304:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 390us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785227.768653:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 250 00000100:00080000:0.0:1789785227.769745:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789785227.778476:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785227.778611:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530130432 00000100:00100000:2.0:1789785227.778624:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530130432 00000100:00100000:2.0:1789785227.778723:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 251 00000100:00100000:2.0:1789785227.778739:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530130432:12345-192.168.203.46@tcp:400:kworker.0 00000100:00080000:0.0:1789785227.779126:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789785227.779167:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530130432:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 432us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785227.779177:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 251 00000100:00100000:2.0:1789785227.797128:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785227.797179:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785227.797217:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785227.797512:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530130688 00000100:00100000:1.0:1789785227.797525:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530130688 00000100:00100000:1.0:1789785227.797619:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530130816 00000100:00100000:1.0:1789785227.797622:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530130816 00000100:00100000:1.0:1789785227.797653:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 252 00000100:00100000:1.0:1789785227.797664:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530130688:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785227.797762:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530130688:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 98us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785227.797770:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 252 00000100:00100000:1.0:1789785227.797789:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 253 00000100:00100000:1.0:1789785227.797796:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2397:x1876725530130816:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785227.797824:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2397:x1876725530130816:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 29us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785227.797831:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 253 00000100:00080000:2.0:1789785227.798537:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789785227.798545:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789785227.798783:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530130560 00000100:00100000:0.0:1789785227.798792:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530130560 00000100:00100000:0.0:1789785227.798876:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 27 00000100:00100000:0.0:1789785227.798896:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2396:x1876725530130560:12345-192.168.203.46@tcp:9:kworker.0 00000020:00000080:0.0:1789785227.798926:0:8805:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c49d 00000100:00080000:0.0:1789785227.798937:0:8805:0:(import.c:65:import_set_state_nolock()) ffff9dafbf439000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789785227.799001:0:8805:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:0.0:1789785227.799188:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+2:2396:x1876725530130560:12345-192.168.203.46@tcp:9:kworker.0 Request processed in 303us (2075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785227.799214:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 27 00010000:00010000:3.0:1789785227.799511:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789785227.800012:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789785228.290640:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785229.122919:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789785229.122955:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549096064:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789785229.123065:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785229.123157:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789785229.123168:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549096192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789785229.123201:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785229.123236:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549096064 00000100:00100000:1.0:1789785229.123245:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549096064 00000100:00100000:1.0:1789785229.123599:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789785229.123629:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf453b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549096064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789785229.123667:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785229.123717:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf453b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549096064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785229.123725:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1789785229.123750:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789785229.123796:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83ad6300 x1876725549096064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785229.123820:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549096064:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789785229.123952:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549096192 00000100:00100000:1.0:1789785229.123957:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549096192 00000100:00100000:1.0:1789785229.123986:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789785229.123992:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549096192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789785229.124137:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789785229.124184:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549096192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 191us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785229.124190:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789785229.124232:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549096192:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789785229.124516:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549096576:0@lo:400:kworker.0 00000100:00100000:3.0:1789785229.124575:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785229.130881:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549096704:0@lo:400:kworker.0 00000100:00100000:0.0:1789785229.130953:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785229.130995:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549097216:0@lo:400:kworker.0 00000100:00100000:0.0:1789785229.131018:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785229.131032:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549097728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789785229.131050:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785229.131092:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789785229.131098:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549096320:0@lo:400:kworker.0 00000100:00100000:0.0:1789785229.132630:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785229.132766:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1876725549096832:0@lo:400:kworker.0 00000100:00100000:0.0:1789785229.132817:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785229.132838:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1876725549097344:0@lo:400:kworker.0 00000100:00100000:0.0:1789785229.132859:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785229.132906:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549097728 00000100:00100000:0.0:1789785229.132914:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549097728 00000100:00100000:0.0:1789785229.132966:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789785229.132975:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549097728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789785229.132998:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785229.133044:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549097728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (1992us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785229.133051:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:0.0:1789785229.133089:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3d0a80 x1876725549097728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785229.133126:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549097728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789785229.133171:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549096448:0@lo:400:kworker.0 00000100:00100000:0.0:1789785229.133848:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785229.133883:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549096960:0@lo:400:kworker.0 00000100:00100000:0.0:1789785229.133912:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785229.133935:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1876725549097472:0@lo:400:kworker.0 00000100:00100000:0.0:1789785229.133953:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785229.133989:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549096704 00000100:00100000:0.0:1789785229.133993:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549096704 00000100:00100000:0.0:1789785229.134014:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549096832 00000100:00100000:0.0:1789785229.134017:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549096832 00000100:00100000:0.0:1789785229.134027:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549097344 00000100:00100000:0.0:1789785229.134030:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549097344 00000100:00100000:0.0:1789785229.134038:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549096448 00000100:00100000:0.0:1789785229.134040:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549096448 00000100:00100000:0.0:1789785229.134047:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549096960 00000100:00100000:0.0:1789785229.134049:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549096960 00000100:00100000:0.0:1789785229.134058:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549097472 00000100:00100000:0.0:1789785229.134060:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549097472 00000100:00100000:0.0:1789785229.134072:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789785229.134078:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549096704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785229.134115:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549096704:12345-0@lo:400:kworker.0 Request processed in 37us (3162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785229.134122:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789785229.134862:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789785229.135523:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1876725549096832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785229.135707:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549096704:0@lo:400:kworker.0 00000100:00080000:1.0:1789785229.135751:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789785229.135759:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789785229.135764:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789785229.135791:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1876725549096832:12345-0@lo:400:kworker.0 Request processed in 918us (2970us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785229.135795:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789785229.135811:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1876725549097344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785229.135857:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789785229.135892:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789785229.135904:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549096448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785229.135911:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1876725549097344:12345-0@lo:400:kworker.0 Request processed in 105us (3049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785229.135933:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789785229.135960:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549096448:12345-0@lo:400:kworker.0 Request processed in 57us (2110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785229.135968:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789785229.135982:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789785229.135990:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549096960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785229.136010:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789785229.136019:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876725549097472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785229.136044:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876725549097472:12345-0@lo:400:kworker.0 Request processed in 27us (2090us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785229.136049:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789785229.136100:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549096448:0@lo:400:kworker.0 00010000:00080000:0.0:1789785229.136113:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3d2300 x1876725549097472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785229.136854:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1876725549097472:0@lo:400:kworker.0 00000100:00100000:2.0:1789785229.136983:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549097216 00000100:00100000:2.0:1789785229.136996:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549097216 00000100:00100000:0.0:1789785229.136997:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1876725549096832:0@lo:400:kworker.0 00000100:00100000:0.0:1789785229.137017:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1876725549097344:0@lo:400:kworker.0 00000100:00100000:2.0:1789785229.137078:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789785229.137092:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549097216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785229.137180:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549097216:12345-0@lo:400:kworker.0 Request processed in 93us (6160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785229.137187:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1789785229.137215:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789785229.137245:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549097216:0@lo:400:kworker.0 00000100:00100000:0.0:1789785229.138947:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549096320 00000100:00100000:0.0:1789785229.138961:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549096320 00000100:00100000:0.0:1789785229.139032:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1789785229.139041:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:3661:x1876725549096320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785229.140215:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549096960:12345-0@lo:400:kworker.0 Request processed in 4223us (6291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785229.140231:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00010000:00080000:2.0:1789785229.140297:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3d0700 x1876725549096960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785229.140316:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549096960:0@lo:400:kworker.0 00000100:00100000:0.0:1789785229.142947:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:3661:x1876725549096320:12345-0@lo:400:kworker.0 Request processed in 3898us (11813us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785229.142961:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1789785229.143667:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549096320:0@lo:400:kworker.0 00000100:00100000:3.0:1789785229.146934:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549097088:0@lo:400:kworker.0 00000100:00100000:3.0:1789785229.147017:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785229.147047:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549097600:0@lo:400:kworker.0 00000100:00100000:3.0:1789785229.147065:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785229.147168:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549097088 00000100:00100000:2.0:1789785229.147178:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549097088 00000100:00100000:2.0:1789785229.147247:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549097600 00000100:00100000:2.0:1789785229.147250:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549097600 00000100:00100000:2.0:1789785229.147286:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789785229.147296:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549097088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785229.147378:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549097088:12345-0@lo:400:kworker.0 Request processed in 83us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785229.147385:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789785229.147413:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789785229.147419:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549097600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785229.147442:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549097600:12345-0@lo:400:kworker.0 Request processed in 24us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785229.147447:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1789785229.147615:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789785229.147648:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549097088:0@lo:400:kworker.0 00010000:00080000:3.0:1789785229.147661:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3d0380 x1876725549097600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785229.147672:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549097600:0@lo:400:kworker.0 00000100:00100000:0.0:1789785229.147842:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549096576 00000100:00100000:0.0:1789785229.147848:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549096576 00000100:00100000:0.0:1789785229.147903:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789785229.147910:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549096576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785229.147961:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549096576:12345-0@lo:400:kworker.0 Request processed in 53us (23387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785229.147967:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789785229.148029:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549096576:0@lo:400:kworker.0 00010000:00010000:0.0:1789785229.314965:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785230.339920:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785230.658935:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549097856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789785230.659031:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785230.659121:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549097856 00000100:00100000:3.0:1789785230.659131:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549097856 00000100:00100000:3.0:1789785230.659197:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789785230.659207:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8393f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549097856:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789785230.659218:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789785230.659228:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549097984:0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789785230.659243:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785230.659258:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785230.659307:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8393f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549097856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785230.659316:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789785230.659332:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549097984 00000100:00100000:3.0:1789785230.659335:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549097984 00000100:00100000:1.0:1789785230.659356:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549097856:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789785230.659374:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789785230.659380:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549097984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789785230.659391:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785230.659430:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549097984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785230.659454:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789785230.659657:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549098112:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789785230.659688:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785230.659731:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549097984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789785230.659740:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549098112 00000100:00100000:0.0:1789785230.659744:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549098112 00000100:00100000:0.0:1789785230.659786:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789785230.659793:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549098112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789785230.659820:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789785230.659878:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549098112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785230.659884:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789785230.659952:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549098112:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789785231.367108:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785232.387773:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785232.877217:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785232.877333:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785232.877464:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785232.877496:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785232.877615:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530130944 00000100:00100000:2.0:1789785232.877625:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530130944 00000100:00100000:2.0:1789785232.877674:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 376 00000100:00100000:2.0:1789785232.877683:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2397:x1876725530130944:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785232.877748:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2397:x1876725530130944:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 65us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785232.877756:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 376 00000100:00100000:3.0:1789785232.883573:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785232.887831:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530131072 00000100:00100000:1.0:1789785232.887854:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530131072 00000100:00100000:1.0:1789785232.887948:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530131328 00000100:00100000:1.0:1789785232.887952:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530131328 00000100:00100000:1.0:1789785232.887972:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530131200 00000100:00100000:1.0:1789785232.887974:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530131200 00000100:00100000:1.0:1789785232.887993:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 260 00000100:00100000:1.0:1789785232.888002:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530131072:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785232.888082:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530131072:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 80us (10876us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785232.888090:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 260 00000100:00100000:1.0:1789785232.888109:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 261 00000100:00100000:1.0:1789785232.888130:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2397:x1876725530131328:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785232.888158:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2397:x1876725530131328:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 29us (10825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785232.888164:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 261 00000100:00100000:1.0:1789785232.888178:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 262 00000100:00100000:1.0:1789785232.888184:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530131200:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785232.888208:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530131200:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 25us (10712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785232.888214:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 262 00000100:00080000:0.0:1789785232.889074:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789785232.889079:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789785232.889840:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530131456 00000100:00100000:1.0:1789785232.889856:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530131456 00000100:00080000:0.0:1789785232.890029:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789785232.890216:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 263 00000100:00100000:1.0:1789785232.890226:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2397:x1876725530131456:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785232.890315:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2397:x1876725530131456:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 91us (6763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785232.890323:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 263 00010000:00010000:3.0:1789785233.410975:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789785233.736667:0:8445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 026b2112-ee35-499c-8d01-18663664f08e 00000020:00000080:3.0:1789785233.736677:0:8445:0:(genops.c:885:class_export_put()) final put ffff9dafbf3c2000/026b2112-ee35-499c-8d01-18663664f08e 00000020:00000080:0.0:1789785233.739061:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafbf3c2000/026b2112-ee35-499c-8d01-18663664f08e for lustre-OST0000 00000020:00000080:1.0:1789785233.740020:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dafbf439000 for lustre-OST0000 00000040:00080000:0.0:1789785234.250815:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789785234.254025:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789785234.254120:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549098240:0@lo:400:kworker.0 00000100:00100000:0.0:1789785234.254190:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785234.254241:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549098752:0@lo:400:kworker.0 00000100:00100000:0.0:1789785234.255365:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785234.255397:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549099264:0@lo:400:kworker.0 00000100:00100000:0.0:1789785234.255424:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785234.255445:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549099776:0@lo:400:kworker.0 00000100:00100000:0.0:1789785234.255466:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785234.255492:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789785234.255501:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725549098368:0@lo:400:kworker.0 00000100:00100000:0.0:1789785234.255530:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785234.255550:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1876725549098880:0@lo:400:kworker.0 00000100:00100000:0.0:1789785234.255572:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785234.255628:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549098752 00000100:00100000:1.0:1789785234.255636:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549098752 00000100:00100000:0.0:1789785234.255765:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1876725549099392:0@lo:400:kworker.0 00000100:00100000:0.0:1789785234.255797:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785234.255823:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549099904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789785234.255830:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549098368 00000100:00100000:3.0:1789785234.255847:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549098368 00000100:00100000:0.0:1789785234.255873:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785234.255882:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549098880 00000100:00100000:3.0:1789785234.255886:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549098880 00000100:00100000:0.0:1789785234.255917:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549098496:0@lo:400:kworker.0 00000100:00100000:3.0:1789785234.255918:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549099392 00000100:00100000:3.0:1789785234.255923:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549099392 00000100:00100000:3.0:1789785234.255948:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789785234.255952:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785234.255962:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf987fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725549098368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785234.255974:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549099008:0@lo:400:kworker.0 00000100:00100000:0.0:1789785234.255997:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785234.256013:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1876725549099520:0@lo:400:kworker.0 00000100:00100000:3.0:1789785234.256031:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf987fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725549098368:12345-0@lo:400:kworker.0 Request processed in 70us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785234.256041:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789785234.256042:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785234.256060:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549099008 00000100:00100000:3.0:1789785234.256065:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549099008 00000100:00100000:0.0:1789785234.256069:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549100032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789785234.256082:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549099520 00000100:00100000:3.0:1789785234.256086:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549099520 00000100:00100000:0.0:1789785234.256096:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785234.256107:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789785234.256115:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf987fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1876725549098880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785234.256121:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1789785234.256130:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876725549098624:0@lo:400:kworker.0 00000100:00100000:1.0:1789785234.256155:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549098496 00000100:00100000:3.0:1789785234.256157:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf987fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1876725549098880:12345-0@lo:400:kworker.0 Request processed in 41us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785234.256161:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549098496 00000100:00100000:0.0:1789785234.256164:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785234.256175:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789785234.256184:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549099136:0@lo:400:kworker.0 00000100:00100000:3.0:1789785234.256195:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549098624 00000100:00100000:3.0:1789785234.256201:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549098624 00000100:00100000:0.0:1789785234.256215:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785234.256227:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789785234.256237:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf987fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1876725549099392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785234.256245:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549099648:0@lo:400:kworker.0 00000100:00100000:1.0:1789785234.256381:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549100032 00000100:00100000:1.0:1789785234.256385:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549100032 00000100:00100000:1.0:1789785234.256535:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789785234.256544:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf987fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3661:x1876725549098752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785234.257484:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785234.257520:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549100160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789785234.257557:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785234.258053:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf987fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3661:x1876725549098752:12345-0@lo:400:kworker.0 Request processed in 1509us (2689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785234.258066:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549098240 00000100:00100000:1.0:1789785234.258072:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789785234.258073:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549098240 00000100:00100000:1.0:1789785234.258102:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789785234.258111:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549098496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785234.258118:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1789785234.258129:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf8590f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:3661:x1876725549098240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785234.258140:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf987fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1876725549099392:12345-0@lo:400:kworker.0 Request processed in 1902us (2340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785234.258151:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789785234.258167:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549098496:12345-0@lo:400:kworker.0 Request processed in 56us (2216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785234.258174:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789785234.258179:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789785234.258179:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf8590f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:3661:x1876725549098240:12345-0@lo:400:kworker.0 Request processed in 50us (3986us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785234.258189:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549099008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785234.258193:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1789785234.258200:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789785234.258210:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549100032:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789785234.258234:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549099264 00000004:00000024:1.0:1789785234.258235:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789785234.258240:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549099008:12345-0@lo:400:kworker.0 Request processed in 54us (2239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785234.258241:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549099264 00000100:00100000:3.0:1789785234.258251:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789785234.258270:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549099776 00000100:00100000:0.0:1789785234.258274:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549099776 00000100:00100000:1.0:1789785234.258275:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549100032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (2178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785234.258284:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789785234.258293:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549099136 00000100:00100000:3.0:1789785234.258364:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789785234.258372:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876725549099520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785234.258502:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876725549099520:12345-0@lo:400:kworker.0 Request processed in 130us (2461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785234.258511:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789785234.258530:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789785234.258537:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876725549098624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785234.258566:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876725549098624:12345-0@lo:400:kworker.0 Request processed in 29us (2403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785234.258572:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789785234.258585:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549099648 00000100:00100000:1.0:1789785234.258591:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549099648 00000100:00100000:3.0:1789785234.258600:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549099904 00000100:00100000:3.0:1789785234.258606:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549099904 00000100:00100000:1.0:1789785234.258617:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789785234.258627:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf987fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549099264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785234.258642:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549100160 00000100:00100000:3.0:1789785234.258647:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549100160 00000100:00100000:3.0:1789785234.258664:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789785234.258669:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf987fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549099264:12345-0@lo:400:kworker.0 Request processed in 44us (3242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785234.258674:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1876725549099904:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789785234.258681:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00002000:00000024:3.0:1789785234.258697:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785234.258699:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789785234.258710:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf987ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3661:x1876725549099776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785234.258738:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1876725549099904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (2864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785234.258746:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789785234.258754:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf987ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3661:x1876725549099776:12345-0@lo:400:kworker.0 Request processed in 44us (3285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785234.258760:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789785234.258764:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789785234.258771:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3659:x1876725549100160:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789785234.258782:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00002000:00000024:3.0:1789785234.258783:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785234.258797:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3659:x1876725549099648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785234.258813:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3659:x1876725549100160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785234.258820:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:3.0:1789785234.258853:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789785234.258858:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789785234.258860:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789785234.258862:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789785234.259078:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549099648:12345-0@lo:400:kworker.0 Request processed in 282us (1597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785234.259087:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789785234.259108:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725549098368:0@lo:400:kworker.0 00000100:00100000:1.0:1789785234.259124:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876725549098624:0@lo:400:kworker.0 00000100:00100000:3.0:1789785234.259129:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1876725549098880:0@lo:400:kworker.0 00010000:00080000:1.0:1789785234.259148:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9daf987fc000 x1876725549099648/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785234.259149:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1876725549099392:0@lo:400:kworker.0 00000100:00100000:1.0:1789785234.259166:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549099648:0@lo:400:kworker.0 00010000:00080000:3.0:1789785234.259168:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9daf987fea00 x1876725549099904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1789785234.259184:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf452d80 x1876725549100160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785234.259187:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549099904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789785234.259206:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549100160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789785234.259208:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549098240:0@lo:400:kworker.0 00000100:00100000:1.0:1789785234.259224:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549098496:0@lo:400:kworker.0 00000100:00100000:3.0:1789785234.259237:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549098752:0@lo:400:kworker.0 00010000:00080000:1.0:1789785234.259244:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9daf987fd500 x1876725549099008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785234.259245:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549099136 00000100:00100000:1.0:1789785234.259257:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549099008:0@lo:400:kworker.0 00010000:00080000:1.0:1789785234.259271:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9daf987fd880 x1876725549099520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785234.259279:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1876725549099520:0@lo:400:kworker.0 00000100:00100000:0.0:1789785234.259290:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789785234.259296:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549100032:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789785234.259445:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549099136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785234.259493:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549099136:12345-0@lo:400:kworker.0 Request processed in 53us (3279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785234.259507:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789785234.259525:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549099264:0@lo:400:kworker.0 00000100:00100000:1.0:1789785234.259541:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549099136:0@lo:400:kworker.0 00010000:00080000:3.0:1789785234.259548:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9daf987fed80 x1876725549099776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785234.259559:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549099776:0@lo:400:kworker.0 00000100:00080000:3.0:1789785234.259589:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789785234.436811:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785235.461233:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785235.778714:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549100288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789785235.778783:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785235.778978:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549100288 00000100:00100000:2.0:1789785235.778986:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549100288 00000100:00100000:2.0:1789785235.779037:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789785235.779047:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549100288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789785235.779078:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789785235.779122:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549100288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785235.779143:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789785235.779232:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549100288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789785235.780508:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789785235.780521:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549100416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789785235.780575:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785235.780606:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549100416 00000100:00100000:3.0:1789785235.780610:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549100416 00000100:00100000:3.0:1789785235.780638:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789785235.780645:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549100416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789785235.780665:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785235.780697:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549100416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785235.780703:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789785235.780734:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549100416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789785235.780893:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549100544:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789785235.780920:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785235.781463:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549100544 00000100:00100000:0.0:1789785235.781468:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549100544 00000100:00100000:0.0:1789785235.781502:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789785235.781510:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549100544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789785235.781524:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785235.781581:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549100544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785235.781587:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789785235.781621:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549100544:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789785236.483559:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785237.511159:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785237.998872:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785237.998917:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785237.998960:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785237.998985:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785237.999021:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785237.999048:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530131584 00000100:00100000:1.0:1789785237.999056:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530131584 00000100:00100000:1.0:1789785237.999101:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 378 00000100:00100000:1.0:1789785237.999110:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2398:x1876725530131584:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785237.999173:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2398:x1876725530131584:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 64us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785237.999181:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 378 00000100:00100000:1.0:1789785237.999210:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530131712 00000100:00100000:1.0:1789785237.999215:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530131712 00000100:00100000:1.0:1789785237.999246:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530131968 00000100:00100000:1.0:1789785237.999249:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530131968 00000100:00100000:1.0:1789785237.999262:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530131840 00000100:00100000:1.0:1789785237.999264:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530131840 00000100:00100000:1.0:1789785237.999275:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530132096 00000100:00100000:1.0:1789785237.999277:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530132096 00000100:00100000:1.0:1789785237.999289:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 270 00000100:00100000:1.0:1789785237.999295:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530131712:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785237.999326:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530131712:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 31us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785237.999332:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 270 00000100:00100000:1.0:1789785237.999372:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 271 00000100:00100000:1.0:1789785237.999378:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf453800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530131968:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785237.999401:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf453800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530131968:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 24us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785237.999413:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 271 00000100:00100000:1.0:1789785237.999426:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 272 00000100:00100000:1.0:1789785237.999443:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530131840:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785237.999470:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530131840:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 39us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785237.999475:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 272 00000100:00100000:1.0:1789785237.999487:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 273 00000100:00100000:1.0:1789785237.999493:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf987fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530132096:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785237.999531:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf987fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530132096:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 38us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785237.999538:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 273 00000100:00080000:1.0:1789785237.999561:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789785237.999565:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789785238.532136:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785239.362732:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789785239.362754:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549100672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789785239.362828:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785239.362887:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549100672 00000100:00100000:2.0:1789785239.362894:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549100672 00000100:00100000:2.0:1789785239.362954:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789785239.362962:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549100672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789785239.362988:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785239.363030:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549100672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785239.363037:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:2.0:1789785239.363056:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789785239.363080:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3f1880 x1876725549100672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785239.363097:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549100672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789785239.363307:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789785239.363318:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549100800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789785239.363370:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785239.363398:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549100800 00000100:00100000:3.0:1789785239.363403:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549100800 00000100:00100000:3.0:1789785239.363431:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789785239.363437:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549100800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789785239.363460:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789785239.363493:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549100800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785239.363499:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789785239.363530:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549100800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789785239.366781:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876725549101184:0@lo:400:kworker.0 00000100:00100000:1.0:1789785239.366854:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785239.366892:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549101696:0@lo:400:kworker.0 00000100:00100000:1.0:1789785239.366925:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785239.366945:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1876725549102208:0@lo:400:kworker.0 00000100:00100000:1.0:1789785239.366966:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785239.366988:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789785239.366994:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549101056:0@lo:400:kworker.0 00000100:00100000:1.0:1789785239.367018:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785239.367043:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1876725549101568:0@lo:400:kworker.0 00000100:00100000:1.0:1789785239.367077:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785239.367092:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1876725549102080:0@lo:400:kworker.0 00000100:00100000:0.0:1789785239.367106:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549101056 00000100:00100000:1.0:1789785239.367111:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785239.367113:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549101056 00000100:00100000:1.0:1789785239.367133:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549101184 00000100:00100000:1.0:1789785239.367136:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549101184 00000100:00100000:1.0:1789785239.367161:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549101696 00000100:00100000:1.0:1789785239.367163:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549101696 00000100:00100000:1.0:1789785239.367182:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549102208 00000100:00100000:1.0:1789785239.367184:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549102208 00000100:00100000:1.0:1789785239.367196:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549101568 00000100:00100000:1.0:1789785239.367199:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549101568 00000100:00100000:1.0:1789785239.367208:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549102080 00000100:00100000:1.0:1789785239.367211:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549102080 00000100:00100000:1.0:1789785239.367226:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789785239.367233:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876725549101184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785239.367279:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876725549101184:12345-0@lo:400:kworker.0 Request processed in 46us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785239.367286:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789785239.367303:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789785239.367309:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1876725549101696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785239.367334:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1876725549101696:12345-0@lo:400:kworker.0 Request processed in 26us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785239.367358:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789785239.367370:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789785239.367375:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1876725549102208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785239.367398:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1876725549102208:12345-0@lo:400:kworker.0 Request processed in 24us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785239.367412:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789785239.367421:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789785239.367426:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1876725549101568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785239.367446:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1876725549101568:12345-0@lo:400:kworker.0 Request processed in 20us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785239.367451:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789785239.367459:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789785239.367464:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1876725549102080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785239.367482:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1876725549102080:12345-0@lo:400:kworker.0 Request processed in 18us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785239.367487:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789785239.367520:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1876725549101568:0@lo:400:kworker.0 00000100:00100000:1.0:1789785239.367528:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1876725549102080:0@lo:400:kworker.0 00000100:00100000:1.0:1789785239.367536:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876725549101184:0@lo:400:kworker.0 00010000:00080000:1.0:1789785239.367546:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9daf987fd880 x1876725549101696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785239.367556:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549101696:0@lo:400:kworker.0 00010000:00080000:1.0:1789785239.367563:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9daf987fc380 x1876725549102208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785239.367571:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1876725549102208:0@lo:400:kworker.0 00000100:00100000:3.0:1789785239.367715:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549100928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789785239.367743:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785239.367766:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725549101440:0@lo:400:kworker.0 00000100:00100000:3.0:1789785239.367784:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785239.367808:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549101952:0@lo:400:kworker.0 00000100:00100000:3.0:1789785239.367827:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785239.367844:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789785239.367849:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549101312:0@lo:400:kworker.0 00000100:00100000:3.0:1789785239.367871:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785239.367888:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549101824:0@lo:400:kworker.0 00000100:00100000:3.0:1789785239.367916:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785239.367933:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549102336:0@lo:400:kworker.0 00000100:00100000:3.0:1789785239.367953:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785239.367983:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549101952 00000100:00100000:3.0:1789785239.367987:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549101952 00000100:00100000:3.0:1789785239.368010:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549101824 00000100:00100000:3.0:1789785239.368012:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549101824 00000100:00100000:3.0:1789785239.368021:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549102336 00000100:00100000:3.0:1789785239.368023:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549102336 00000100:00100000:3.0:1789785239.368037:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789785239.368043:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549101952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785239.368076:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549101952:12345-0@lo:400:kworker.0 Request processed in 33us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785239.368082:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789785239.368094:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789785239.368100:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549101824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785239.368122:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549101824:12345-0@lo:400:kworker.0 Request processed in 24us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785239.368128:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789785239.368136:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789785239.368142:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549102336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785239.368180:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549102336:12345-0@lo:400:kworker.0 Request processed in 38us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785239.368186:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789785239.368204:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549101312 00000100:00100000:3.0:1789785239.368207:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549101312 00000100:00100000:3.0:1789785239.368231:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789785239.368237:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549101312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785239.368267:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549101312:12345-0@lo:400:kworker.0 Request processed in 31us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785239.368281:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789785239.368316:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549101312:0@lo:400:kworker.0 00000100:00100000:3.0:1789785239.368324:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549101824:0@lo:400:kworker.0 00010000:00080000:3.0:1789785239.368332:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf3d1f80 x1876725549102336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785239.368361:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549102336:0@lo:400:kworker.0 00000100:00100000:3.0:1789785239.368370:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549101952:0@lo:400:kworker.0 00000100:00100000:3.0:1789785239.368391:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549101440 00000100:00100000:3.0:1789785239.368394:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549101440 00000100:00100000:3.0:1789785239.368413:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789785239.368418:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725549101440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785239.368444:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725549101440:12345-0@lo:400:kworker.0 Request processed in 26us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785239.368450:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789785239.368469:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725549101440:0@lo:400:kworker.0 00000100:00080000:2.0:1789785239.368602:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789785239.368606:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789785239.368609:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789785239.368611:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789785239.368654:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549100928 00000100:00100000:1.0:1789785239.368658:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549100928 00000100:00100000:1.0:1789785239.368690:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789785239.368696:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549100928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789785239.368710:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785239.368738:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549100928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785239.368743:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789785239.368971:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1789785239.368981:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:3660:x1876725549101056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785239.369062:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549101056:0@lo:400:kworker.0 00000100:00100000:0.0:1789785239.369322:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:3660:x1876725549101056:12345-0@lo:400:kworker.0 Request processed in 343us (2302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785239.369330:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00010000:00080000:3.0:1789785239.370110:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9daf987ff100 x1876725549100928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785239.370130:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549100928:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789785239.556512:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789785239.694274:0:14073:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 22:33:57 (1789785237) 00010000:00010000:3.0:1789785240.579845:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785240.899076:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789785240.899080:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc18c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549102592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789785240.899089:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549102464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789785240.899189:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549102720:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789785240.906697:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785240.906716:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785240.906821:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549102464 00000100:00100000:3.0:1789785240.906841:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549102464 00000100:00100000:3.0:1789785240.906894:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789785240.906905:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549102464:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789785240.906929:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549102720 00000100:00100000:1.0:1789785240.906935:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549102720 00000004:00000024:3.0:1789785240.906941:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789785240.906967:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789785240.906975:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549102720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789785240.906994:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785240.907031:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549102720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785240.907038:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789785240.907100:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549102464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 196us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785240.907108:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789785240.907174:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549102720:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789785240.907236:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549102464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789785240.907264:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785240.907355:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549102592 00000100:00100000:0.0:1789785240.907360:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549102592 00000100:00100000:0.0:1789785240.907386:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789785240.907394:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549102592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789785240.907404:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785240.907450:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549102592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785240.907457:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789785240.907731:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc18c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549102592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789785241.468821:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785241.468986:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530132224 00000100:00100000:2.0:1789785241.468996:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530132224 00000100:00100000:2.0:1789785241.469072:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 40 00000100:00100000:2.0:1789785241.469086:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+5:11079:x1876725530132224:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00000100:00080000:0.0:1789785241.469184:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789785241.469283:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785241.469305:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09a00/0x2f18ee3fd845c57d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8632 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.469399:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c584 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.469412:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c584 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.469424:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c584 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789785241.469467:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789785241.469470:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789785241.469505:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c584 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.469530:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09a00/0x2f18ee3fd845c57d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8632 expref: 7 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.469548:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c584 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8632 expref: 6 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.469556:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9daf87d6e400) 00010000:00010000:2.0:1789785241.469572:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789785241.469577:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b09e00, rc 0) 00000100:00100000:2.0:1789785241.469745:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+6:11079:x1876725530132224:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 662us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785241.469752:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 40 00000100:00100000:3.0:1789785241.496954:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785241.497112:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530132352 00000100:00100000:1.0:1789785241.497122:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530132352 00000100:00100000:1.0:1789785241.497189:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 41 00000100:00100000:1.0:1789785241.497200:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+6:11080:x1876725530132352:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789785241.497220:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785241.497239:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845c58b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8639 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785241.497321:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845c592 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785241.497335:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845c592 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785241.497378:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845c592 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785241.497392:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845c599 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785241.497400:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845c599 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785241.497406:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845c599 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785241.497465:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64c00/0x2f18ee3fd845c5a0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785241.497473:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64c00/0x2f18ee3fd845c5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785241.497479:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64c00/0x2f18ee3fd845c5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789785241.497516:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789785241.497520:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789785241.497539:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64c00/0x2f18ee3fd845c5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785241.497560:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845c592 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785241.497577:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845c592 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785241.497583:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845c592 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785241.497589:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc21ca600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785241.497593:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845c592 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785241.497600:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845c592 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785241.497612:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9daf87d6e400) 00010000:00010000:1.0:1789785241.497615:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785241.497621:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845c592 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785241.497626:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845c592 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785241.497831:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845c599 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785241.497840:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845c599 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785241.497846:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845c599 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785241.497858:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc21cbc00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785241.497861:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845c599 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785241.497868:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845c599 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785241.497876:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9dae827c0a00) 00010000:00010000:1.0:1789785241.497879:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785241.497882:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845c599 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785241.497888:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845c599 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785241.497993:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845c58b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8639 expref: 8 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785241.498005:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64c00/0x2f18ee3fd845c5a0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8639 expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785241.498013:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dae827c0300) 00010000:00010000:1.0:1789785241.498015:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789785241.498018:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64c00, rc 0) 00000100:00100000:1.0:1789785241.498080:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+7:11080:x1876725530132352:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 881us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785241.498089:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 41 00000100:00100000:1.0:1789785241.501846:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785241.502005:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530132480 00000100:00100000:3.0:1789785241.502015:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530132480 00000100:00100000:3.0:1789785241.502112:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:3.0:1789785241.502123:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:026b2112-ee35-499c-8d01-18663664f08e+7:11080:x1876725530132480:12345-192.168.203.46@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789785241.502212:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:026b2112-ee35-499c-8d01-18663664f08e+7:11080:x1876725530132480:12345-192.168.203.46@tcp:900:lhsmtool_posix.0 Request processed in 91us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785241.502220:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:0.0:1789785241.511899:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785241.513106:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530132736 00000100:00100000:2.0:1789785241.513123:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530132736 00000100:00100000:2.0:1789785241.513233:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 42 00000100:00100000:2.0:1789785241.513246:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+7:11080:x1876725530132736:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789785241.513273:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785241.513300:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09a00/0x2f18ee3fd845c5a7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8640 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.513458:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c5ae lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.513476:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c5ae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.513491:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c5ae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.513896:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c5b5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.513920:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c5b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.513933:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c5b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.514954:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08200/0x2f18ee3fd845c5bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.514970:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08200/0x2f18ee3fd845c5bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.514980:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08200/0x2f18ee3fd845c5bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789785241.514994:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789785241.515102:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c5ae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.515301:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c5ae lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.515313:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c5ae lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.515319:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785241.515323:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c5ae lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.515331:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c5ae lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.515368:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dae827c0300) 00010000:00010000:2.0:1789785241.515372:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785241.515377:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c5ae lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.515397:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c5ae lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.515414:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c5b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.515420:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c5b5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.515426:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c5b5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.515430:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785241.515433:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c5b5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.515439:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c5b5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.515447:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9daf87d6e200) 00010000:00010000:2.0:1789785241.515449:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785241.515452:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c5b5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.515457:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c5b5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.516434:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09a00/0x2f18ee3fd845c5a7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8640 expref: 10 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.516459:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08200/0x2f18ee3fd845c5bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8640 expref: 9 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785241.516477:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9daf87d6e700) 00010000:00010000:2.0:1789785241.516480:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785241.516483:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b08200, rc 0) 00000100:00100000:2.0:1789785241.516636:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+9:11080:x1876725530132736:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 3391us (4752us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789785241.516646:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 42 00000100:00100000:0.0:1789785241.531066:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785241.534955:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530132864 00000100:00100000:2.0:1789785241.534970:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530132864 00000100:00100000:2.0:1789785241.535044:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 43 00000100:00100000:2.0:1789785241.535419:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+9:11080:x1876725530132864:12345-192.168.203.46@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789785241.535534:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+9:11080:x1876725530132864:12345-192.168.203.46@tcp:59:lhsmtool_posix.0 Request processed in 119us (4484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785241.539063:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 43 00000100:00100000:3.0:1789785241.543979:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785241.544101:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530132992 00000100:00100000:1.0:1789785241.544278:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530132992 00000100:00100000:1.0:1789785241.544410:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 44 00000100:00100000:1.0:1789785241.544424:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+5:11080:x1876725530132992:12345-192.168.203.46@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1789785241.544536:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1789785241.545817:0:11254:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1350us 00000100:00100000:3.0:1789785241.575309:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+5:11080:x1876725530132992:12345-192.168.203.46@tcp:59:lhsmtool_posix.0 Request processed in 30880us (31337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785241.575324:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 44 00010000:00010000:2.0:1789785241.603149:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789785242.437919:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789785242.438198:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789785242.626859:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785243.116125:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785243.116164:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785243.116224:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785243.116262:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530133120 00000100:00100000:1.0:1789785243.116277:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530133120 00000100:00100000:1.0:1789785243.116327:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 380 00000100:00100000:1.0:1789785243.116360:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2399:x1876725530133120:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785243.116431:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2399:x1876725530133120:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 96us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785243.116439:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 380 00000100:00100000:2.0:1789785243.118000:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785243.123168:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530133248 00000100:00100000:3.0:1789785243.123182:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530133248 00000100:00100000:3.0:1789785243.123267:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530133376 00000100:00100000:3.0:1789785243.123271:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530133376 00000100:00100000:3.0:1789785243.123303:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 280 00000100:00100000:3.0:1789785243.123315:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+9:2400:x1876725530133248:12345-192.168.203.46@tcp:400:kworker.0 00000100:00080000:1.0:1789785243.123600:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789785243.123605:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789785243.123810:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+9:2400:x1876725530133248:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 497us (7644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785243.123831:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 280 00000100:00100000:3.0:1789785243.123850:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530133504 00000100:00100000:3.0:1789785243.123853:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530133504 00000100:00100000:3.0:1789785243.123876:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 281 00000100:00100000:3.0:1789785243.123882:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2399:x1876725530133376:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785243.124999:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 282 00000100:00100000:0.0:1789785243.125012:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8445c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2400:x1876725530133504:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785243.129064:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785243.129106:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530133632 00000100:00100000:2.0:1789785243.129116:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530133632 00000100:00100000:2.0:1789785243.129167:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 283 00000100:00100000:2.0:1789785243.129176:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8445c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2399:x1876725530133632:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785243.129263:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8445c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2399:x1876725530133632:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 87us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785243.129271:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 283 00000100:00100000:3.0:1789785243.132780:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2399:x1876725530133376:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 8879us (16536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785243.132795:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 281 00000100:00080000:3.0:1789785243.132831:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789785243.132836:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789785243.138320:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8445c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2400:x1876725530133504:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 13299us (20315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785243.138335:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 282 00010000:00010000:0.0:1789785243.672136:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785243.683801:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785243.683896:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530133760 00000100:00100000:3.0:1789785243.683906:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530133760 00000100:00100000:3.0:1789785243.683993:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 45 00000100:00100000:3.0:1789785243.684004:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8445f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+9:11122:x1876725530133760:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789785243.684022:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785243.684040:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050400/0x2f18ee3fd845c5ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8647 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.684100:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051600/0x2f18ee3fd845c5d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.684115:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051600/0x2f18ee3fd845c5d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.684126:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051600/0x2f18ee3fd845c5d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.684142:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d2000/0x2f18ee3fd845c5d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.684158:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d2000/0x2f18ee3fd845c5d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.684165:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d2000/0x2f18ee3fd845c5d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.684204:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051600/0x2f18ee3fd845c5d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.684211:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051600/0x2f18ee3fd845c5d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.684217:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051600/0x2f18ee3fd845c5d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.684224:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc2051600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785243.684228:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051600/0x2f18ee3fd845c5d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.684236:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051600/0x2f18ee3fd845c5d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.684247:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9daf87d6e400) 00010000:00010000:3.0:1789785243.684250:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785243.684254:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051600/0x2f18ee3fd845c5d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.684260:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051600/0x2f18ee3fd845c5d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.684271:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d2000/0x2f18ee3fd845c5d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.684283:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d2000/0x2f18ee3fd845c5d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.684289:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d2000/0x2f18ee3fd845c5d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.684294:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf829d2000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785243.684296:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d2000/0x2f18ee3fd845c5d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.684302:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d2000/0x2f18ee3fd845c5d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.684310:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9dafc21de200) 00010000:00010000:3.0:1789785243.684312:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785243.684315:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d2000/0x2f18ee3fd845c5d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.684320:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d2000/0x2f18ee3fd845c5d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.684376:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050400/0x2f18ee3fd845c5ca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8647 expref: 10 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.684387:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9daf87d6e400) 00010000:00010000:3.0:1789785243.684389:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785243.684393:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050400/0x2f18ee3fd845c5ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8647 expref: 10 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.684404:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc2050400, rc 0) 00000100:00100000:3.0:1789785243.684481:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8445f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+9:11122:x1876725530133760:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 478us (685us total) trans 0 rc 301/301 00000100:00100000:3.0:1789785243.688889:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 45 00000100:00100000:0.0:1789785243.693853:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785243.694041:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530134016 00000100:00100000:2.0:1789785243.694050:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530134016 00000100:00100000:2.0:1789785243.694103:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 46 00000100:00100000:2.0:1789785243.694113:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+9:11122:x1876725530134016:12345-192.168.203.46@tcp:36:lfs.0 00010000:00010000:2.0:1789785243.694170:0:11254:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785243.694195:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c584 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8632 expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785243.694215:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9daf87d6e400) 00010000:00010000:2.0:1789785243.694225:0:11254:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789785243.694281:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c5df lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785243.694294:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c5df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785243.694304:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c5df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785243.694315:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09000/0x2f18ee3fd845c5e6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785243.694322:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09000/0x2f18ee3fd845c5e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785243.694364:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09000/0x2f18ee3fd845c5e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.695034:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d3800/0x2f18ee3fd845c5ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.695045:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d3800/0x2f18ee3fd845c5ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.695052:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d3800/0x2f18ee3fd845c5ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789785243.695067:0:11254:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003eabe763 reply state 000000005b24d29f transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d3800/0x2f18ee3fd845c5ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.695078:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d3800/0x2f18ee3fd845c5ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.695084:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:3.0:1789785243.695087:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789785243.695089:0:11254:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789785243.695094:0:11254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789785243.695101:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c5df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.695107:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c5df lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.695113:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c5df lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.695118:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785243.695128:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c5df lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.695136:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c5df lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.695144:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dae827bd200) 00010000:00010000:3.0:1789785243.695147:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785243.695150:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c5df lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.695156:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c5df lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789785243.695169:0:11254:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003eabe763 reply state 000000005b24d29f transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09000/0x2f18ee3fd845c5e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.695176:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09000/0x2f18ee3fd845c5e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.695182:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9dae827bd600) 00010000:00010000:3.0:1789785243.695184:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789785243.695186:0:11254:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789785243.695296:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+10:11122:x1876725530134016:12345-192.168.203.46@tcp:36:lfs.0 Request processed in 1183us (1450us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789785243.695304:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 46 00000100:00100000:2.0:1789785243.807001:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785243.807053:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530134144 00000100:00100000:0.0:1789785243.807064:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530134144 00000100:00100000:0.0:1789785243.807122:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 47 00000100:00100000:0.0:1789785243.807133:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8445ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+10:11130:x1876725530134144:12345-192.168.203.46@tcp:101:lctl.0 00010000:00010000:0.0:1789785243.807156:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785243.807177:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845c5f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd864e expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785243.807238:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845c5fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785243.807252:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845c5fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785243.807276:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845c5fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785243.807322:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789785243.807326:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789785243.807380:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845c5fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785243.807406:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845c5f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd864e expref: 12 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785243.807425:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845c5fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd864e expref: 11 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785243.807433:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafbaaba900) 00010000:00010000:0.0:1789785243.807684:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789785243.807690:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf80030c00, rc 0) 00000100:00100000:0.0:1789785243.807752:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8445ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+11:11130:x1876725530134144:12345-192.168.203.46@tcp:101:lctl.0 Request processed in 620us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785243.807760:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 47 00000100:00100000:2.0:1789785243.872179:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785243.872241:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530134272 00000100:00100000:3.0:1789785243.872251:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530134272 00000100:00100000:3.0:1789785243.872309:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 48 00000100:00100000:3.0:1789785243.872318:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8445d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+11:11136:x1876725530134272:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:3.0:1789785243.872372:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785243.872405:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d2000/0x2f18ee3fd845c602 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8655 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.872473:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050400/0x2f18ee3fd845c609 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.872703:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050400/0x2f18ee3fd845c609 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.872717:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050400/0x2f18ee3fd845c609 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.872729:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051600/0x2f18ee3fd845c610 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.872736:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051600/0x2f18ee3fd845c610 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.872743:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051600/0x2f18ee3fd845c610 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.872827:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845c617 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.872835:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845c617 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.872841:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845c617 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785243.872873:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789785243.872877:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789785243.872909:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845c617 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.872924:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050400/0x2f18ee3fd845c609 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.872931:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050400/0x2f18ee3fd845c609 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.872938:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050400/0x2f18ee3fd845c609 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.872943:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc2050400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785243.872947:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050400/0x2f18ee3fd845c609 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.872954:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050400/0x2f18ee3fd845c609 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.872965:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafbaaba900) 00010000:00010000:3.0:1789785243.872968:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785243.872972:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050400/0x2f18ee3fd845c609 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.872977:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2050400/0x2f18ee3fd845c609 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.872990:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051600/0x2f18ee3fd845c610 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.872996:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051600/0x2f18ee3fd845c610 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.873002:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051600/0x2f18ee3fd845c610 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.873010:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc2051600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785243.873014:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051600/0x2f18ee3fd845c610 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.873020:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051600/0x2f18ee3fd845c610 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.873026:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9dae827bd600) 00010000:00010000:3.0:1789785243.873028:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785243.873031:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051600/0x2f18ee3fd845c610 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.873036:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc2051600/0x2f18ee3fd845c610 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.873060:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d2000/0x2f18ee3fd845c602 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8655 expref: 13 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.873072:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845c617 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8655 expref: 12 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.873080:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:3.0:1789785243.873082:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789785243.873084:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bb800, rc 0) 00000100:00100000:3.0:1789785243.873139:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8445d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+12:11136:x1876725530134272:12345-192.168.203.46@tcp:101:bash.0 Request processed in 822us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785243.873146:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 48 00000100:00100000:1.0:1789785243.877049:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785243.877125:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530134528 00000100:00100000:3.0:1789785243.877147:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530134528 00000100:00100000:3.0:1789785243.877210:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 49 00000100:00100000:3.0:1789785243.877220:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+12:11136:x1876725530134528:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:3.0:1789785243.877240:0:11254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785243.877258:0:11254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845c61e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd865c expref: -99 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.877382:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb400/0x2f18ee3fd845c625 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.877396:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb400/0x2f18ee3fd845c625 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.877407:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb400/0x2f18ee3fd845c625 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.877683:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845c62c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.877693:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845c62c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.877701:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845c62c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789785243.877985:0:11254:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1789785243.878100:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845c633 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.878109:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845c633 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.878129:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845c633 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.878173:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb400/0x2f18ee3fd845c625 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.878180:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb400/0x2f18ee3fd845c625 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.878186:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb400/0x2f18ee3fd845c625 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.878192:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bb400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785243.878197:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb400/0x2f18ee3fd845c625 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.878203:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb400/0x2f18ee3fd845c625 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.878214:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:3.0:1789785243.878217:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785243.878221:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb400/0x2f18ee3fd845c625 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.878227:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb400/0x2f18ee3fd845c625 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789785243.878240:0:11254:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d03f1095 reply state 00000000b64fc603 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845c62c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.878249:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845c62c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.878261:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dafc21de200) 00010000:00010000:3.0:1789785243.878263:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789785243.878266:0:11254:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789785243.878293:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845c61e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd865c expref: 15 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.878307:0:11254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845c633 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd865c expref: 14 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.878315:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dafc21def00) 00010000:00010000:3.0:1789785243.878318:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789785243.878321:0:11254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814ba000, rc 0) 00000100:00100000:3.0:1789785243.878796:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+15:11136:x1876725530134528:12345-192.168.203.46@tcp:101:bash.0 Request processed in 1576us (1756us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789785243.878805:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 49 00000100:00100000:2.0:1789785243.883771:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785243.883856:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530134656 00000100:00100000:3.0:1789785243.883865:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530134656 00000100:00100000:3.0:1789785243.883939:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 28 00000100:00100000:3.0:1789785243.883947:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8445e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2396:x1876725530134656:12345-192.168.203.46@tcp:8:bash.0 00010000:00080000:3.0:1789785243.883980:0:8451:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp t0 exp 0000000000000000 cur 352 last 0 00000020:00000080:3.0:1789785243.884009:0:8451:0:(genops.c:1385:class_connect()) connect: client 026b2112-ee35-499c-8d01-18663664f08e, cookie 0x2f18ee3fd845c641 00002000:00100000:3.0:1789785243.884021:0:8451:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 026b2112-ee35-499c-8d01-18663664f08e/ffff9dae83bd9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789785243.884038:0:8451:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789785243.884110:0:8451:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789785243.884136:0:8451:0:(import.c:65:import_set_state_nolock()) ffff9dae83bda800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789785243.884222:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8445e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+6:2396:x1876725530134656:12345-192.168.203.46@tcp:8:bash.0 Request processed in 274us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785243.884229:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 28 00000100:00100000:1.0:1789785243.887242:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785243.887365:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530134784 00000100:00100000:3.0:1789785243.887375:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530134784 00000100:00100000:3.0:1789785243.887437:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 29 00000100:00100000:3.0:1789785243.887447:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+6:0:x1876725530134784:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:3.0:1789785243.887463:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785243.887493:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845c648 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8663 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789785243.887517:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789785243.887533:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=352s v=(0 0) 00010000:00010000:3.0:1789785243.887537:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785243.887546:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845c648 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8663 expref: 7 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.887568:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845c648 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8663 expref: 7 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.887589:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bb000, rc 0) 00000100:00100000:3.0:1789785243.887818:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+7:0:x1876725530134784:12345-192.168.203.46@tcp:101:bash.0 Request processed in 371us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785243.887826:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 29 00000100:00080000:1.0:1789785243.889796:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789785243.890500:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785243.890567:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530134912 00000100:00100000:3.0:1789785243.890583:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530134912 00000100:00100000:3.0:1789785243.890636:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 30 00000100:00100000:3.0:1789785243.890659:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf987ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+7:11136:x1876725530134912:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:3.0:1789785243.890677:0:8805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785243.890692:0:8805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845c64f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd866a expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.890721:0:8805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845c648 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8663 expref: 8 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.890730:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785243.890734:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785243.890739:0:8805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845c64f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd866a expref: 8 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.890778:0:8805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845c648 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8663 expref: 8 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.890792:0:8805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845c648 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8663 expref: 8 pid: 8450 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785243.890805:0:8805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8805:1876725549102848:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789785243.890885:0:8805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf9a85b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789785243.894029:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785243.894114:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530135040 00000100:00100000:1.0:1789785243.894123:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530135040 00010000:00010000:1.0:1789785243.894168:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845c648 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8663 expref: 9 pid: 8450 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785243.894206:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 52 00000100:00100000:1.0:1789785243.894215:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:026b2112-ee35-499c-8d01-18663664f08e+9:2398:x1876725530135040:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789785243.894228:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785243.894260:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845c648 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8663 expref: 9 pid: 8450 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785243.894273:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845c648 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8663 expref: 9 pid: 8450 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785243.894299:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789785243.894303:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789785243.894312:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845c64f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd866a expref: 9 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785243.894323:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845c64f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd866a expref: 9 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785243.894401:0:6519:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845c64f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd866a expref: 9 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785243.894416:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987ff480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1876725549102976:192.168.203.46@tcp:105: 00000100:00100000:1.0:1789785243.894486:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf82d5d540 going to sleep for 11 seconds 00010000:00010000:3.0:1789785243.895301:0:8805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845c648 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8663 expref: 9 pid: 8450 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785243.895320:0:8805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8805:1876725549102848:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785243.895408:0:8805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845c64f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd866a expref: 8 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785243.895421:0:8805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bb400, rc 0) 00000100:00100000:3.0:1789785243.895457:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf987ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+8:11136:x1876725530134912:12345-192.168.203.46@tcp:101:bash.0 Request processed in 4800us (4963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785243.895466:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 30 00000100:00100000:1.0:1789785243.897755:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987ff480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1876725549102976:192.168.203.46@tcp:105: 00010000:00010000:1.0:1789785243.897790:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785243.897840:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:026b2112-ee35-499c-8d01-18663664f08e+7:2398:x1876725530135040:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 3626us (3820us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785243.897852:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 52 00000100:00100000:1.0:1789785243.902777:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785243.902864:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530135296 00000100:00100000:2.0:1789785243.902874:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530135296 00000100:00100000:2.0:1789785243.902934:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00100000:2.0:1789785243.902944:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf987ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+15:11136:x1876725530135296:12345-192.168.203.46@tcp:35:bash.0 00000100:00100000:2.0:1789785243.903213:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf987ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+16:11136:x1876725530135296:12345-192.168.203.46@tcp:35:bash.0 Request processed in 269us (453us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789785243.903222:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00100000:2.0:1789785243.992325:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785243.992547:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530135552 00000100:00100000:0.0:1789785243.992557:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530135552 00000100:00100000:0.0:1789785243.992618:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 50 00000100:00100000:0.0:1789785243.992628:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8445f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+16:11146:x1876725530135552:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:0.0:1789785243.992651:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785243.992671:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845c656 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8671 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785243.992795:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789785243.992888:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845c656 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8671 expref: 18 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785243.992903:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafbaaba900) 00010000:00010000:0.0:1789785243.992906:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789785243.992912:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845c656 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8671 expref: 18 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785243.992927:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf80031a00, rc 0) 00000100:00100000:0.0:1789785243.992985:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8445f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+17:11146:x1876725530135552:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 358us (669us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1789785243.992993:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 50 00000100:00100000:3.0:1789785243.996265:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785243.996371:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530135808 00000100:00100000:2.0:1789785243.996381:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530135808 00000100:00100000:2.0:1789785243.996430:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:2.0:1789785243.996441:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8393f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+17:11146:x1876725530135808:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:2.0:1789785243.996653:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8393f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+18:11146:x1876725530135808:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 213us (397us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789785243.996662:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:1.0:1789785244.084820:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785244.084979:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530135936 00000100:00100000:3.0:1789785244.084988:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530135936 00000100:00100000:3.0:1789785244.085051:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 51 00000100:00100000:3.0:1789785244.085060:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf987fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+18:11152:x1876725530135936:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789785244.085087:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785244.085105:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845c664 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8678 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785244.085461:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845c66b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785244.085476:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845c66b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785244.085486:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845c66b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785244.085527:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789785244.085531:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789785244.085549:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845c66b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785244.085585:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845c664 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8678 expref: 20 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785244.085606:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845c66b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8678 expref: 19 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785244.085614:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:3.0:1789785244.085617:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789785244.085631:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814ba200, rc 0) 00000100:00100000:3.0:1789785244.085743:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf987fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+19:11152:x1876725530135936:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 684us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785244.085752:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 51 00000100:00100000:1.0:1789785244.101564:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785244.101773:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530136192 00000100:00100000:2.0:1789785244.101783:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530136192 00000100:00100000:2.0:1789785244.102804:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 52 00000100:00100000:2.0:1789785244.102820:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf987fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+19:11152:x1876725530136192:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:2.0:1789785244.102855:0:7896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785244.102875:0:7896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09a00/0x2f18ee3fd845c672 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd867f expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.102989:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c679 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.103005:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c679 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.103017:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c679 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789785244.103029:0:7896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789785244.103152:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09a00/0x2f18ee3fd845c672 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd867f expref: 22 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.103170:0:7896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c679 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd867f expref: 21 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.103179:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dafc21def00) 00010000:00010000:2.0:1789785244.103183:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789785244.103186:0:7896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b08a00, rc 0) 00000100:00100000:2.0:1789785244.103249:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf987fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+21:11152:x1876725530136192:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 434us (1693us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789785244.103255:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 52 00000100:00100000:2.0:1789785244.111239:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785244.111316:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785244.111648:0:7484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530136576 00000100:00100000:0.0:1789785244.111664:0:7484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530136576 00000100:00100000:0.0:1789785244.111750:0:7484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 3 00000100:00100000:0.0:1789785244.111774:0:7484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8445d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+21:2400:x1876725530136576:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789785244.111791:0:7484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789785244.111802:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530136448 00000100:00100000:3.0:1789785244.111813:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530136448 00010000:00010000:0.0:1789785244.111820:0:7484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c679 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd867f expref: 22 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.111843:0:7484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dafc21def00) 00010000:00010000:0.0:1789785244.111848:0:7484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785244.111891:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 53 00000100:00100000:3.0:1789785244.111904:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8445f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+21:11152:x1876725530136448:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789785244.111934:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785244.111959:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845c687 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8686 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785244.111983:0:7484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8445d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+22:2400:x1876725530136576:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 221us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785244.112008:0:7484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 3 00010000:00010000:3.0:1789785244.112101:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845c68e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785244.112121:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845c68e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785244.112135:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845c68e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785244.112182:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789785244.112538:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845c687 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8686 expref: 23 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.112570:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845c68e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8686 expref: 22 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.112579:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dafc21def00) 00010000:00010000:1.0:1789785244.112581:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789785244.112584:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814ba400, rc 0) 00000100:00100000:1.0:1789785244.118307:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8445f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+22:11152:x1876725530136448:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 6395us (7073us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789785244.118318:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 53 00000100:00100000:2.0:1789785244.128209:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785244.128433:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530136704 00000100:00100000:3.0:1789785244.128443:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530136704 00000100:00100000:3.0:1789785244.128541:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 31 00000100:00100000:3.0:1789785244.128551:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8445c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+7:2397:x1876725530136704:12345-192.168.203.46@tcp:1:lfs.0 00010000:00010000:3.0:1789785244.128590:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845c69c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785244.128610:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845c64f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd866a expref: 7 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785244.128619:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785244.128623:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789785244.128628:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845c69c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785244.128662:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845c64f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd866a expref: 7 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785244.128805:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845c64f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd866a expref: 7 pid: 8805 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785244.128820:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8450:1876725549103104:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789785244.128916:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf9a85b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785244.138525:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8450:1876725549103104:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785244.138571:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845c69c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785244.139106:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785244.139450:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530136832 00000100:00100000:3.0:1789785244.139458:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530136832 00002000:00100000:3.0:1789785244.139555:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9daf82c80a80 x1876725530136832/t0(0) o4->026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp:375/0 lens 504/0 e 0 to 0 dl 1789785255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789785244.139566:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9daf82c80a80 with x1876725530136832 ext(0->12) 00010000:00010000:3.0:1789785244.139574:0:8455:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845c64f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd866a expref: 8 pid: 8805 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785244.139588:0:8455:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845c64f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd866a expref: 8 pid: 8805 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789785244.139596:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9daf82c80a80 00000100:00100000:3.0:1789785244.139627:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 0 00000100:00100000:3.0:1789785244.139636:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:026b2112-ee35-499c-8d01-18663664f08e+8:2398:x1876725530136832:12345-192.168.203.46@tcp:4:lfs.0 00000001:00100000:3.0:1789785244.141933:0:9529:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 026b2112-ee35-499c-8d01-18663664f08e 00000100:00100000:0.0:1789785244.142931:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:026b2112-ee35-499c-8d01-18663664f08e+9:2398:x1876725530136832:12345-192.168.203.46@tcp:4:lfs.0 Request processed in 3288us (3820us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789785244.142948:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 0 00002000:00100000:0.0:1789785244.142959:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9daf82c80a80 x1876725530136832/t4294967300(0) o4->026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp:375/0 lens 504/448 e 0 to 0 dl 1789785255 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789785244.142970:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9daf82c80a80 with x1876725530136832 ext(0->12) 00010000:00010000:0.0:1789785244.142980:0:8455:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845c64f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd866a expref: 9 pid: 8805 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.142998:0:8455:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845c64f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd866a expref: 9 pid: 8805 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789785244.143006:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9daf82c80a80 00000100:00100000:2.0:1789785244.146404:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785244.146504:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530136960 00000100:00100000:1.0:1789785244.146513:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530136960 00010000:00010000:1.0:1789785244.146549:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845c64f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd866a expref: 9 pid: 8805 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785244.146580:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 53 00000100:00100000:1.0:1789785244.146589:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8445ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+9:2397:x1876725530136960:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789785244.146604:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789785244.146622:0:6518:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789785244.146625:0:6518:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789785242 00002000:00010000:1.0:1789785244.146627:0:6518:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789785243 00002000:00010000:1.0:1789785244.146629:0:6518:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789785242 00002000:00010000:1.0:1789785244.146631:0:6518:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789785244.146637:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845c64f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd866a expref: 9 pid: 8805 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.146662:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845c64f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd866a expref: 9 pid: 8805 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.146684:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845c64f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd866a expref: 9 pid: 8805 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.146702:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789785244.146706:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789785244.146711:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845c69c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.146719:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845c69c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.146750:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785244.146815:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8445ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+8:2397:x1876725530136960:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 226us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785244.146823:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 53 00010000:00010000:2.0:1789785244.147245:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845c69c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.147256:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845c69c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.147276:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845c69c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.147285:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845c69c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.147294:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845c69c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.147302:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bbe00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:2.0:1789785244.147307:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845c69c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.147316:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845c69c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.147331:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845c69c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.147374:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845c69c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785244.147440:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8445c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+7:2397:x1876725530136704:12345-192.168.203.46@tcp:1:lfs.0 Request processed in 18888us (19238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785244.147448:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 31 00000100:00100000:2.0:1789785244.152295:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785244.152381:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530137216 00000100:00100000:1.0:1789785244.152391:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530137216 00000100:00100000:1.0:1789785244.152457:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 8 00000100:00100000:1.0:1789785244.152467:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8445ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+22:11152:x1876725530137216:12345-192.168.203.46@tcp:35:lfs.0 00000004:00010000:1.0:1789785244.152538:0:6537:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845c68e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8686 expref: 22 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789785244.154694:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1789785244.154813:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1789785244.155103:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1789785244.155147:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c6a3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.155802:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845c633 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd865c expref: 26 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.155814:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c6a3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.155869:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845c633 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd865c expref: 26 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.155884:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845c633 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd865c expref: 26 pid: 11254 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785244.155899:0:6537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c81f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6537:1876725549103232:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789785244.155983:0:6537:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1ae3840 going to sleep for 11 seconds 00000100:00100000:1.0:1789785244.161003:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785244.161078:0:7484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530137344 00000100:00100000:2.0:1789785244.161087:0:7484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530137344 00010000:00010000:2.0:1789785244.161123:0:7484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845c633 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd865c expref: 27 pid: 11254 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785244.161170:0:7484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 54 00000100:00100000:2.0:1789785244.161179:0:7484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf987fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+27:2398:x1876725530137344:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789785244.161194:0:7484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785244.161200:0:7484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845c633 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd865c expref: 27 pid: 11254 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.161213:0:7484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845c633 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd865c expref: 27 pid: 11254 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.161244:0:7484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dafc21def00) 00010000:00010000:2.0:1789785244.161249:0:7484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c6a3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.161258:0:7484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c6a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.161267:0:7484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c6a3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.161297:0:7484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785244.161375:0:7484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf987fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+27:2398:x1876725530137344:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 196us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785244.161383:0:7484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 54 00010000:00010000:0.0:1789785244.161633:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845c633 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd865c expref: 26 pid: 11254 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785244.161653:0:6537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c81f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6537:1876725549103232:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789785244.161674:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c6a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.161682:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c6a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.161688:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c6a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789785244.161795:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1789785244.161901:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1789785244.161979:0:6537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c81f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1876725549103360:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789785244.162023:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785244.162061:0:6537:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1ae3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789785244.162427:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549103360 00000100:00100000:2.0:1789785244.162434:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549103360 00000100:00100000:2.0:1789785244.162499:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789785244.162508:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6537:x1876725549103360:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789785244.162594:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6537:x1876725549103360:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 87us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785244.162601:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789785244.162637:0:6537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c81f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1876725549103360:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789785244.162785:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1789785244.162830:0:6537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8445dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1876725549103488:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789785244.162858:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785244.162873:0:6537:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785244.163187:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549103488 00000100:00100000:3.0:1789785244.163192:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549103488 00000100:00100000:3.0:1789785244.163235:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789785244.163243:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8445e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6537:x1876725549103488:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789785244.163378:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8445e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6537:x1876725549103488:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 136us (519us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789785244.163386:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:3.0:1789785244.163416:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789785244.163621:0:6537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8445dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1876725549103488:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789785244.163665:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1789785244.163697:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c6a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.163707:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c6a3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.163715:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c6a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.163720:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf80030800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785244.163725:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c6a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.163733:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c6a3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.163747:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dafc21def00) 00010000:00010000:1.0:1789785244.163750:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789785244.163754:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c6a3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.163773:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c6a3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789785244.163863:0:6537:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789785244.163918:0:6537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789785244.163937:0:6537:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 352417597693ns, next at 353417595954ns, rc = 0 00000001:00080000:1.0:1789785244.163943:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1789785244.163967:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dafc21def00) 00010000:00010000:1.0:1789785244.163971:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789785244.163977:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845c68e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8686 expref: 30 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785244.164077:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8445ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+29:11152:x1876725530137216:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 11610us (11790us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1789785244.164086:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 8 00000020:00080000:1.0:1789785244.164090:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789785244.170777:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785244.171031:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530137472 00000100:00100000:3.0:1789785244.171040:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530137472 00000100:00100000:3.0:1789785244.171095:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 54 00000100:00100000:3.0:1789785244.171106:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf987ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+29:11152:x1876725530137472:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789785244.171129:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785244.171160:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845c6aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd868d expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785244.171216:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845c6aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd868d expref: 30 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785244.171242:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845c6aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd868d expref: 30 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785244.171260:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:3.0:1789785244.171263:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789785244.171267:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bb600, rc 0) 00000100:00100000:3.0:1789785244.171327:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf987ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+30:11152:x1876725530137472:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 224us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785244.171334:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 54 00000100:00100000:3.0:1789785244.174979:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785244.175120:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530137728 00000100:00100000:0.0:1789785244.175142:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530137728 00000100:00100000:0.0:1789785244.175203:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00100000:0.0:1789785244.175214:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf88773450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+30:11152:x1876725530137728:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:0.0:1789785244.175472:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf88773450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+31:11152:x1876725530137728:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 259us (501us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1789785244.175492:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00100000:1.0:1789785244.280804:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785244.280930:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530137984 00000100:00100000:2.0:1789785244.280944:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530137984 00000100:00100000:2.0:1789785244.281034:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 55 00000100:00100000:2.0:1789785244.281047:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf987fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+31:11162:x1876725530137984:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:2.0:1789785244.281082:0:7896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785244.281110:0:7896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c6b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8694 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789785244.281411:0:7896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789785244.281674:0:7896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c6b1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8694 expref: 33 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.281693:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafbaaba900) 00010000:00010000:2.0:1789785244.281696:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789785244.281703:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c6b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8694 expref: 33 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.281723:0:7896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b08a00, rc 0) 00000100:00100000:2.0:1789785244.281827:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf987fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+32:11162:x1876725530137984:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 782us (1038us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1789785244.281836:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 55 00000100:00100000:2.0:1789785244.284757:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785244.285132:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530138112 00000100:00100000:1.0:1789785244.285145:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530138112 00000100:00100000:1.0:1789785244.285272:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 56 00000100:00100000:1.0:1789785244.285284:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8445fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+32:11162:x1876725530138112:12345-192.168.203.46@tcp:34:lfs.0 00010000:00010000:1.0:1789785244.285415:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c6bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285438:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c6bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285452:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c6bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285464:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c6c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285471:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c6c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285508:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c6c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285606:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c6cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285615:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c6cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285622:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c6cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789785244.285685:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c6cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285702:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c6bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285710:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c6bf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285718:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c6bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285724:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785244.285729:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c6bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285737:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c6bf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285752:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:1.0:1789785244.285772:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785244.285779:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c6bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285786:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c6bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285801:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c6c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285807:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c6c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285813:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c6c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285818:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a64000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785244.285820:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c6c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285826:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c6c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285834:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dafc21de200) 00010000:00010000:1.0:1789785244.285836:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785244.285839:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c6c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285844:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c6c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285855:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c6cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285866:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c6cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285871:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c6cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285877:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a64200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785244.285880:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c6cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285886:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c6cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285894:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:1.0:1789785244.285896:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785244.285899:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c6cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.285905:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c6cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785244.286000:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8445fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+32:11162:x1876725530138112:12345-192.168.203.46@tcp:34:lfs.0 Request processed in 717us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785244.286009:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 56 00000100:00100000:3.0:1789785244.288588:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785244.288775:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530138368 00000100:00100000:0.0:1789785244.288788:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530138368 00000100:00100000:0.0:1789785244.288857:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:0.0:1789785244.288870:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+32:11162:x1876725530138368:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:0.0:1789785244.289183:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+33:11162:x1876725530138368:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 314us (607us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789785244.289192:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:2.0:1789785244.338834:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785244.339035:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530138624 00000100:00100000:0.0:1789785244.339048:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530138624 00000100:00100000:0.0:1789785244.339124:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 57 00000100:00100000:0.0:1789785244.339136:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8445ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+33:11165:x1876725530138624:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:0.0:1789785244.339177:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785244.339203:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845c6d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd869b expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.339304:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c6db lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.339323:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c6db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.339371:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c6db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.339405:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845c6e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.339414:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845c6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.339422:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845c6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.339569:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845c6e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.339578:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845c6e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.339585:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845c6e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785244.339596:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789785244.339701:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c6db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.339710:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c6db lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.339717:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c6db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.339723:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf80030800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785244.339741:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c6db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.339770:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c6db lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.339785:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:0.0:1789785244.339789:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785244.339794:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c6db lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.339800:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c6db lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.339818:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845c6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.339825:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845c6e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.339831:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845c6e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.339837:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf80030600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785244.339840:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845c6e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.339847:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845c6e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.339854:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dafc21de200) 00010000:00010000:0.0:1789785244.339857:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785244.339860:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845c6e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.339876:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845c6e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.339923:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845c6d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd869b expref: 36 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.339939:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845c6e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd869b expref: 35 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.344220:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:0.0:1789785244.344229:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789785244.344234:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf80031a00, rc 0) 00000100:00100000:0.0:1789785244.344333:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8445ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+35:11165:x1876725530138624:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 5192us (5510us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1789785244.344358:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 57 00000100:00100000:2.0:1789785244.351653:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785244.351783:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530138752 00000100:00100000:0.0:1789785244.351796:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530138752 00000100:00100000:0.0:1789785244.351877:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 58 00000100:00100000:0.0:1789785244.351889:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8445df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+35:11165:x1876725530138752:12345-192.168.203.46@tcp:54:lfs.0 00010000:00010000:0.0:1789785244.351994:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845c6f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.352016:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845c6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.352030:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845c6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.352099:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845c6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.352108:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845c6f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.352116:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845c6f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.352123:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf80030e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785244.352128:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845c6f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.352137:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845c6f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.352151:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:0.0:1789785244.352154:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789785244.352160:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845c6f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.352167:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845c6f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785244.352260:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8445df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+35:11165:x1876725530138752:12345-192.168.203.46@tcp:54:lfs.0 Request processed in 371us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785244.352273:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 58 00000100:00100000:0.0:1789785244.355058:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785244.355191:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530139008 00000100:00100000:2.0:1789785244.355204:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530139008 00000100:00100000:2.0:1789785244.355270:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:2.0:1789785244.355282:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+35:11165:x1876725530139008:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:2.0:1789785244.355627:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+36:11165:x1876725530139008:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 345us (583us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789785244.355636:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:3.0:1789785244.482680:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789785244.482710:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549103616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789785244.482815:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785244.482893:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549103616 00000100:00100000:3.0:1789785244.482903:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549103616 00000100:00100000:3.0:1789785244.482973:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789785244.482983:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549103616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789785244.483039:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789785244.483094:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549103616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785244.483103:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000040:00080000:0.0:1789785244.483137:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789785244.483430:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549103616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789785244.483811:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789785244.483827:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549103744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789785244.483876:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785244.483923:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549103744 00000100:00100000:1.0:1789785244.483929:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549103744 00000100:00100000:1.0:1789785244.483972:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789785244.483995:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf987fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1876725549103744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789785244.484015:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785244.484058:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf987fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1876725549103744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785244.484065:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789785244.484110:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549103744:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1789785244.485311:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789785244.485719:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789785244.485749:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549103872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789785244.485823:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785244.486289:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725549104128:0@lo:400:kworker.0 00000100:00100000:3.0:1789785244.486329:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785244.486379:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725549104640:0@lo:400:kworker.0 00000100:00100000:3.0:1789785244.486404:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785244.486423:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549105152:0@lo:400:kworker.0 00000100:00100000:3.0:1789785244.486460:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785244.486558:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876725549104384:0@lo:400:kworker.0 00000100:00100000:2.0:1789785244.486594:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785244.486616:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549104896:0@lo:400:kworker.0 00000100:00100000:3.0:1789785244.486669:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789785244.486670:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785244.486680:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549104256:0@lo:400:kworker.0 00000100:00100000:2.0:1789785244.486711:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789785244.486717:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785244.486721:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549104000:0@lo:400:kworker.0 00000100:00100000:3.0:1789785244.486743:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549104768:0@lo:400:kworker.0 00000100:00100000:2.0:1789785244.486770:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785244.486786:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785244.486805:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549104512:0@lo:400:kworker.0 00000100:00100000:3.0:1789785244.486827:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549104896 00000100:00100000:3.0:1789785244.486835:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549104896 00000100:00100000:2.0:1789785244.486849:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785244.486877:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549105024:0@lo:400:kworker.0 00000100:00100000:3.0:1789785244.486898:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549104768 00000100:00100000:3.0:1789785244.486902:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549104768 00000100:00100000:2.0:1789785244.486907:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785244.486939:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789785244.486942:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549104000 00000100:00100000:2.0:1789785244.486948:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549104000 00000100:00100000:3.0:1789785244.486952:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8445ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549104896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785244.486986:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1789785244.486996:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:3659:x1876725549104000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785244.487109:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789785244.487119:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549104768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785244.487190:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549103872 00000100:00100000:1.0:1789785244.487196:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549103872 00000100:00100000:1.0:1789785244.487233:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789785244.487241:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549103872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789785244.487260:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785244.487474:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:3659:x1876725549104000:12345-0@lo:400:kworker.0 Request processed in 479us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785244.487483:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1789785244.487519:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549104256 00000100:00100000:2.0:1789785244.487523:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549104256 00000100:00100000:2.0:1789785244.487550:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789785244.487557:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549104256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785244.487598:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549104256:12345-0@lo:400:kworker.0 Request processed in 41us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785244.487604:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789785244.487646:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549104000:0@lo:400:kworker.0 00000100:00100000:2.0:1789785244.487706:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549104256:0@lo:400:kworker.0 00000100:00100000:2.0:1789785244.487734:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549104128 00000100:00100000:2.0:1789785244.487747:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549104128 00000100:00100000:2.0:1789785244.487777:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549104640 00000100:00100000:2.0:1789785244.487779:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549104640 00000100:00100000:2.0:1789785244.487798:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549105152 00000100:00100000:2.0:1789785244.487800:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549105152 00000100:00100000:2.0:1789785244.487810:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549104384 00000100:00100000:2.0:1789785244.487812:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549104384 00000100:00100000:2.0:1789785244.487821:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549104512 00000100:00100000:2.0:1789785244.487823:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549104512 00000100:00100000:2.0:1789785244.487836:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549105024 00000100:00100000:2.0:1789785244.487837:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549105024 00000100:00100000:2.0:1789785244.487849:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789785244.487854:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725549104128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785244.487889:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725549104128:12345-0@lo:400:kworker.0 Request processed in 35us (1560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785244.487895:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789785244.487905:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789785244.487910:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725549104640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785244.487934:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725549104640:12345-0@lo:400:kworker.0 Request processed in 24us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785244.487939:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789785244.487948:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789785244.487952:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549105152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785244.487974:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549105152:12345-0@lo:400:kworker.0 Request processed in 22us (1514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785244.487979:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789785244.487987:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789785244.487991:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8445d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876725549104384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785244.488045:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8445d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876725549104384:12345-0@lo:400:kworker.0 Request processed in 52us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785244.488051:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789785244.488064:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789785244.488070:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf85536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549104512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785244.488096:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf85536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549104512:12345-0@lo:400:kworker.0 Request processed in 27us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785244.488101:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789785244.488112:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789785244.488118:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf85536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549105024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785244.488145:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf85536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549105024:12345-0@lo:400:kworker.0 Request processed in 28us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785244.488151:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789785244.488177:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549104512:0@lo:400:kworker.0 00000100:00100000:2.0:1789785244.488187:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549105024:0@lo:400:kworker.0 00000100:00100000:2.0:1789785244.488196:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876725549104384:0@lo:400:kworker.0 00000100:00100000:2.0:1789785244.488223:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725549104128:0@lo:400:kworker.0 00010000:00080000:2.0:1789785244.488237:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf50f800 x1876725549104640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785244.488247:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725549104640:0@lo:400:kworker.0 00010000:00080000:2.0:1789785244.488255:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf50ea00 x1876725549105152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785244.488274:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549105152:0@lo:400:kworker.0 00000100:00080000:2.0:1789785244.488331:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789785244.488360:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789785244.488363:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789785244.488366:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789785244.492434:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549104768:12345-0@lo:400:kworker.0 Request processed in 5301us (5633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785244.492466:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789785244.492576:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549104768:0@lo:400:kworker.0 00000100:00100000:1.0:1789785244.494900:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549103872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7644us (9060us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785244.494918:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789785244.496134:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8445ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549104896:12345-0@lo:400:kworker.0 Request processed in 9177us (9455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785244.496677:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789785244.496974:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549104896:0@lo:400:kworker.0 00000100:00100000:2.0:1789785244.499540:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549103872:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789785244.621860:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785244.622610:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530139264 00000100:00100000:3.0:1789785244.622625:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530139264 00000100:00100000:3.0:1789785244.622705:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 59 00000100:00100000:3.0:1789785244.622717:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf85535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+36:11196:x1876725530139264:12345-192.168.203.46@tcp:101:cat.0 00010000:00010000:3.0:1789785244.622749:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785244.622788:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba800/0x2f18ee3fd845c6fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd86a2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785244.622922:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845c705 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785244.622939:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845c705 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785244.622953:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845c705 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785244.622965:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789785244.623968:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba800/0x2f18ee3fd845c6fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86a2 expref: 39 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.624112:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845c705 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86a2 expref: 38 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.624123:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:2.0:1789785244.624126:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789785244.624130:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bae00, rc 0) 00000100:00100000:2.0:1789785244.624301:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf85535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+38:11196:x1876725530139264:12345-192.168.203.46@tcp:101:cat.0 Request processed in 1585us (2455us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789785244.624311:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 59 00000100:00100000:3.0:1789785244.634775:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785244.634920:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530139392 00000100:00100000:1.0:1789785244.634936:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530139392 00000100:00100000:1.0:1789785244.635029:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 4 00000100:00100000:1.0:1789785244.635041:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+38:2397:x1876725530139392:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789785244.635062:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785244.635095:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845c705 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86a2 expref: 38 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.635126:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:1.0:1789785244.635133:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785244.636408:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+37:2397:x1876725530139392:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 1357us (1645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785244.636423:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 4 00000100:00100000:2.0:1789785244.645223:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785244.645330:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530139648 00000100:00100000:3.0:1789785244.645359:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530139648 00000100:00100000:3.0:1789785244.645421:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00100000:3.0:1789785244.645431:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf85536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+37:11196:x1876725530139648:12345-192.168.203.46@tcp:35:cat.0 00000100:00100000:3.0:1789785244.646180:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf85536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+38:11196:x1876725530139648:12345-192.168.203.46@tcp:35:cat.0 Request processed in 745us (965us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1789785244.646189:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 12 00010000:00010000:2.0:1789785244.675182:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785244.707985:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785244.708505:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530139904 00000100:00100000:1.0:1789785244.708516:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530139904 00000100:00100000:1.0:1789785244.708579:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 60 00000100:00100000:1.0:1789785244.708590:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf85537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+38:11202:x1876725530139904:12345-192.168.203.46@tcp:101:dd.0 00010000:00010000:1.0:1789785244.708615:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785244.708619:0:6535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789785244.708644:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845c66b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8678 expref: 38 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.708669:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:1.0:1789785244.708674:0:6535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789785244.708686:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c713 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd86a9 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.708798:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c71a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.708812:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845c6e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd869b expref: 38 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.708821:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c71a lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.708853:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845c6e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd869b expref: 38 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785244.708884:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845c6e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd869b expref: 38 pid: 6533 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785244.708898:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1876725549105280:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789785244.709000:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84c40900 going to sleep for 11 seconds 00000100:00100000:1.0:1789785244.713040:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1876725549105280:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789785244.713069:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c71a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785244.715296:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785244.715768:0:7484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530140032 00000100:00100000:0.0:1789785244.715778:0:7484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530140032 00010000:00010000:0.0:1789785244.715821:0:7484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845c6e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd869b expref: 39 pid: 6533 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785244.715892:0:7484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 55 00000100:00100000:0.0:1789785244.715903:0:7484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf85534a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+39:2398:x1876725530140032:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789785244.715916:0:7484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785244.715923:0:7484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845c6e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd869b expref: 39 pid: 6533 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.715937:0:7484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845c6e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd869b expref: 39 pid: 6533 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.715961:0:7484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845c6e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd869b expref: 39 pid: 6533 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.715977:0:7484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:0.0:1789785244.715996:0:7484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c71a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.716005:0:7484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c71a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.716013:0:7484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c71a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.716043:0:7484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785244.716099:0:7484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf85534a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+38:2398:x1876725530140032:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 197us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785244.716106:0:7484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 55 00010000:00010000:2.0:1789785244.716160:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c71a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.716168:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c71a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789785244.716202:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789785244.716368:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c713 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86a9 expref: 39 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.716384:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c71a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86a9 expref: 38 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.716390:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:2.0:1789785244.716393:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789785244.716395:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64000, rc 0) 00000100:00100000:2.0:1789785244.716420:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf85537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+38:11202:x1876725530139904:12345-192.168.203.46@tcp:101:dd.0 Request processed in 7833us (8447us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789785244.716427:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 60 00000100:00100000:2.0:1789785244.723276:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785244.723385:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530140160 00000100:00100000:0.0:1789785244.723422:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530140160 00000100:00100000:0.0:1789785244.723474:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 61 00000100:00100000:0.0:1789785244.723490:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf85535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+38:11202:x1876725530140160:12345-192.168.203.46@tcp:101:dd.0 00010000:00010000:0.0:1789785244.723512:0:11254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785244.723530:0:11254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c728 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd86b0 expref: -99 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.723562:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845c72f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.723575:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845c72f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.723586:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845c72f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.723695:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c728 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86b0 expref: 40 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.723718:0:11254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845c72f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86b0 expref: 39 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785244.723727:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:0.0:1789785244.723730:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789785244.723734:0:11254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf80030600, rc 0) 00000100:00100000:0.0:1789785244.723792:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf85535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+39:11202:x1876725530140160:12345-192.168.203.46@tcp:101:dd.0 Request processed in 304us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785244.723799:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 61 00000100:00100000:3.0:1789785244.729930:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785244.730038:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530140416 00000100:00100000:2.0:1789785244.730049:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530140416 00000100:00100000:2.0:1789785244.730110:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 62 00000100:00100000:2.0:1789785244.730121:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+39:11202:x1876725530140416:12345-192.168.203.46@tcp:36:dd.0 00010000:00010000:2.0:1789785244.730410:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845c736 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.730428:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845c736 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.730440:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845c736 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789785244.730484:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1789785244.730515:0:6534:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e1690c6 reply state 00000000fadf0341 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845c736 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.730528:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845c736 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785244.730536:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:2.0:1789785244.730539:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789785244.730542:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789785244.730628:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+42:11202:x1876725530140416:12345-192.168.203.46@tcp:36:dd.0 Request processed in 508us (706us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1789785244.730636:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 62 00000020:00080000:2.0:1789785244.730640:0:6534:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789785245.005610:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785245.005730:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530140544 00000100:00100000:2.0:1789785245.005744:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530140544 00000100:00100000:2.0:1789785245.005856:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 63 00000100:00100000:2.0:1789785245.005879:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf987fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+42:11216:x1876725530140544:12345-192.168.203.46@tcp:101:stat.0 00010000:00010000:2.0:1789785245.005914:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785245.005941:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c73d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd86b7 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789785245.006121:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789785245.006597:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c744 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.006619:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c744 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.006635:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c744 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.006648:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c74b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.006675:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c74b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.006683:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c74b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.006798:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c752 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.006812:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c71a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86a9 expref: 43 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.006821:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c752 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.007220:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c71a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86a9 expref: 43 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.007240:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c71a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86a9 expref: 43 pid: 6535 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785245.007260:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf85535180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1876725549105408:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789785245.007470:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1ae3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789785245.010519:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf85535180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1876725549105408:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789785245.010572:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c752 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785245.011459:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785245.011570:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530140800 00000100:00100000:2.0:1789785245.011580:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530140800 00000100:00100000:2.0:1789785245.011645:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 13 00000100:00100000:2.0:1789785245.011657:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf987fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+44:6637:x1876725530140800:12345-192.168.203.46@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789785245.012269:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf987fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+45:6637:x1876725530140800:12345-192.168.203.46@tcp:35:ldlm_bl.0 Request processed in 610us (813us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1789785245.012299:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 13 00000100:00100000:2.0:1789785245.018444:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785245.018974:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530140928 00000100:00100000:1.0:1789785245.018998:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530140928 00010000:00010000:1.0:1789785245.019106:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c71a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86a9 expref: 45 pid: 6535 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785245.019215:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 56 00000100:00100000:1.0:1789785245.019226:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf85534700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+45:2397:x1876725530140928:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789785245.019245:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785245.019253:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c71a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86a9 expref: 45 pid: 6535 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785245.019289:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c71a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86a9 expref: 45 pid: 6535 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785245.019316:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c71a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86a9 expref: 45 pid: 6535 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785245.019388:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:1.0:1789785245.019396:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c752 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785245.019407:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c752 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785245.019416:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c752 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785245.019447:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789785245.019802:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c752 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.019812:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c752 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789785245.019977:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789785245.019982:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789785245.020311:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c752 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.020328:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c752 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.020549:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c744 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.020557:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c744 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.020972:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c744 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.020979:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b08a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785245.020984:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c744 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.021001:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c744 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785245.021244:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf85534700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+44:2397:x1876725530140928:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 1244us (2039us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785245.021258:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 56 00010000:00010000:2.0:1789785245.021328:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:2.0:1789785245.021331:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785245.021359:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c744 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.021366:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c744 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.021383:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c74b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.021389:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c74b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.021396:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c74b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.021402:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785245.021405:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c74b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.021411:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c74b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.021419:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dafc21de200) 00010000:00010000:2.0:1789785245.021421:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785245.021424:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c74b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.021430:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c74b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.021491:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c73d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86b7 expref: 44 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.021506:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c752 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86b7 expref: 43 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.021514:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:2.0:1789785245.021516:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789785245.021519:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b09600, rc 0) 00000100:00100000:2.0:1789785245.021942:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf987fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+43:11216:x1876725530140544:12345-192.168.203.46@tcp:101:stat.0 Request processed in 16066us (16345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785245.021951:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 63 00000100:00100000:2.0:1789785245.123312:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785245.123472:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530141184 00000100:00100000:0.0:1789785245.123485:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530141184 00000100:00100000:0.0:1789785245.124020:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 64 00000100:00100000:0.0:1789785245.124034:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf85534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+43:11222:x1876725530141184:12345-192.168.203.46@tcp:36:truncate.0 00010000:00010000:0.0:1789785245.124115:0:7896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785245.124150:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c752 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86b7 expref: 43 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.125041:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:0.0:1789785245.125050:0:7896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789785245.125281:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c759 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.125300:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c759 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.125313:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c759 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789785245.125426:0:7896:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:0.0:1789785245.125450:0:7896:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000060ec0458 reply state 00000000b2223c10 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c759 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.125462:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c759 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.125469:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:0.0:1789785245.125471:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789785245.125474:0:7896:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789785245.128189:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf85534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+45:11222:x1876725530141184:12345-192.168.203.46@tcp:36:truncate.0 Request processed in 4140us (4873us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1789785245.128205:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 64 00000020:00080000:0.0:1789785245.128216:0:7896:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789785245.365527:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785245.365804:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530141312 00000100:00100000:0.0:1789785245.365813:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530141312 00000100:00100000:0.0:1789785245.365874:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 65 00000100:00100000:0.0:1789785245.365884:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf987fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+45:11236:x1876725530141312:12345-192.168.203.46@tcp:101:stat.0 00010000:00010000:0.0:1789785245.365907:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785245.365925:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845c760 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd86be expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366081:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845c767 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366097:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845c767 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366109:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845c767 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366128:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845c76e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366136:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845c76e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366155:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845c76e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366225:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c775 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366234:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366241:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785245.366279:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1789785245.366283:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789785245.366305:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366317:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366324:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845c767 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366331:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845c767 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366380:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845c767 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366387:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf80030a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785245.366391:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845c767 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366399:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845c767 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366410:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:0.0:1789785245.366413:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785245.366417:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845c767 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366423:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845c767 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366435:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845c76e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366441:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845c76e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366447:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845c76e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366452:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf80030e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785245.366454:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845c76e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366469:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845c76e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366477:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dafc21de200) 00010000:00010000:0.0:1789785245.366487:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785245.366491:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845c76e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366497:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845c76e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366524:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845c760 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86be expref: 47 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366539:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c775 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86be expref: 46 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.366546:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:0.0:1789785245.366549:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789785245.366551:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eac400, rc 0) 00000100:00100000:0.0:1789785245.366956:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf987fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+46:11236:x1876725530141312:12345-192.168.203.46@tcp:101:stat.0 Request processed in 1071us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785245.366964:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 65 00000100:00100000:3.0:1789785245.481593:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785245.481740:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530141568 00000100:00100000:2.0:1789785245.481766:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530141568 00000100:00100000:2.0:1789785245.481894:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 66 00000100:00100000:2.0:1789785245.481905:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+46:11246:x1876725530141568:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:2.0:1789785245.481925:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785245.481945:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c77c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd86c5 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789785245.482081:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789785245.482191:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c77c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86c5 expref: 48 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.482206:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafbaaba900) 00010000:00010000:2.0:1789785245.482216:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789785245.482221:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c77c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86c5 expref: 48 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.482235:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b09800, rc 0) 00000100:00100000:2.0:1789785245.482303:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+47:11246:x1876725530141568:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 400us (721us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1789785245.482310:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 66 00000100:00100000:3.0:1789785245.488635:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785245.488836:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530141824 00000100:00100000:1.0:1789785245.488850:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530141824 00000100:00100000:1.0:1789785245.488921:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 14 00000100:00100000:1.0:1789785245.488932:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+47:11246:x1876725530141824:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:1.0:1789785245.489269:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+48:11246:x1876725530141824:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 338us (648us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1789785245.489294:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 14 00000100:00100000:1.0:1789785245.555106:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785245.555318:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530142080 00000100:00100000:0.0:1789785245.555332:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530142080 00000100:00100000:0.0:1789785245.555456:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 67 00000100:00100000:0.0:1789785245.555476:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf987ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+48:11252:x1876725530142080:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:0.0:1789785245.555534:0:7896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785245.555561:0:7896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c78a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd86cc expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.555709:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c791 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.555727:0:7896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c775 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86be expref: 49 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.555737:0:7896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c791 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.555790:0:7896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c775 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86be expref: 49 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.555806:0:7896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c775 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86be expref: 49 pid: 6533 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785245.555824:0:7896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7896:1876725549105536:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789785245.555949:0:7896:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385f240 going to sleep for 11 seconds 00000100:00100000:2.0:1789785245.566410:0:7896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7896:1876725549105536:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789785245.566451:0:7896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c791 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785245.573159:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785245.573311:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530142208 00000100:00100000:3.0:1789785245.573324:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530142208 00010000:00010000:3.0:1789785245.573406:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c775 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86be expref: 50 pid: 6533 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785245.573455:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 57 00000100:00100000:3.0:1789785245.573466:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9e9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+50:2397:x1876725530142208:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789785245.573489:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785245.573497:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c775 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86be expref: 50 pid: 6533 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.573513:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c775 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86be expref: 50 pid: 6533 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.573542:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c775 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86be expref: 50 pid: 6533 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.573563:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:3.0:1789785245.573569:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c791 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.573582:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c791 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.573658:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c791 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.573717:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785245.573858:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9e9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+49:2397:x1876725530142208:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 393us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785245.573866:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 57 00010000:00010000:1.0:1789785245.575391:0:7896:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c791 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785245.575411:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c791 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789785245.575442:0:7896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1789785245.575649:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c78a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86cc expref: 50 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785245.575674:0:7896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c791 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86cc expref: 49 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785245.575683:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:1.0:1789785245.575687:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789785245.575691:0:7896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eac800, rc 0) 00000100:00100000:1.0:1789785245.575767:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf987ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+49:11252:x1876725530142080:12345-192.168.203.46@tcp:101:bash.0 Request processed in 20300us (20672us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1789785245.575778:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 67 00000100:00100000:0.0:1789785245.582023:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785245.582625:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530142464 00000100:00100000:2.0:1789785245.582640:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530142464 00000100:00100000:2.0:1789785245.582861:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 68 00000100:00100000:2.0:1789785245.582875:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8393f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+49:11252:x1876725530142464:12345-192.168.203.46@tcp:36:bash.0 00010000:00010000:2.0:1789785245.583322:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c79f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.585296:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c79f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.585329:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c79f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789785245.585491:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1789785245.586730:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c184428 reply state 000000003f46fceb transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c79f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.586787:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c79f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.586798:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:2.0:1789785245.586801:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789785245.586808:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789785245.587665:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8393f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+52:11252:x1876725530142464:12345-192.168.203.46@tcp:36:bash.0 Request processed in 4782us (5646us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1789785245.587680:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 68 00000020:00080000:2.0:1789785245.587688:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789785245.605479:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785245.609240:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530142592 00000100:00100000:1.0:1789785245.609261:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530142592 00000100:00100000:0.0:1789785245.609671:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 69 00000100:00100000:0.0:1789785245.609687:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf85537480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+52:11252:x1876725530142592:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:0.0:1789785245.609733:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785245.609779:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c7a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd86d3 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.609933:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c7ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.609953:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c791 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86cc expref: 53 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.609963:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c7ad lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.610039:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c791 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86cc expref: 53 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.610056:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c791 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86cc expref: 53 pid: 7896 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785245.610073:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf87815180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1876725549105664:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789785245.610481:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385f240 going to sleep for 11 seconds 00000100:00100000:2.0:1789785245.616792:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf87815180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1876725549105664:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789785245.616833:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c7ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785245.617177:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785245.617257:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530142720 00000100:00100000:2.0:1789785245.617266:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530142720 00010000:00010000:2.0:1789785245.617314:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c791 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86cc expref: 54 pid: 7896 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785245.617388:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 58 00000100:00100000:2.0:1789785245.617400:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87814700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:026b2112-ee35-499c-8d01-18663664f08e+54:2398:x1876725530142720:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789785245.617418:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785245.617426:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c791 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86cc expref: 54 pid: 7896 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.617439:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c791 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86cc expref: 54 pid: 7896 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.618076:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c791 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86cc expref: 54 pid: 7896 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.618099:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:2.0:1789785245.618105:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c7ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.618117:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c7ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.618126:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c7ad lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.618172:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785245.618247:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87814700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:026b2112-ee35-499c-8d01-18663664f08e+53:2398:x1876725530142720:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 848us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785245.618256:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 58 00010000:00010000:3.0:1789785245.618679:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c7ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.618689:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c7ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785245.618784:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789785245.618789:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789785245.618818:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c7ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.618856:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c7a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86d3 expref: 53 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.618873:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c7ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86d3 expref: 52 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.618881:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:3.0:1789785245.618884:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789785245.618887:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eace00, rc 0) 00000100:00100000:3.0:1789785245.618919:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf85537480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+52:11252:x1876725530142592:12345-192.168.203.46@tcp:101:bash.0 Request processed in 9237us (13467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785245.618927:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 69 00000100:00100000:1.0:1789785245.627248:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785245.627381:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530142976 00000100:00100000:2.0:1789785245.627394:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530142976 00000100:00100000:2.0:1789785245.627467:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 15 00000100:00100000:2.0:1789785245.627480:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf88773050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+52:11252:x1876725530142976:12345-192.168.203.46@tcp:35:bash.0 00000100:00100000:2.0:1789785245.628649:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf88773050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+53:11252:x1876725530142976:12345-192.168.203.46@tcp:35:bash.0 Request processed in 1162us (1407us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789785245.628663:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 15 00010000:00010000:2.0:1789785245.698864:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785245.703867:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785245.705823:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530143232 00000100:00100000:1.0:1789785245.705844:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530143232 00000100:00100000:1.0:1789785245.706007:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 70 00000100:00100000:1.0:1789785245.706041:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+53:11262:x1876725530143232:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789785245.706080:0:7896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785245.706108:0:7896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c7b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd86da expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789785245.706260:0:7896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789785245.706418:0:7896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c7b4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86da expref: 55 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785245.706435:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafbaaba900) 00010000:00010000:1.0:1789785245.706438:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789785245.706444:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c7b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86da expref: 55 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785245.706459:0:7896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a65c00, rc 0) 00000100:00100000:1.0:1789785245.706553:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+54:11262:x1876725530143232:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 513us (2701us total) trans 4294967347 rc 301/301 00000100:00100000:1.0:1789785245.706561:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 70 00000100:00100000:1.0:1789785245.710456:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785245.710692:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530143360 00000100:00100000:2.0:1789785245.710771:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530143360 00000100:00100000:2.0:1789785245.710915:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 71 00000100:00100000:2.0:1789785245.710930:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf987fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+54:11262:x1876725530143360:12345-192.168.203.46@tcp:34:lfs.0 00010000:00010000:2.0:1789785245.711032:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09a00/0x2f18ee3fd845c7c2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711054:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09a00/0x2f18ee3fd845c7c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711069:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09a00/0x2f18ee3fd845c7c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711084:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c7c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711092:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711099:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711222:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c7d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711233:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c7d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711240:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c7d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789785245.711304:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c7d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711318:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09a00/0x2f18ee3fd845c7c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711333:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09a00/0x2f18ee3fd845c7c2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711380:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09a00/0x2f18ee3fd845c7c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711387:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785245.711393:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09a00/0x2f18ee3fd845c7c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711402:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09a00/0x2f18ee3fd845c7c2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711416:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:2.0:1789785245.711419:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785245.711425:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09a00/0x2f18ee3fd845c7c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711432:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09a00/0x2f18ee3fd845c7c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711449:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711455:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c7c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711461:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c7c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711466:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785245.711475:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c7c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711491:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c7c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711502:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dafc21de200) 00010000:00010000:2.0:1789785245.711504:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785245.711507:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c7c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711513:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c7c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711524:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c7d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711531:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c7d0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711538:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c7d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711543:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785245.711546:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c7d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711551:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c7d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711559:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:2.0:1789785245.711561:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785245.711572:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c7d0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.711578:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c7d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785245.711682:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf987fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+54:11262:x1876725530143360:12345-192.168.203.46@tcp:34:lfs.0 Request processed in 755us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785245.711803:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 71 00000100:00100000:0.0:1789785245.721468:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785245.721579:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530143616 00000100:00100000:3.0:1789785245.721604:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530143616 00000100:00100000:3.0:1789785245.721799:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:3.0:1789785245.721813:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+54:11262:x1876725530143616:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:3.0:1789785245.722193:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+55:11262:x1876725530143616:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 382us (740us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1789785245.722203:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:1.0:1789785245.746133:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785245.746722:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530143872 00000100:00100000:3.0:1789785245.746738:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530143872 00000100:00100000:3.0:1789785245.746865:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 72 00000100:00100000:3.0:1789785245.746878:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf987fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+55:11265:x1876725530143872:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789785245.746915:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785245.746944:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845c7d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd86e1 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.747051:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845c7de lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.747071:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845c7de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.747086:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845c7de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.747100:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845c7e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.747108:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845c7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.747114:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845c7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.749283:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845c7ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.749310:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845c7ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.749326:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845c7ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785245.749354:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789785245.749686:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845c7de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.749695:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845c7de lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.749702:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845c7de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.749709:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814ba600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785245.749714:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845c7de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.749723:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845c7de lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.749739:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:3.0:1789785245.749742:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785245.749747:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845c7de lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.749784:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845c7de lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.749802:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845c7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.749808:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845c7e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.749814:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845c7e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.749819:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bac00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785245.749823:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845c7e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.749830:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845c7e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.749838:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dafc21de200) 00010000:00010000:3.0:1789785245.749841:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785245.749844:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845c7e5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.749850:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845c7e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.749907:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845c7d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86e1 expref: 58 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.749923:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845c7ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86e1 expref: 57 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.749937:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:3.0:1789785245.749939:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789785245.749942:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bb200, rc 0) 00000100:00100000:3.0:1789785245.750029:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf987fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+57:11265:x1876725530143872:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 3152us (3909us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1789785245.750038:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 72 00000100:00100000:1.0:1789785245.753241:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785245.753322:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785245.753555:0:7484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530144128 00000100:00100000:0.0:1789785245.753568:0:7484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530144128 00000100:00100000:0.0:1789785245.753649:0:7484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:0.0:1789785245.753661:0:7484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+57:2398:x1876725530144128:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789785245.753680:0:7484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785245.753711:0:7484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845c7ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86e1 expref: 57 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.753762:0:7484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:0.0:1789785245.753768:0:7484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785245.753869:0:7484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+56:2398:x1876725530144128:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 209us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785245.753878:0:7484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:3.0:1789785245.753997:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530144000 00000100:00100000:3.0:1789785245.754002:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530144000 00000100:00100000:3.0:1789785245.754050:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 73 00000100:00100000:3.0:1789785245.754057:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+56:11265:x1876725530144000:12345-192.168.203.46@tcp:54:lfs.0 00010000:00010000:3.0:1789785245.754129:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c7fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.754155:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c7fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.754168:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c7fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.754211:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c7fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.754218:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c7fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.754223:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c7fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.754229:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814baa00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785245.754241:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c7fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.754250:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c7fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.754259:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:3.0:1789785245.754262:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789785245.754265:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c7fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.754271:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c7fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785245.754307:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+56:11265:x1876725530144000:12345-192.168.203.46@tcp:54:lfs.0 Request processed in 251us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785245.754315:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 73 00000100:00100000:0.0:1789785245.756875:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785245.756962:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530144384 00000100:00100000:3.0:1789785245.756972:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530144384 00000100:00100000:3.0:1789785245.757031:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:3.0:1789785245.757041:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+56:11265:x1876725530144384:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:2.0:1789785245.757856:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+57:11265:x1876725530144384:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 809us (988us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789785245.757868:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:2.0:1789785245.881810:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785245.881933:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530144640 00000100:00100000:0.0:1789785245.881946:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530144640 00000100:00100000:0.0:1789785245.882027:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 74 00000100:00100000:0.0:1789785245.882050:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf85536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+57:11283:x1876725530144640:12345-192.168.203.46@tcp:101:cat.0 00010000:00010000:0.0:1789785245.882084:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785245.882110:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c801 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd86e8 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.882266:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c808 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.882286:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c808 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.882299:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c808 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785245.882313:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789785245.882648:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c801 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86e8 expref: 60 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.882696:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c808 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86e8 expref: 59 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785245.882706:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:0.0:1789785245.882710:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789785245.882714:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eac400, rc 0) 00000100:00100000:0.0:1789785245.882807:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf85536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+59:11283:x1876725530144640:12345-192.168.203.46@tcp:101:cat.0 Request processed in 769us (1011us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1789785245.882816:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 74 00000100:00100000:1.0:1789785245.910425:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785245.910656:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530144768 00000100:00100000:3.0:1789785245.910670:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530144768 00000100:00100000:3.0:1789785245.910762:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 75 00000100:00100000:3.0:1789785245.910776:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+59:11284:x1876725530144768:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789785245.910807:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785245.910833:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c816 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd86ef expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.910949:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845c81d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.910968:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845c81d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.910983:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845c81d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785245.911038:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789785245.911042:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789785245.911067:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845c81d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.911101:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c816 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86ef expref: 61 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.911124:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845c81d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86ef expref: 60 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.911132:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:3.0:1789785245.911135:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789785245.911139:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bba00, rc 0) 00000100:00100000:3.0:1789785245.911217:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+60:11284:x1876725530144768:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 444us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785245.911224:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 75 00000100:00100000:3.0:1789785245.917984:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785245.918603:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530145152 00000100:00100000:2.0:1789785245.918617:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530145152 00000100:00100000:2.0:1789785245.918700:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 18 00000100:00100000:2.0:1789785245.918711:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+60:11284:x1876725530145152:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:2.0:1789785245.919156:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+61:11284:x1876725530145152:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 435us (1188us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1789785245.919166:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 18 00000100:00100000:2.0:1789785245.923493:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785245.923727:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530145280 00000100:00100000:3.0:1789785245.923771:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530145280 00000100:00100000:3.0:1789785245.923864:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00100000:3.0:1789785245.923877:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf85534e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+61:11284:x1876725530145280:12345-192.168.203.46@tcp:103:lfs.0 00010000:00010000:3.0:1789785245.923898:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789785245.923931:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c7ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86d3 expref: 61 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.923958:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c808 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86e8 expref: 60 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.923973:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845c6aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd868d expref: 59 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785245.923987:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:3.0:1789785245.923994:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785245.924082:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf85534e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+58:11284:x1876725530145280:12345-192.168.203.46@tcp:103:lfs.0 Request processed in 208us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785245.924091:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00100000:1.0:1789785245.927857:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785245.927965:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530145408 00000100:00100000:0.0:1789785245.927978:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530145408 00000100:00100000:2.0:1789785245.928166:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 76 00000100:00100000:2.0:1789785245.928181:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+58:11284:x1876725530145408:12345-192.168.203.46@tcp:58:lfs.0 00010000:00010000:2.0:1789785245.928409:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09a00/0x2f18ee3fd845c824 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.928433:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09a00/0x2f18ee3fd845c824 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.928720:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09a00/0x2f18ee3fd845c824 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789785245.929169:0:6533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789785245.929717:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1789785245.929841:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1789785245.930270:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+58:11284:x1876725530145408:12345-192.168.203.46@tcp:58:lfs.0 Request processed in 2085us (2419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785245.930283:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 76 00000100:00100000:0.0:1789785245.955816:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785245.955996:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530145536 00000100:00100000:2.0:1789785245.956009:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530145536 00000100:00100000:2.0:1789785245.956097:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 77 00000100:00100000:2.0:1789785245.956111:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+58:11286:x1876725530145536:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:2.0:1789785245.956302:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785245.956331:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c82b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd86f6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.956702:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c832 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.956722:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c832 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.956735:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c832 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.956759:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c839 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.956793:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c839 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.956800:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c839 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.956917:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845c840 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.956928:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845c840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.956936:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845c840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789785245.956988:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789785245.956993:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789785245.957016:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845c840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.957030:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845c840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.957052:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c832 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.957059:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c832 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.957066:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c832 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.957083:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785245.957088:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c832 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.957096:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c832 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.957111:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:2.0:1789785245.957114:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785245.957119:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c832 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.957126:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09800/0x2f18ee3fd845c832 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.957270:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c839 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.957278:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c839 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.957284:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c839 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.957289:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785245.957291:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c839 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.957297:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c839 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.957315:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dafc21de200) 00010000:00010000:2.0:1789785245.957317:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785245.957320:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c839 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.957326:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09e00/0x2f18ee3fd845c839 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.957950:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845c82b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86f6 expref: 60 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.957969:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845c840 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86f6 expref: 59 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785245.957977:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:2.0:1789785245.957980:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789785245.957983:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d54200, rc 0) 00000100:00100000:2.0:1789785245.958272:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+59:11286:x1876725530145536:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 2162us (2471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785245.958282:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 77 00000100:00100000:0.0:1789785246.019284:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789785246.020801:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549105920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789785246.020905:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785246.021131:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf85535500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549106048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789785246.021759:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785246.021916:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549106048 00000100:00100000:3.0:1789785246.021927:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549106048 00000100:00100000:3.0:1789785246.021994:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789785246.022006:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf85536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549106048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789785246.022062:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446268928 avail 1300029440 00000100:00100000:3.0:1789785246.022123:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf85536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549106048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785246.022165:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789785246.022224:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf85535500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549106048:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789785246.022634:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549105920 00000100:00100000:1.0:1789785246.022641:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549105920 00000100:00100000:1.0:1789785246.022699:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789785246.022709:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549105920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789785246.022745:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785246.022817:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549105920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785246.022823:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789785246.022865:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549105920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789785246.022887:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549105792:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789785246.023063:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785246.023170:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549105792 00000100:00100000:1.0:1789785246.023176:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549105792 00000100:00100000:1.0:1789785246.023215:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789785246.023223:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549105792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789785246.023238:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789785246.023723:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789785246.024238:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549105792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1010us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785246.024249:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789785246.024763:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549105792:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1789785246.530545:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789785246.530554:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789785246.530588:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789785246.530599:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789785246.530723:0:13813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf85537100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1876725549106176:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789785246.530831:0:13813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf982a8000 going to sleep for 11 seconds 00000100:00100000:2.0:1789785246.532817:0:13813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf85537100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1876725549106176:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789785246.533645:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785246.533720:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530145664 00000100:00100000:2.0:1789785246.533728:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530145664 00000100:00100000:2.0:1789785246.533789:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 78 00000100:00100000:2.0:1789785246.533799:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+59:11297:x1876725530145664:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789785246.533837:0:7896:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789785246.534174:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+59:11297:x1876725530145664:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 Request processed in 143us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785246.534183:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 78 00000100:00100000:2.0:1789785246.542173:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785246.542270:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530145792 00000100:00100000:0.0:1789785246.542281:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530145792 00000100:00100000:0.0:1789785246.542366:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 79 00000100:00100000:0.0:1789785246.542378:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf85537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+59:11297:x1876725530145792:12345-192.168.203.46@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789785246.542457:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c847 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.542475:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c847 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.542487:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c847 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544312:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c84e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544333:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c84e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544359:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c84e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544396:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c855 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544405:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c855 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544412:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c855 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785246.544480:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789785246.544485:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789785246.544502:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c855 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544514:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c847 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544520:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c847 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544526:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c847 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544547:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eacc00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785246.544552:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c847 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544559:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c847 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544574:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9daf87d6e700) 00010000:00010000:0.0:1789785246.544578:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785246.544584:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c847 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544591:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c847 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544601:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c84e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544607:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c84e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544613:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c84e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544619:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81ead400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785246.544621:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c84e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544628:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c84e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544656:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9dae82670500) 00010000:00010000:0.0:1789785246.544659:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785246.544662:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c84e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544667:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c84e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544680:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c855 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544686:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c855 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544691:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c855 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544695:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eac400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785246.544698:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c855 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544704:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c855 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544712:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:0.0:1789785246.544714:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785246.544717:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c855 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.544723:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c855 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785246.544828:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf85537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+59:11297:x1876725530145792:12345-192.168.203.46@tcp:34:lhsmtool_posix.0 Request processed in 2448us (2661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785246.544837:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 79 00000001:00080000:2.0:1789785246.545910:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:2.0:1789785246.545969:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1789785246.545994:0:6512:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dae827d6e40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1789785246.545999:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dae83a4e000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dae827d66c0 00000020:00080000:2.0:1789785246.546001:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dae83a4e400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dae82b0b800 00010000:00010000:0.0:1789785246.546126:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09000/0x2f18ee3fd845c5e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546136:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09000/0x2f18ee3fd845c5e6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546143:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09000/0x2f18ee3fd845c5e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546148:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785246.546151:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09000/0x2f18ee3fd845c5e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546158:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09000/0x2f18ee3fd845c5e6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546171:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9dae827bd600) 00010000:00010000:0.0:1789785246.546174:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785246.546178:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09000/0x2f18ee3fd845c5e6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546184:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09000/0x2f18ee3fd845c5e6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546201:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d3800/0x2f18ee3fd845c5ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546224:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d3800/0x2f18ee3fd845c5ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546231:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d3800/0x2f18ee3fd845c5ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546236:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf829d3800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785246.546239:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d3800/0x2f18ee3fd845c5ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546245:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d3800/0x2f18ee3fd845c5ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546253:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:0.0:1789785246.546256:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785246.546258:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d3800/0x2f18ee3fd845c5ed lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546264:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf829d3800/0x2f18ee3fd845c5ed lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546280:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845c62c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546287:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845c62c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546293:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845c62c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546298:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bbc00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785246.546306:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845c62c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546313:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845c62c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546321:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dafc21de200) 00010000:00010000:0.0:1789785246.546324:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785246.546326:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845c62c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546332:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845c62c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546371:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845c736 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546378:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845c736 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546383:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845c736 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546387:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b08400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785246.546390:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845c736 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546396:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845c736 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546403:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:0.0:1789785246.546406:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785246.546415:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845c736 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546430:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845c736 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546443:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c759 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546449:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c759 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546455:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c759 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546460:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf80030800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785246.546610:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c759 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546618:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c759 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546626:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:0.0:1789785246.546629:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785246.546631:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c759 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546637:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845c759 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546656:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c79f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546662:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c79f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546675:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c79f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546680:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b08a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785246.546683:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c79f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546690:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c79f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546698:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:0.0:1789785246.546700:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785246.546703:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c79f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.546709:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845c79f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789785246.546896:0:6565:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1789785246.547055:0:6565:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1789785246.547283:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789785246.547798:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549106304:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789785246.547884:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785246.548043:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549106304 00000100:00100000:2.0:1789785246.548051:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549106304 00000100:00100000:2.0:1789785246.548147:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789785246.548157:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf44b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3662:x1876725549106304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789785246.548184:0:8450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1789785246.548214:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aadf49a, atime: 0x6aadf49b, ctime: 0x6aadf49a, blocks: 0x8 00010000:00010000:2.0:1789785246.548221:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000326977a8/0x2f18ee3fd845c85c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.548242:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=354s v=(0 0) 00010000:00010000:2.0:1789785246.548247:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785246.548253:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000326977a8/0x2f18ee3fd845c85c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.548269:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000326977a8/0x2f18ee3fd845c85c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.548278:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000326977a8/0x2f18ee3fd845c85c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.548286:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000326977a8/0x2f18ee3fd845c85c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.548307:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789785246.548474:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf44b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3662:x1876725549106304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 317us (589us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789785246.548481:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:2.0:1789785246.548521:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dafbf50ce00/2, rc 0, transno 4294967302 00000100:00100000:2.0:1789785246.548527:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549106304:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789785246.548589:0:9538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789785246.548596:0:9538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000326977a8/0x2f18ee3fd845c85c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.548604:0:9538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55a00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:0.0:1789785246.548608:0:9538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000326977a8/0x2f18ee3fd845c85c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.548617:0:9538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000326977a8/0x2f18ee3fd845c85c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.548657:0:9538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000326977a8/0x2f18ee3fd845c85c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.548665:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000326977a8/0x2f18ee3fd845c85c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.548683:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785246.548685:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785246.548687:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789785246.549190:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789785246.549275:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785246.549358:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530146048 00000100:00100000:0.0:1789785246.549365:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530146048 00000100:00100000:0.0:1789785246.549409:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 80 00000100:00100000:0.0:1789785246.549427:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf85537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+12:11297:x1876725530146048:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789785246.549443:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785246.549458:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c863 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd86fd expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.549811:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c86a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.549825:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c86a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.549834:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c86a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785246.549844:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789785246.550042:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c86a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.550049:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c86a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.550066:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c86a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.550071:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eac800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785246.550074:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c86a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.550080:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c86a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.550092:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:2.0:1789785246.550095:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789785246.550099:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c86a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.550106:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c86a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.550145:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c863 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86fd expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.550155:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9daf87d6e700) 00010000:00010000:2.0:1789785246.550157:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789785246.550161:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c863 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86fd expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.550170:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eace00, rc 0) 00000100:00100000:2.0:1789785246.550258:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf85537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+13:11297:x1876725530146048:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 841us (984us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1789785246.550275:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 80 00000100:00100000:3.0:1789785246.559623:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785246.559769:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530146176 00000100:00100000:2.0:1789785246.559778:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530146176 00000100:00100000:2.0:1789785246.559833:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 81 00000100:00100000:2.0:1789785246.559844:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+13:11297:x1876725530146176:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789785246.559881:0:11254:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789785246.559992:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+13:11297:x1876725530146176:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 Request processed in 149us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785246.560000:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 81 00000100:00100000:3.0:1789785246.563100:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785246.563206:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530146432 00000100:00100000:2.0:1789785246.563215:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530146432 00000100:00100000:2.0:1789785246.563272:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 82 00000100:00100000:2.0:1789785246.563283:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+13:11297:x1876725530146432:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789785246.563303:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785246.563306:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789785246.563332:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845c81d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86ef expref: 13 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.563388:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:2.0:1789785246.563394:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789785246.563406:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845c878 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8704 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789785246.563820:0:6533:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789785246.563963:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845c87f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.563982:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845c87f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.563992:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845c87f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.564043:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845c878 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8704 expref: 15 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.564058:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845c87f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8704 expref: 14 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.564066:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dae827bd300) 00010000:00010000:2.0:1789785246.564069:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789785246.564071:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d55200, rc 0) 00000100:00100000:2.0:1789785246.564125:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+14:11297:x1876725530146432:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 844us (1035us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1789785246.564133:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 82 00000100:00100000:2.0:1789785246.574944:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785246.575057:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530146688 00000100:00100000:0.0:1789785246.575066:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530146688 00000100:00100000:0.0:1789785246.575136:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 83 00000100:00100000:0.0:1789785246.575146:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf85535880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+14:11297:x1876725530146688:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789785246.575203:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785246.575236:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845c87f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8704 expref: 14 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.575259:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dae827bd300) 00010000:00010000:0.0:1789785246.575269:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789785246.575296:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c88d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.575308:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c88d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.575319:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c88d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.575334:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c894 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x53e80609 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.575394:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c894 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x53e80609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.575401:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c894 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x53e80609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.575579:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c88d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.575606:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c88d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.575613:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c88d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.575619:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eac400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785246.575623:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c88d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.575630:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c88d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.575639:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:0.0:1789785246.575642:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785246.575646:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c88d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.575738:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c88d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.575756:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c894 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x53e80609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.575762:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c894 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x53e80609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.575768:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c894 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x53e80609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.575774:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81ead400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785246.575783:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c894 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x53e80609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.575790:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c894 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x53e80609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.575798:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x53e80609 (ffff9dae82670500) 00010000:00010000:0.0:1789785246.575800:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785246.575803:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c894 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x53e80609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.575809:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c894 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x53e80609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785246.577571:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf85535880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+13:11297:x1876725530146688:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 2414us (2627us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789785246.577583:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 83 00000100:00100000:0.0:1789785246.588651:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785246.589029:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530146816 00000100:00100000:3.0:1789785246.589040:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530146816 00000100:00100000:3.0:1789785246.589099:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 84 00000100:00100000:3.0:1789785246.589109:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+13:11297:x1876725530146816:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789785246.589128:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785246.589157:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c89b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd870b expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.589189:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845c8a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.589201:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845c8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.589211:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845c8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.589320:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c89b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd870b expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.589375:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845c8a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd870b expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.589396:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9daf94af3100) 00010000:00010000:3.0:1789785246.589399:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789785246.589403:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bb600, rc 0) 00000100:00100000:3.0:1789785246.589455:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+14:11297:x1876725530146816:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 347us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785246.589823:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 84 00000100:00100000:0.0:1789785246.592240:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785246.592322:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530147072 00000100:00100000:1.0:1789785246.592331:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530147072 00000100:00100000:1.0:1789785246.592414:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 85 00000100:00100000:1.0:1789785246.592425:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+14:11297:x1876725530147072:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789785246.592505:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c8a9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.592520:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c8a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.592545:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c8a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789785246.592707:0:7896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1789785246.592717:0:7896:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 354846377989ns, next at 355846375814ns, rc = 0 00000004:00010000:1.0:1789785246.592773:0:7896:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000628d01a6 reply state 00000000345c5a63 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c8a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.592787:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c8a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.592794:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9daf94af3100) 00010000:00010000:1.0:1789785246.592796:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789785246.592800:0:7896:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789785246.592881:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+16:11297:x1876725530147072:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 458us (648us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1789785246.592888:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 85 00000100:00100000:1.0:1789785246.595793:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785246.595871:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530147200 00000100:00100000:0.0:1789785246.595880:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530147200 00000100:00100000:0.0:1789785246.595933:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 86 00000100:00100000:0.0:1789785246.595942:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+16:11297:x1876725530147200:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789785246.595965:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785246.595982:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c8b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8712 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.596031:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c8b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8712 expref: 17 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.596058:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c8b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8712 expref: 17 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.596076:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9daf94af3100) 00010000:00010000:0.0:1789785246.596079:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789785246.596082:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eac400, rc 0) 00000100:00100000:0.0:1789785246.596144:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+17:11297:x1876725530147200:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 203us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785246.596151:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 86 00000100:00100000:0.0:1789785246.608545:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785246.609259:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530147328 00000100:00100000:1.0:1789785246.609271:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530147328 00000100:00100000:1.0:1789785246.609325:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 33 00000100:00100000:1.0:1789785246.609334:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2396:x1876725530147328:12345-192.168.203.46@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1789785246.609397:0:8449:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp t0 exp 0000000000000000 cur 354 last 0 00000020:00000080:1.0:1789785246.609426:0:8449:0:(genops.c:1385:class_connect()) connect: client 026b2112-ee35-499c-8d01-18663664f08e, cookie 0x2f18ee3fd845c8b7 00002000:00100000:1.0:1789785246.609438:0:8449:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 026b2112-ee35-499c-8d01-18663664f08e/ffff9dafbf43e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789785246.609450:0:8449:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789785246.609533:0:8449:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789785246.609563:0:8449:0:(import.c:65:import_set_state_nolock()) ffff9dafbf43e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789785246.609626:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+6:2396:x1876725530147328:12345-192.168.203.46@tcp:8:lhsmtool_posix.0 Request processed in 291us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785246.609634:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 33 00000100:00100000:1.0:1789785246.617328:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785246.617656:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530147456 00000100:00100000:3.0:1789785246.617666:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530147456 00000100:00100000:3.0:1789785246.617736:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 34 00000100:00100000:3.0:1789785246.617755:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+6:0:x1876725530147456:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1789785246.618062:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789785246.619827:0:8445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:3.0:1789785246.619848:0:8445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 026b2112-ee35-499c-8d01-18663664f08e 00000100:00100000:3.0:1789785246.620043:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+5:0:x1876725530147456:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 Request processed in 2289us (2714us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789785246.620058:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 34 00000100:00100000:3.0:1789785246.633553:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785246.634754:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530147712 00000100:00100000:2.0:1789785246.634770:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530147712 00000100:00100000:2.0:1789785246.634842:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:2.0:1789785246.634852:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+17:11297:x1876725530147712:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789785246.635060:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+18:11297:x1876725530147712:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 209us (1524us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1789785246.635068:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:3.0:1789785246.644142:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785246.644735:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530147968 00000100:00100000:0.0:1789785246.644760:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530147968 00000100:00100000:0.0:1789785246.644821:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 87 00000100:00100000:0.0:1789785246.644830:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+18:11297:x1876725530147968:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789785246.644945:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+18:11297:x1876725530147968:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 115us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785246.644953:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 87 00000100:00100000:2.0:1789785246.652647:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785246.656022:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530148096 00000100:00100000:3.0:1789785246.656043:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530148096 00000100:00100000:3.0:1789785246.656130:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 88 00000100:00100000:3.0:1789785246.656144:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf85534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+18:11297:x1876725530148096:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789785246.656174:0:11254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785246.656202:0:11254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c8be lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8719 expref: -99 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.656314:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845c8c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.656332:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845c8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.656375:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845c8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785246.656433:0:11254:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789785246.656457:0:11254:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845c8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.656489:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c8be lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8719 expref: 20 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.656508:0:11254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845c8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8719 expref: 19 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.656518:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9daf94af3100) 00010000:00010000:3.0:1789785246.656521:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789785246.656525:0:11254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bac00, rc 0) 00000100:00100000:3.0:1789785246.656615:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf85534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+19:11297:x1876725530148096:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 474us (3979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785246.656623:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 88 00000100:00100000:0.0:1789785246.663915:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785246.664052:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530148224 00000100:00100000:1.0:1789785246.664065:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530148224 00000100:00100000:1.0:1789785246.664134:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 35 00000100:00100000:1.0:1789785246.664146:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530148224:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789785246.664170:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785246.664206:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000752b0cce/0x2f18ee3fd845c8cc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8720 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789785246.664240:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aadf49d, blocks: 0x0 00010000:00010000:1.0:1789785246.664268:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=354s v=(0 0) 00010000:00010000:1.0:1789785246.664273:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789785246.664285:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000752b0cce/0x2f18ee3fd845c8cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8720 expref: 6 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.664308:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000752b0cce/0x2f18ee3fd845c8cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8720 expref: 6 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.664323:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64200, rc 0) 00000100:00100000:1.0:1789785246.664438:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+6:2400:x1876725530148224:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 292us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785246.664460:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 35 00000100:00100000:2.0:1789785246.677108:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785246.677211:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530148480 00000100:00100000:3.0:1789785246.677221:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530148480 00000100:00100000:3.0:1789785246.677317:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 89 00000100:00100000:3.0:1789785246.677363:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf85535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+19:11297:x1876725530148480:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789785246.677488:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf85535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+19:11297:x1876725530148480:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 153us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785246.677495:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 89 00000100:00100000:0.0:1789785246.683671:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785246.683945:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530148608 00000100:00100000:2.0:1789785246.683961:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530148608 00000100:00100000:2.0:1789785246.684037:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 36 00000100:00100000:2.0:1789785246.684050:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87816d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+6:11297:x1876725530148608:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789785246.684077:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785246.684105:0:8451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845c8d3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8727 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.684168:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000752b0cce/0x2f18ee3fd845c8cc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8720 expref: 7 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.684179:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785246.684184:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785246.684191:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845c8d3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8727 expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.684236:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000752b0cce/0x2f18ee3fd845c8cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8720 expref: 7 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.684252:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000752b0cce/0x2f18ee3fd845c8cc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8720 expref: 7 pid: 8449 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785246.684269:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf85534a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8451:1876725549106432:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789785246.684412:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafa64c2600 going to sleep for 11 seconds 00000100:00100000:2.0:1789785246.689837:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785246.689885:0:7484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530148736 00000100:00100000:2.0:1789785246.689896:0:7484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530148736 00010000:00010000:2.0:1789785246.689952:0:7484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000752b0cce/0x2f18ee3fd845c8cc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8720 expref: 8 pid: 8449 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785246.690001:0:7484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 59 00000100:00100000:2.0:1789785246.690013:0:7484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf85534700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+8:2397:x1876725530148736:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789785246.690032:0:7484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785246.690059:0:7484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000752b0cce/0x2f18ee3fd845c8cc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8720 expref: 8 pid: 8449 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.690075:0:7484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000752b0cce/0x2f18ee3fd845c8cc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8720 expref: 8 pid: 8449 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.690108:0:7484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785246.690114:0:7484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785246.690124:0:7484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845c8d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8727 expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.690135:0:7484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845c8d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8727 expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.690316:0:7484:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845c8d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8727 expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785246.690358:0:7484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf85535180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7484:1876725549106560:192.168.203.46@tcp:105: 00000100:00100000:2.0:1789785246.690478:0:7484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab2540 going to sleep for 11 seconds 00010000:00010000:0.0:1789785246.691579:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000752b0cce/0x2f18ee3fd845c8cc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8720 expref: 8 pid: 8449 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785246.691612:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf85534a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8451:1876725549106432:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789785246.691646:0:8451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845c8d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8727 expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.691668:0:8451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d55400, rc 0) 00000100:00100000:0.0:1789785246.691736:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87816d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+7:11297:x1876725530148608:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 7686us (8072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785246.691756:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 36 00000100:00100000:1.0:1789785246.694842:0:7484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf85535180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7484:1876725549106560:192.168.203.46@tcp:105: 00010000:00010000:1.0:1789785246.694895:0:7484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785246.694985:0:7484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf85534700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+6:2397:x1876725530148736:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 4973us (5162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785246.694999:0:7484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 59 00000100:00100000:3.0:1789785246.700902:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785246.700997:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530148864 00000100:00100000:1.0:1789785246.701011:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530148864 00002000:00100000:1.0:1789785246.701093:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9dafbf50c380 x1876725530148864/t0(0) o4->026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp:377/0 lens 504/0 e 0 to 0 dl 1789785257 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789785246.701106:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dafbf50c380 with x1876725530148864 ext(0->8) 00002000:00010000:1.0:1789785246.701114:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dafbf50c380 00000100:00100000:1.0:1789785246.701148:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 0 00000100:00100000:1.0:1789785246.701307:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:026b2112-ee35-499c-8d01-18663664f08e+6:2397:x1876725530148864:12345-192.168.203.46@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789785246.705398:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:026b2112-ee35-499c-8d01-18663664f08e+8:2397:x1876725530148864:12345-192.168.203.46@tcp:4:lhsmtool_posix.0 Request processed in 4084us (4499us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789785246.711086:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 0 00002000:00100000:1.0:1789785246.711110:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9dafbf50c380 x1876725530148864/t4294967303(0) o4->026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp:377/0 lens 504/448 e 0 to 0 dl 1789785257 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789785246.711123:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dafbf50c380 with x1876725530148864 ext(0->8) 00002000:00010000:1.0:1789785246.711130:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dafbf50c380 00000100:00100000:0.0:1789785246.714867:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785246.715109:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530148992 00000100:00100000:1.0:1789785246.715124:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530148992 00000100:00100000:1.0:1789785246.715202:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 90 00000100:00100000:1.0:1789785246.715226:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+19:11297:x1876725530148992:12345-192.168.203.46@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789785246.717502:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1789785246.717518:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1789785246.717543:0:6512:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:2.0:1789785246.717896:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789785246.717916:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf85535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549106688:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789785246.718052:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785246.718183:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549106688 00000100:00100000:0.0:1789785246.718191:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549106688 00010000:00010000:1.0:1789785246.718203:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c8a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.718216:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c8a9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.718225:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c8a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.718232:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a64400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785246.718237:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c8a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.718246:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c8a9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785246.718252:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789785246.718264:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf85534a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549106688:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1789785246.718265:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9daf94af3100) 00010000:00010000:1.0:1789785246.718272:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789785246.718277:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c8a9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.718284:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c8a9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789785246.718308:0:6565:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1789785246.718317:0:6565:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789785246.718450:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+14:11297:x1876725530148992:12345-192.168.203.46@tcp:44:lhsmtool_posix.0 Request processed in 3223us (3593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785246.718459:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 90 00002000:00010000:0.0:1789785246.718564:0:8805:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789785246.718568:0:8805:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789785245 00002000:00010000:0.0:1789785246.718571:0:8805:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789785246.718574:0:8805:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789785245 -> 1789785245 00002000:00010000:0.0:1789785246.718576:0:8805:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1789785246.718628:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf85534a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3661:x1876725549106688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 366us (576us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789785246.718637:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:1.0:1789785246.718820:0:3661:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9daf85535180/2, rc 0, transno 4294967304 00000100:00100000:1.0:1789785246.718827:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf85535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549106688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789785246.722643:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785246.722832:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530149120 00000100:00100000:1.0:1789785246.722843:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530149120 00000100:00100000:1.0:1789785246.722907:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 38 00000100:00100000:1.0:1789785246.722921:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+8:2397:x1876725530149120:12345-192.168.203.46@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789785246.727312:0:8445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1789785246.727327:0:8445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00010000:00010000:2.0:1789785246.727823:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785246.728194:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+6:2397:x1876725530149120:12345-192.168.203.46@tcp:16:lhsmtool_posix.0 Request processed in 5265us (5548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785246.728212:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 38 00000100:00100000:1.0:1789785246.739194:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785246.739275:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530149376 00000100:00100000:2.0:1789785246.739285:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530149376 00000100:00100000:2.0:1789785246.739369:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 91 00000100:00100000:2.0:1789785246.739380:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+14:11297:x1876725530149376:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789785246.739445:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785246.739482:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845c8c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8719 expref: 14 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.739499:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9daf94af3100) 00010000:00010000:2.0:1789785246.739504:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789785246.739533:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845c8da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.739546:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845c8da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.739557:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845c8da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789785246.739678:0:6534:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082d1ceff reply state 00000000a237e1d1 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845c8da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.739834:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845c8da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.739854:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9daf94af3100) 00010000:00010000:2.0:1789785246.739857:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789785246.739859:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789785246.740013:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+15:11297:x1876725530149376:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 634us (826us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1789785246.740022:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 91 00000100:00100000:0.0:1789785246.752755:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785246.753726:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530149504 00000100:00100000:1.0:1789785246.753740:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530149504 00000100:00100000:1.0:1789785246.753807:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 39 00000100:00100000:1.0:1789785246.753818:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+6:2400:x1876725530149504:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789785246.753973:0:8449:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789785246.753977:0:8449:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789785245 -> 1789785244 00002000:00010000:1.0:1789785246.753979:0:8449:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789785243 00002000:00010000:1.0:1789785246.753981:0:8449:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789785245 -> 1789785244 00002000:00010000:1.0:1789785246.753984:0:8449:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789785246.754049:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+7:2400:x1876725530149504:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 Request processed in 232us (1309us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789785246.754057:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 39 00000100:00100000:1.0:1789785246.759423:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785246.759494:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530149760 00000100:00100000:2.0:1789785246.759505:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530149760 00000100:00100000:2.0:1789785246.759565:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 92 00000100:00100000:2.0:1789785246.759578:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+15:11297:x1876725530149760:12345-192.168.203.46@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789785246.759659:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845c8e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.759678:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845c8a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd870b expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.759689:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845c8e1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.759727:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845c8a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd870b expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.759755:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845c8a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd870b expref: 15 pid: 6535 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785246.759771:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1876725549106816:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789785246.759881:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab2180 going to sleep for 11 seconds 00000100:00100000:1.0:1789785246.770417:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785246.770450:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530149888 00000100:00100000:1.0:1789785246.770458:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530149888 00010000:00010000:1.0:1789785246.770494:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845c8a2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd870b expref: 16 pid: 6535 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785246.770543:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 60 00000100:00100000:1.0:1789785246.770553:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83875c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+16:2398:x1876725530149888:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789785246.770568:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785246.770576:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845c8a2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd870b expref: 16 pid: 6535 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.770588:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845c8a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd870b expref: 16 pid: 6535 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.770611:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9daf94af3100) 00010000:00010000:1.0:1789785246.770617:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845c8e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.770627:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845c8e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.770634:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845c8e1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.770654:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785246.770714:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83875c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+16:2398:x1876725530149888:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 161us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785246.770722:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 60 00010000:00010000:3.0:1789785246.773480:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845c8a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd870b expref: 15 pid: 6535 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785246.773509:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1876725549106816:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785246.773534:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845c8e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.773544:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845c8e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.773549:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845c8e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.773588:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845c8e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.773596:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845c8e1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.773603:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845c8e1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.773624:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785246.773629:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845c8e1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.773637:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845c8e1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.773654:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9daf94af3100) 00010000:00010000:3.0:1789785246.773656:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789785246.773660:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845c8e1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.773666:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845c8e1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785246.773775:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+14:11297:x1876725530149760:12345-192.168.203.46@tcp:55:lhsmtool_posix.0 Request processed in 14199us (14360us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789785246.773785:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 92 00000100:00100000:1.0:1789785246.779470:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785246.779551:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530150016 00000100:00100000:0.0:1789785246.779561:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530150016 00000100:00100000:0.0:1789785246.779619:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 40 00000100:00100000:0.0:1789785246.779630:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+7:2397:x1876725530150016:12345-192.168.203.46@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789785246.779681:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000025b87893/0x2f18ee3fd845c8e8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.779717:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845c8d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8727 expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.779726:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789785246.779731:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789785246.779735:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025b87893/0x2f18ee3fd845c8e8 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.779781:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845c8d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8727 expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.779795:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845c8d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8727 expref: 7 pid: 8451 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785246.779810:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf87817b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8451:1876725549106944:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789785246.779888:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafac70eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789785246.783254:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf87817b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8451:1876725549106944:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789785246.783288:0:8451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000025b87893/0x2f18ee3fd845c8e8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785246.783441:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785246.784073:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530150144 00000100:00100000:3.0:1789785246.784082:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530150144 00010000:00010000:3.0:1789785246.784122:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845c8d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8727 expref: 8 pid: 8451 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785246.784166:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 61 00000100:00100000:3.0:1789785246.784176:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf445f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+8:2398:x1876725530150144:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789785246.784189:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785246.784209:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845c8d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8727 expref: 8 pid: 8451 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.784238:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845c8d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8727 expref: 8 pid: 8451 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.784263:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845c8d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8727 expref: 8 pid: 8451 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.784278:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789785246.784283:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789785246.784288:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000025b87893/0x2f18ee3fd845c8e8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.784298:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025b87893/0x2f18ee3fd845c8e8 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.784321:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785246.784382:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf445f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+7:2398:x1876725530150144:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 207us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785246.784390:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 61 00010000:00010000:0.0:1789785246.785624:0:8451:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000025b87893/0x2f18ee3fd845c8e8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.785651:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025b87893/0x2f18ee3fd845c8e8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.785675:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000025b87893/0x2f18ee3fd845c8e8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.785684:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025b87893/0x2f18ee3fd845c8e8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.785783:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025b87893/0x2f18ee3fd845c8e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.785791:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eacc00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:0.0:1789785246.785796:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025b87893/0x2f18ee3fd845c8e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.785805:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025b87893/0x2f18ee3fd845c8e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.785823:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025b87893/0x2f18ee3fd845c8e8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.785831:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025b87893/0x2f18ee3fd845c8e8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785246.785934:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+6:2397:x1876725530150016:12345-192.168.203.46@tcp:1:lhsmtool_posix.0 Request processed in 6302us (6470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785246.785943:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 40 00000100:00100000:3.0:1789785246.794273:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785246.804010:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530150400 00000100:00100000:0.0:1789785246.804217:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530150400 00000100:00100000:0.0:1789785246.804292:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 93 00000100:00100000:0.0:1789785246.804304:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+14:11297:x1876725530150400:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789785246.804397:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c8ef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.804413:0:7896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845c72f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86b0 expref: 14 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.804423:0:7896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c8ef lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.804457:0:7896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845c72f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86b0 expref: 14 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.804470:0:7896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845c72f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86b0 expref: 14 pid: 11254 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785246.804554:0:7896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf87817b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7896:1876725549107072:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789785246.804645:0:7896:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafac70eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789785246.810186:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785246.810436:0:7896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf87817b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7896:1876725549107072:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785246.810476:0:7896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c8ef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785246.810520:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530150528 00000100:00100000:2.0:1789785246.810527:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530150528 00010000:00010000:2.0:1789785246.810561:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845c72f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86b0 expref: 15 pid: 11254 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785246.810600:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 62 00000100:00100000:2.0:1789785246.810608:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9e8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+15:2397:x1876725530150528:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789785246.810621:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785246.810628:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845c72f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86b0 expref: 15 pid: 11254 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.810640:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845c72f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86b0 expref: 15 pid: 11254 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.810660:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845c72f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86b0 expref: 15 pid: 11254 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.810674:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:2.0:1789785246.810679:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c8ef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.810688:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c8ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.810695:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c8ef lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785246.810718:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789785246.810753:0:7896:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c8ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.810775:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c8ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785246.810782:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9e8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+14:2397:x1876725530150528:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 172us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785246.810790:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 62 00010000:00010000:3.0:1789785246.810982:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c8f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.818760:0:7896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c8b0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8712 expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.818780:0:7896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c8f6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.818829:0:7896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c8b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8712 expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.818852:0:7896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c8b0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8712 expref: 14 pid: 6534 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785246.818871:0:7896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7896:1876725549107200:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789785246.818982:0:7896:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf9017bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789785246.823495:0:7896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7896:1876725549107200:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785246.823528:0:7896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c8f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789785246.827906:0:14221:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789785246.827917:0:14221:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789785246.827949:0:14221:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789785246.827957:0:14221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789785246.829271:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785246.829427:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530150656 00000100:00100000:0.0:1789785246.829437:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530150656 00010000:00010000:0.0:1789785246.829479:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c8b0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8712 expref: 15 pid: 6534 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785246.829518:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 63 00000100:00100000:0.0:1789785246.829529:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+15:2398:x1876725530150656:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789785246.829543:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785246.829549:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c8b0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8712 expref: 15 pid: 6534 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.829563:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c8b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8712 expref: 15 pid: 6534 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.829585:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c8b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8712 expref: 15 pid: 6534 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.829599:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9daf94af3100) 00010000:00010000:0.0:1789785246.829604:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c8f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.829613:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c8f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.829621:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c8f6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.829651:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785246.829707:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+14:2398:x1876725530150656:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 179us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785246.829715:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 63 00010000:00010000:3.0:1789785246.829754:0:7896:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c8f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.829776:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c8f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789785246.829874:0:7896:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1789785246.830027:0:7896:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1789785246.830078:0:7896:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1789785246.830155:0:7896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8445d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7896:1876725549107328:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789785246.830200:0:7896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785246.830234:0:7896:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf982a80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789785246.832163:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549107328 00000100:00100000:0.0:1789785246.832176:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549107328 00000100:00100000:0.0:1789785246.832488:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789785246.832500:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8445ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7896:x1876725549107328:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789785246.832631:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8445ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7896:x1876725549107328:12345-0@lo:1000:mdt00_003.0 Request processed in 133us (2428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785246.832638:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789785246.832709:0:7896:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1789785246.832716:0:7896:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9daf85535180, transno 4294967304 00000100:00100000:1.0:1789785246.832733:0:7896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8445d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7896:1876725549107328:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1789785246.832891:0:7896:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1789785246.832979:0:7896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf445180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7896:1876725549107456:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789785246.833030:0:7896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785246.839537:0:7896:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf9017b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785246.840211:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549107456 00000100:00100000:3.0:1789785246.840221:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549107456 00000100:00100000:3.0:1789785246.840271:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789785246.840282:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7896:x1876725549107456:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789785246.841916:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7896:x1876725549107456:12345-0@lo:1000:mdt00_003.0 Request processed in 1631us (8894us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789785246.841929:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789785246.842334:0:7896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf445180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7896:1876725549107456:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1789785246.843299:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c8f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.843311:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c8f6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.843318:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c8f6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.843324:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814baa00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785246.843329:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c8f6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.843649:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c8f6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.843666:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9daf94af3100) 00010000:00010000:0.0:1789785246.843669:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789785246.843674:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c8f6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.843679:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c8f6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.843711:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09a00/0x2f18ee3fd845c824 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.843726:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09a00/0x2f18ee3fd845c824 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.843732:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09a00/0x2f18ee3fd845c824 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.843737:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785246.843740:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09a00/0x2f18ee3fd845c824 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.843889:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09a00/0x2f18ee3fd845c824 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.843899:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:0.0:1789785246.843902:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789785246.843905:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09a00/0x2f18ee3fd845c824 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.843910:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09a00/0x2f18ee3fd845c824 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.843933:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c8fd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.843946:0:7896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845c840 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86f6 expref: 17 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.843955:0:7896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c8fd lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.843992:0:7896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845c840 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86f6 expref: 17 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.844012:0:7896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845c840 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86f6 expref: 17 pid: 6534 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785246.844117:0:7896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf87814a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7896:1876725549107584:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789785246.844198:0:7896:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafac70e900 going to sleep for 11 seconds 00000100:00100000:2.0:1789785246.854061:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785246.854173:0:7896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf87814a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7896:1876725549107584:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789785246.854184:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530150784 00000100:00100000:1.0:1789785246.854191:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530150784 00010000:00010000:0.0:1789785246.854200:0:7896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c8fd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.854238:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845c840 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86f6 expref: 18 pid: 6534 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785246.854277:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 64 00000100:00100000:1.0:1789785246.854287:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:026b2112-ee35-499c-8d01-18663664f08e+18:2398:x1876725530150784:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789785246.854299:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785246.854306:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845c840 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86f6 expref: 18 pid: 6534 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.854317:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845c840 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86f6 expref: 18 pid: 6534 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.854362:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845c840 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd86f6 expref: 18 pid: 6534 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.854392:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:1.0:1789785246.854397:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c8fd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.854406:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c8fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.854413:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c8fd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.854435:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785246.854482:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:026b2112-ee35-499c-8d01-18663664f08e+17:2398:x1876725530150784:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 196us (429us total) trans 0 rc 0/0 00010000:00010000:0.0:1789785246.854486:0:7896:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c8fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785246.854489:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 64 00010000:00010000:0.0:1789785246.854493:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c8fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.854505:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c8fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.854512:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c8fd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.854518:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c8fd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.854523:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eace00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785246.854527:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c8fd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.854534:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c8fd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.854551:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:0.0:1789785246.854554:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785246.854558:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c8fd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.854564:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845c8fd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.854575:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c8ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.854580:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c8ef lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.854585:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c8ef lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.854590:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81ead400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785246.854593:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c8ef lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.854599:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c8ef lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.854605:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9daf94af3600) 00010000:00010000:0.0:1789785246.854608:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789785246.854611:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c8ef lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785246.854617:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c8ef lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785246.854970:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+16:11297:x1876725530150400:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 50666us (60706us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1789785246.854980:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 93 00000020:00080000:0.0:1789785246.854984:0:7896:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789785246.855081:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789785246.855086:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789785246.855101:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789785246.855107:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789785246.870974:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785246.871232:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530151040 00000100:00100000:1.0:1789785246.871243:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530151040 00000100:00100000:1.0:1789785246.871310:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 20 00000100:00100000:1.0:1789785246.871321:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8445d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+16:11297:x1876725530151040:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789785246.871619:0:6537:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789785246.871653:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:1.0:1789785246.871688:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c904 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.871705:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c904 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.871724:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c904 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.871733:0:6537:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c904 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.871739:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c904 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.871755:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c904 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785246.871774:0:6537:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789785246.871859:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8445d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+18:11297:x1876725530151040:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 538us (906us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1789785246.871867:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 20 00000020:00080000:1.0:1789785246.871872:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789785246.872058:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789785246.872066:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c904 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.872074:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a64200 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:3.0:1789785246.872078:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c904 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.872087:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c904 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.872102:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9daf94af3100) 00010000:00010000:3.0:1789785246.872112:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789785246.872119:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c904 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.872125:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c904 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785246.872138:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785246.872140:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785246.872142:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785247.750054:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785248.240886:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785248.240932:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785248.240965:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530151296 00000100:00100000:0.0:1789785248.240974:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530151296 00000100:00100000:0.0:1789785248.241031:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 290 00000100:00100000:0.0:1789785248.241041:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+18:2400:x1876725530151296:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785248.241118:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+18:2400:x1876725530151296:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 78us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785248.241126:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 290 00000100:00100000:1.0:1789785248.241289:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530151168 00000100:00100000:1.0:1789785248.241294:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530151168 00000100:00100000:1.0:1789785248.241333:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 382 00000100:00100000:1.0:1789785248.241363:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2400:x1876725530151168:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785248.241396:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2400:x1876725530151168:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 57us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785248.241403:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 382 00000100:00080000:1.0:1789785248.241429:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789785248.248581:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785248.248633:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785248.248656:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785248.248689:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785248.248712:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785248.248751:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530151424 00000100:00100000:1.0:1789785248.248760:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530151424 00000100:00100000:1.0:1789785248.248811:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530151808 00000100:00100000:1.0:1789785248.248815:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530151808 00000100:00100000:1.0:1789785248.248836:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530151936 00000100:00100000:1.0:1789785248.248839:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530151936 00000100:00100000:1.0:1789785248.248856:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 291 00000100:00100000:1.0:1789785248.248867:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2399:x1876725530151424:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785248.248937:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2399:x1876725530151424:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 71us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785248.248944:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 291 00000100:00100000:1.0:1789785248.248961:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 292 00000100:00100000:1.0:1789785248.248968:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2400:x1876725530151808:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785248.248993:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2400:x1876725530151808:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 26us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785248.248999:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 292 00000100:00100000:1.0:1789785248.249011:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 293 00000100:00100000:1.0:1789785248.249017:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2400:x1876725530151936:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785248.249041:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2400:x1876725530151936:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 24us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785248.249048:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 293 00000100:00100000:1.0:1789785248.249065:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530151552 00000100:00100000:1.0:1789785248.249068:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530151552 00000100:00100000:1.0:1789785248.249093:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530151680 00000100:00100000:1.0:1789785248.249103:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530151680 00000100:00100000:1.0:1789785248.249130:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 116 00000100:00100000:1.0:1789785248.249136:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+6:2400:x1876725530151552:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785248.249161:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+6:2400:x1876725530151552:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 25us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785248.249167:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 116 00000100:00100000:1.0:1789785248.249178:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 117 00000100:00100000:1.0:1789785248.249184:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+7:2400:x1876725530151680:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785248.249206:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+7:2400:x1876725530151680:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 22us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785248.249211:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 117 00000100:00080000:1.0:1789785248.249244:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789785248.249248:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789785248.249251:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789785248.249253:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:2.0:1789785248.568082:0:14273:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789785248.568092:0:14273:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789785248.568119:0:14273:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789785248.568127:0:14273:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789785248.712473:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785248.712555:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530152192 00000100:00100000:2.0:1789785248.712566:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530152192 00000100:00100000:2.0:1789785248.712626:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 94 00000100:00100000:2.0:1789785248.712638:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+18:11316:x1876725530152192:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:2.0:1789785248.712661:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785248.712682:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54e00/0x2f18ee3fd845c90b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd872e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785248.712808:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55600/0x2f18ee3fd845c912 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785248.712823:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55600/0x2f18ee3fd845c912 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785248.712834:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55600/0x2f18ee3fd845c912 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789785248.712845:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789785248.712946:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54e00/0x2f18ee3fd845c90b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd872e expref: 21 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785248.712964:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55600/0x2f18ee3fd845c912 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd872e expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785248.712983:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:2.0:1789785248.712986:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789785248.712990:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d55600, rc 0) 00000100:00100000:2.0:1789785248.713054:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+20:11316:x1876725530152192:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 418us (590us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1789785248.713062:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 94 00000100:00100000:3.0:1789785248.718007:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785248.718225:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530152320 00000100:00100000:0.0:1789785248.718235:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530152320 00000100:00100000:0.0:1789785248.718300:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 95 00000100:00100000:0.0:1789785248.718309:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+20:11316:x1876725530152320:12345-192.168.203.46@tcp:34:lfs.0 00010000:00010000:0.0:1789785248.718418:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c920 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718437:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c920 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718449:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c920 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718477:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c927 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718485:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718492:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718568:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c92e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718576:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c92e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718583:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c92e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789785248.718630:0:7896:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c92e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718643:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c920 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718649:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c920 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718657:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c920 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718663:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81ead400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785248.718667:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c920 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718681:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c920 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718694:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:0.0:1789785248.718697:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785248.718702:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c920 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718708:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c920 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718718:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718723:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c927 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718738:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c927 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718744:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eacc00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785248.718747:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c927 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718753:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c927 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718759:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dae8266fa00) 00010000:00010000:0.0:1789785248.718762:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785248.718765:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c927 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718782:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c927 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718796:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c92e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718802:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c92e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718808:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c92e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718812:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eada00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785248.718815:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c92e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718820:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c92e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718828:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dae8266f700) 00010000:00010000:0.0:1789785248.718830:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785248.718833:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c92e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.718838:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c92e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785248.718904:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+20:11316:x1876725530152320:12345-192.168.203.46@tcp:34:lfs.0 Request processed in 595us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785248.718912:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 95 00010000:00010000:0.0:1789785248.771531:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785248.780373:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785248.780573:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530152576 00000100:00100000:1.0:1789785248.780584:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530152576 00000100:00100000:1.0:1789785248.780648:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 96 00000100:00100000:1.0:1789785248.780660:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+20:11319:x1876725530152576:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789785248.780682:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785248.780705:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c935 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8735 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.780794:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c93c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.780808:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c93c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.780834:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c93c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.780850:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c943 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.780857:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c943 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.780864:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c943 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.780977:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c94a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.780985:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c94a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.780992:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c94a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789785248.781000:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789785248.781073:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c93c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.781081:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c93c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.781087:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c93c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.781092:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a64400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785248.781103:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c93c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.781110:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c93c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.781122:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:1.0:1789785248.781125:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785248.781130:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c93c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.781136:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c93c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.781148:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c943 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.781154:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c943 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.781160:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c943 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.781165:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785248.781168:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c943 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.781174:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c943 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.781181:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dae827c3d00) 00010000:00010000:1.0:1789785248.781183:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785248.781192:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c943 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.781198:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c943 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.781239:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c935 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8735 expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.781252:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c94a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8735 expref: 22 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.781259:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dae827c3a00) 00010000:00010000:1.0:1789785248.781262:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789785248.781264:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a65000, rc 0) 00000100:00100000:1.0:1789785248.781313:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+22:11319:x1876725530152576:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 657us (981us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789785248.781318:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 96 00000100:00100000:0.0:1789785248.789996:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785248.790153:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530152704 00000100:00100000:1.0:1789785248.790163:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530152704 00000100:00100000:1.0:1789785248.790255:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 97 00000100:00100000:1.0:1789785248.790267:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+22:11319:x1876725530152704:12345-192.168.203.46@tcp:54:lfs.0 00010000:00010000:1.0:1789785248.790332:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c958 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.790379:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.790392:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.790448:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.790455:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c958 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.790462:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c958 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.790468:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785248.790473:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c958 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.790480:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c958 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.790492:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dae827c3a00) 00010000:00010000:1.0:1789785248.790495:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789785248.790499:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c958 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.790506:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c958 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785248.790582:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+22:11319:x1876725530152704:12345-192.168.203.46@tcp:54:lfs.0 Request processed in 317us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785248.790589:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 97 00000100:00100000:3.0:1789785248.793107:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785248.793247:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530152960 00000100:00100000:1.0:1789785248.793257:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530152960 00000100:00100000:1.0:1789785248.793386:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 21 00000100:00100000:1.0:1789785248.793408:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf88771050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+22:11319:x1876725530152960:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:1.0:1789785248.793632:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf88771050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+23:11319:x1876725530152960:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 225us (533us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1789785248.793639:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 21 00000100:00100000:2.0:1789785248.846054:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785248.847721:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530153216 00000100:00100000:3.0:1789785248.847746:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530153216 00000100:00100000:3.0:1789785248.847821:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 98 00000100:00100000:3.0:1789785248.847834:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf85535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+23:10836:x1876725530153216:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:3.0:1789785248.847858:0:11254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785248.847880:0:11254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845c95f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd873c expref: -99 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785248.847999:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845c966 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785248.848014:0:11254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c94a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8735 expref: 24 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785248.848024:0:11254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845c966 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785248.848058:0:11254:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c94a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8735 expref: 24 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785248.848086:0:11254:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c94a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8735 expref: 24 pid: 6533 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785248.848100:0:11254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11254:1876725549107712:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789785248.848323:0:11254:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8398e000 going to sleep for 11 seconds 00000100:00100000:2.0:1789785248.852485:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785248.852716:0:7484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530153344 00000100:00100000:1.0:1789785248.852736:0:7484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530153344 00010000:00010000:1.0:1789785248.852779:0:7484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c94a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8735 expref: 25 pid: 6533 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785248.852821:0:7484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 65 00000100:00100000:1.0:1789785248.852832:0:7484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf85534e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+25:2397:x1876725530153344:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789785248.852846:0:7484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785248.852853:0:7484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c94a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8735 expref: 25 pid: 6533 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.852865:0:7484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c94a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8735 expref: 25 pid: 6533 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.852888:0:7484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dae827c3a00) 00010000:00010000:1.0:1789785248.852892:0:7484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845c966 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.852900:0:7484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845c966 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.852908:0:7484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845c966 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.852947:0:7484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785248.853017:0:7484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf85534e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+25:2397:x1876725530153344:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 187us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785248.853025:0:7484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 65 00010000:00010000:3.0:1789785248.853869:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c94a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8735 expref: 24 pid: 6533 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785248.853890:0:11254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11254:1876725549107712:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785248.853911:0:11254:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845c966 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785248.853920:0:11254:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845c966 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785248.853926:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845c966 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785248.853944:0:11254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789785248.854094:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845c95f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd873c expref: 25 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785248.854111:0:11254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845c966 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd873c expref: 24 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785248.854119:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dae827c3a00) 00010000:00010000:3.0:1789785248.854130:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789785248.854133:0:11254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814ba600, rc 0) 00000100:00100000:3.0:1789785248.854189:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf85535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+24:10836:x1876725530153216:12345-192.168.203.46@tcp:101:bash.0 Request processed in 6358us (8215us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1789785248.854197:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 98 00000100:00100000:2.0:1789785248.862001:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785248.862889:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530153472 00000100:00100000:1.0:1789785248.862901:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530153472 00000100:00100000:1.0:1789785248.863023:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 99 00000100:00100000:1.0:1789785248.863035:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf85534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+24:10836:x1876725530153472:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:1.0:1789785248.863060:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785248.863083:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c974 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8743 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.863117:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c97b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.863132:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c97b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.863156:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c97b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.863288:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c974 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8743 expref: 26 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.863306:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c97b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8743 expref: 25 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.863314:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dae827c3a00) 00010000:00010000:1.0:1789785248.863325:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789785248.863329:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64000, rc 0) 00000100:00100000:1.0:1789785248.863438:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf85534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+25:10836:x1876725530153472:12345-192.168.203.46@tcp:101:bash.0 Request processed in 405us (1455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785248.863454:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 99 00000100:00100000:1.0:1789785248.870038:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785248.870940:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530153728 00000100:00100000:0.0:1789785248.870953:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530153728 00000100:00100000:0.0:1789785248.871013:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 100 00000100:00100000:0.0:1789785248.871023:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+25:10836:x1876725530153728:12345-192.168.203.46@tcp:36:bash.0 00010000:00010000:0.0:1789785248.871323:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c982 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.871509:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c982 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.871523:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c982 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789785248.871569:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1789785248.871594:0:6534:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000094fa8515 reply state 00000000f19282b7 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c982 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.871605:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c982 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785248.871613:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dae827c3a00) 00010000:00010000:0.0:1789785248.871616:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789785248.871619:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789785248.871741:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1789785248.871842:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+29:10836:x1876725530153728:12345-192.168.203.46@tcp:36:bash.0 Request processed in 818us (1811us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1789785248.871850:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 100 00000020:00080000:0.0:1789785248.871855:0:6534:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789785248.877511:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785248.877756:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530153856 00000100:00100000:3.0:1789785248.877767:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530153856 00000100:00100000:3.0:1789785248.877829:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 101 00000100:00100000:3.0:1789785248.877840:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+29:10836:x1876725530153856:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:3.0:1789785248.877864:0:11254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785248.877884:0:11254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845c989 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd874a expref: -99 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785248.877942:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845c989 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd874a expref: 30 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785248.877958:0:11254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845c989 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd874a expref: 30 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785248.877975:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dae827c3a00) 00010000:00010000:3.0:1789785248.877978:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789785248.877983:0:11254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bb600, rc 0) 00000100:00100000:3.0:1789785248.878051:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+30:10836:x1876725530153856:12345-192.168.203.46@tcp:101:bash.0 Request processed in 212us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785248.878057:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 101 00000100:00100000:2.0:1789785248.884874:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785248.884993:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530153984 00000100:00100000:1.0:1789785248.885012:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530153984 00000100:00100000:1.0:1789785248.885122:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 41 00000100:00100000:1.0:1789785248.885132:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+6:10836:x1876725530153984:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:1.0:1789785248.885157:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785248.885178:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ad73925/0x2f18ee3fd845c990 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8751 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789785248.885203:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aadf49c, atime: 0x6aadf49b, ctime: 0x6aadf49c, blocks: 0x8 00010000:00010000:1.0:1789785248.885224:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=357s v=(0 0) 00010000:00010000:1.0:1789785248.885228:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789785248.885237:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ad73925/0x2f18ee3fd845c990 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8751 expref: 7 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.885254:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009ad73925/0x2f18ee3fd845c990 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8751 expref: 7 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.885266:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64600, rc 0) 00000100:00100000:1.0:1789785248.885320:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+7:10836:x1876725530153984:12345-192.168.203.46@tcp:101:bash.0 Request processed in 190us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785248.885389:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 41 00000100:00100000:1.0:1789785248.889274:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785248.889706:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530154112 00000100:00100000:0.0:1789785248.889736:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530154112 00002000:00010000:0.0:1789785248.889776:0:8455:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1789785248.889782:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dafb5ee4700 with x1876725530154112 ext(0->18446744073709551615) 00002000:00010000:0.0:1789785248.889794:0:8455:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dafb5ee4700. 00000100:00100000:0.0:1789785248.889829:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 1 00000100:00100000:0.0:1789785248.889838:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:026b2112-ee35-499c-8d01-18663664f08e+7:2398:x1876725530154112:12345-192.168.203.46@tcp:10:bash.0 00002000:00010000:0.0:1789785248.890835:0:8455:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789785248.890842:0:8455:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789785244 -> 1789785247 00002000:00010000:0.0:1789785248.890845:0:8455:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1789785243 -> 1789785243 00002000:00010000:0.0:1789785248.890847:0:8455:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789785244 -> 1789785247 00002000:00010000:0.0:1789785248.890849:0:8455:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1789785248.890916:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:026b2112-ee35-499c-8d01-18663664f08e+8:2398:x1876725530154112:12345-192.168.203.46@tcp:10:bash.0 Request processed in 1075us (1648us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789785248.890925:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 1 00002000:00010000:0.0:1789785248.890930:0:8455:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1789785248.890933:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dafb5ee4700 with x1876725530154112 ext(0->18446744073709551615) 00002000:00010000:0.0:1789785248.890939:0:8455:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dafb5ee4700. 00000100:00100000:2.0:1789785248.995323:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785248.995564:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530154240 00000100:00100000:1.0:1789785248.995575:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530154240 00000100:00100000:1.0:1789785248.995642:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 102 00000100:00100000:1.0:1789785248.995653:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+30:11333:x1876725530154240:12345-192.168.203.46@tcp:34:lfs.0 00010000:00010000:1.0:1789785248.995740:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c997 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.995759:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c997 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.995771:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c997 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.995788:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c99e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.995795:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c99e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.995801:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c99e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.995869:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c9a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.995878:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c9a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.995885:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c9a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789785248.995938:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c9a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.995950:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c997 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.995955:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c997 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.995962:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c997 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.995968:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a64400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785248.995972:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c997 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.995980:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c997 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.995992:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:1.0:1789785248.995995:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785248.995999:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c997 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.996005:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c997 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.996019:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c99e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.996026:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c99e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.996051:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c99e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.996247:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785248.996251:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c99e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.996259:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c99e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.996268:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dae827c3200) 00010000:00010000:1.0:1789785248.996270:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785248.996274:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c99e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.996279:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c99e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.996296:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c9a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.996302:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c9a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.996308:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c9a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.996313:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785248.996316:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c9a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.996493:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c9a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.996504:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dae827c3a00) 00010000:00010000:1.0:1789785248.996507:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785248.996510:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c9a5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785248.996516:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c9a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785248.996607:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+30:11333:x1876725530154240:12345-192.168.203.46@tcp:34:lfs.0 Request processed in 954us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785248.996615:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 102 00000100:00100000:2.0:1789785249.080215:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785249.080387:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530154496 00000100:00100000:0.0:1789785249.080398:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530154496 00000100:00100000:0.0:1789785249.080467:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 103 00000100:00100000:0.0:1789785249.080478:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+30:11336:x1876725530154496:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:0.0:1789785249.080500:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785249.080519:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c9ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8758 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.080600:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c9b3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.080627:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c9b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.080639:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c9b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.080656:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c9ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.080664:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c9ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.080671:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c9ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.080792:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c9c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.080801:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.080809:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785249.080818:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789785249.080896:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c9b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.080904:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c9b3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.080910:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c9b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.080922:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eac800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785249.080927:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c9b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.080935:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c9b3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.080949:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:0.0:1789785249.080952:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785249.080957:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c9b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.080963:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845c9b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.080976:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c9ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.080983:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c9ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.080989:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c9ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.080994:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81ead400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785249.080997:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c9ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.081017:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c9ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.081038:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dae8266f700) 00010000:00010000:0.0:1789785249.081040:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785249.081043:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c9ba lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.081050:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845c9ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.081092:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845c9ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8758 expref: 33 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.081107:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c9c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8758 expref: 32 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.081115:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dae827c3a00) 00010000:00010000:0.0:1789785249.081117:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789785249.081120:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eada00, rc 0) 00000100:00100000:0.0:1789785249.081201:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+32:11336:x1876725530154496:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 724us (995us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1789785249.081209:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 103 00000100:00100000:0.0:1789785249.089656:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785249.091471:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530154624 00000100:00100000:1.0:1789785249.091485:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530154624 00000100:00100000:1.0:1789785249.091558:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 104 00000100:00100000:1.0:1789785249.091569:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+32:11336:x1876725530154624:12345-192.168.203.46@tcp:54:lfs.0 00010000:00010000:1.0:1789785249.091636:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c9cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.091653:0:7896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845c966 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd873c expref: 32 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.091665:0:7896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c9cf lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.091699:0:7896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845c966 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd873c expref: 32 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.091741:0:7896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845c966 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd873c expref: 32 pid: 11254 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785249.091756:0:7896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb5ee6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7896:1876725549107840:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789785249.091859:0:7896:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1ae39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789785249.095863:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785249.095987:0:7896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb5ee6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7896:1876725549107840:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789785249.096019:0:7896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c9cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785249.100577:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530154880 00000100:00100000:0.0:1789785249.100592:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530154880 00000100:00100000:0.0:1789785249.100721:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 22 00000100:00100000:0.0:1789785249.100742:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+33:6637:x1876725530154880:12345-192.168.203.46@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789785249.101065:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+34:6637:x1876725530154880:12345-192.168.203.46@tcp:35:ldlm_bl.0 Request processed in 324us (5211us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1789785249.101091:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 22 00000100:00100000:2.0:1789785249.108423:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785249.108562:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530155008 00000100:00100000:0.0:1789785249.108572:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530155008 00010000:00010000:0.0:1789785249.108615:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845c966 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd873c expref: 34 pid: 11254 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785249.108658:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 66 00000100:00100000:0.0:1789785249.108668:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+34:2398:x1876725530155008:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789785249.108681:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785249.108688:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845c966 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd873c expref: 34 pid: 11254 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.108701:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845c966 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd873c expref: 34 pid: 11254 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.108721:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845c966 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd873c expref: 34 pid: 11254 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.108750:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dae827c3a00) 00010000:00010000:0.0:1789785249.108755:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c9cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.108764:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c9cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.108771:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c9cf lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.108825:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785249.108885:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+33:2398:x1876725530155008:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 219us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785249.108894:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 66 00010000:00010000:2.0:1789785249.111070:0:7896:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c9cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.111087:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c9cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.111150:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c9cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.111158:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c9cf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.111184:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c9cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.111189:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785249.111194:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c9cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.111201:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c9cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.111217:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dae827c3a00) 00010000:00010000:2.0:1789785249.111220:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789785249.111224:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c9cf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.111231:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845c9cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785249.111319:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+32:11336:x1876725530154624:12345-192.168.203.46@tcp:54:lfs.0 Request processed in 19747us (21668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785249.111328:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 104 00000100:00100000:2.0:1789785249.118946:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785249.119038:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530155264 00000100:00100000:1.0:1789785249.119050:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530155264 00000100:00100000:1.0:1789785249.119122:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 23 00000100:00100000:1.0:1789785249.119132:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+32:11336:x1876725530155264:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:1.0:1789785249.119568:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+33:11336:x1876725530155264:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 435us (631us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789785249.119577:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 23 00000100:00100000:0.0:1789785249.263651:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785249.263704:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785249.263803:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530155392 00000100:00100000:2.0:1789785249.263813:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530155392 00002000:00100000:2.0:1789785249.263861:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->7) req@ffff9daf87817480 x1876725530155392/t0(0) o4->026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp:380/0 lens 496/0 e 0 to 0 dl 1789785260 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789785249.263872:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9daf87817480 with x1876725530155392 ext(0->7) 00002000:00010000:2.0:1789785249.263877:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9daf87817480 00000100:00100000:2.0:1789785249.263909:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 2 00000100:00100000:2.0:1789785249.263931:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87817480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:026b2112-ee35-499c-8d01-18663664f08e+8:2400:x1876725530155392:12345-192.168.203.46@tcp:4:bash.0 00000100:00100000:1.0:1789785249.264716:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530155520 00000100:00100000:1.0:1789785249.264732:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530155520 00000100:00100000:1.0:1789785249.264776:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 42 00000100:00100000:1.0:1789785249.264785:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+11:2400:x1876725530155520:12345-192.168.203.46@tcp:16:kworker.0 00000100:00100000:1.0:1789785249.266020:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87817480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:026b2112-ee35-499c-8d01-18663664f08e+11:2400:x1876725530155392:12345-192.168.203.46@tcp:4:bash.0 Request processed in 2084us (2309us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789785249.266034:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 2 00002000:00100000:1.0:1789785249.266046:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->7) req@ffff9daf87817480 x1876725530155392/t4294967308(0) o4->026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp:380/0 lens 496/448 e 0 to 0 dl 1789785260 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789785249.266063:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9daf87817480 with x1876725530155392 ext(0->7) 00002000:00010000:1.0:1789785249.266068:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9daf87817480 00000001:00080000:2.0:1789785249.268002:0:8445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1789785249.268021:0:8445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:1.0:1789785249.268195:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+6:2400:x1876725530155520:12345-192.168.203.46@tcp:16:kworker.0 Request processed in 3406us (4549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785249.268205:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 42 00000100:00100000:0.0:1789785249.272891:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785249.273008:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530155776 00000100:00100000:1.0:1789785249.273018:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530155776 00000100:00100000:1.0:1789785249.273176:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 105 00000100:00100000:1.0:1789785249.273185:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+33:11347:x1876725530155776:12345-192.168.203.46@tcp:101:cat.0 00010000:00010000:1.0:1789785249.273207:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785249.273225:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c9d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd875f expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.273305:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c9dd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.273320:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c9dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.273331:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c9dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.273375:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c9e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.273382:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c9e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.273388:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c9e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.273684:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c9eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.273696:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c9eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.273702:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c9eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789785249.273712:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789785249.273796:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c9dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.273803:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c9dd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.273808:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c9dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.273813:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a64400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785249.273818:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c9dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.273825:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c9dd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.273838:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:1.0:1789785249.273841:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785249.273845:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c9dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.273862:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845c9dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.273879:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c9e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.273886:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c9e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.273890:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c9e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.273894:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785249.273897:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c9e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.273903:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c9e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.273910:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dae827c3200) 00010000:00010000:1.0:1789785249.273913:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785249.273915:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c9e4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.273920:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845c9e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.273962:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845c9d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd875f expref: 36 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.273975:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c9eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd875f expref: 35 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.273989:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dae827c3a00) 00010000:00010000:1.0:1789785249.273991:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789785249.273994:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64200, rc 0) 00000100:00100000:1.0:1789785249.274246:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+35:11347:x1876725530155776:12345-192.168.203.46@tcp:101:cat.0 Request processed in 1060us (1362us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1789785249.274255:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 105 00000100:00100000:3.0:1789785249.278419:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785249.278596:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530156032 00000100:00100000:0.0:1789785249.278605:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530156032 00000100:00100000:0.0:1789785249.278654:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 24 00000100:00100000:0.0:1789785249.278663:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+35:11347:x1876725530156032:12345-192.168.203.46@tcp:35:cat.0 00000100:00100000:0.0:1789785249.278937:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+36:11347:x1876725530156032:12345-192.168.203.46@tcp:35:cat.0 Request processed in 275us (528us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789785249.278945:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 24 00000100:00100000:2.0:1789785249.310947:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785249.311292:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530156288 00000100:00100000:3.0:1789785249.311320:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530156288 00000100:00100000:3.0:1789785249.311413:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 106 00000100:00100000:3.0:1789785249.311424:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+36:11348:x1876725530156288:12345-192.168.203.46@tcp:36:rm.0 00010000:00010000:3.0:1789785249.311512:0:11254:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1789785249.311540:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845c989 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd874a expref: 36 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.311577:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845c9eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd875f expref: 35 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.311591:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845c9c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8758 expref: 34 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.311603:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845c97b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8743 expref: 33 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.311625:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dae827c3a00) 00010000:00010000:3.0:1789785249.311630:0:11254:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789785249.311660:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c9f9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.311673:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c9f9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.311682:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c9f9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.311696:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845ca00 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.311714:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845ca00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.311721:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845ca00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.311811:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845ca07 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.311821:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845ca07 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.311828:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845ca07 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789785249.312049:0:11254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1789785249.312060:0:11254:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 357565721182ns, next at 358565718729ns, rc = 0 00010000:00010000:3.0:1789785249.312108:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845ca0e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.312117:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845ca0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.312125:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845ca0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.312132:0:11254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845ca0e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.312139:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845ca0e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.312156:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845ca0e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.312921:0:11254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789785249.312950:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845ca07 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.312957:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845ca07 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.312963:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845ca07 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.312968:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bba00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785249.312973:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845ca07 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.312979:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845ca07 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.312990:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dae827c3a00) 00010000:00010000:3.0:1789785249.312993:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789785249.313008:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845ca07 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.313014:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845ca07 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.313033:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c9f9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.313038:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c9f9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.313051:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c9f9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.313056:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814baa00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785249.313059:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c9f9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.313066:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c9f9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.313074:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:3.0:1789785249.313076:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785249.313080:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c9f9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.313085:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845c9f9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789785249.313096:0:11254:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008ec4e23 reply state 00000000faa42c19 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845ca00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.313106:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845ca00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.313112:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dafac970e00) 00010000:00010000:3.0:1789785249.313114:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789785249.313116:0:11254:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789785249.313207:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+34:11348:x1876725530156288:12345-192.168.203.46@tcp:36:rm.0 Request processed in 1782us (2279us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1789785249.313215:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 106 00010000:00010000:2.0:1789785249.314449:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789785249.314467:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845ca0e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.314477:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bbc00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:2.0:1789785249.314481:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845ca0e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.314489:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845ca0e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.314503:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dae827c3a00) 00010000:00010000:2.0:1789785249.314505:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789785249.314509:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845ca0e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.314516:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845ca0e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.314530:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785249.314531:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785249.314533:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785249.361465:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785249.361671:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530156544 00000100:00100000:1.0:1789785249.361680:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530156544 00000100:00100000:1.0:1789785249.361741:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 107 00000100:00100000:1.0:1789785249.361752:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+34:11354:x1876725530156544:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:1.0:1789785249.361776:0:7896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785249.361795:0:7896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845ca15 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8766 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.361887:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845ca1c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.361903:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845ca1c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.361915:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845ca1c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.361938:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845ca23 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.361946:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845ca23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.361970:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845ca23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789785249.365434:0:7896:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1789785249.365590:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ca2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.365606:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ca2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.365616:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ca2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.365654:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845ca1c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.365661:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845ca1c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.365668:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845ca1c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.365673:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a64400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785249.365677:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845ca1c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.365684:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845ca1c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.365697:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:1.0:1789785249.365700:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785249.365718:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845ca1c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.365735:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845ca1c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789785249.365750:0:7896:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d327b6f8 reply state 000000009d21ef41 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845ca23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.365761:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845ca23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.365768:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dafac970e00) 00010000:00010000:1.0:1789785249.365770:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789785249.365773:0:7896:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789785249.365805:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845ca15 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8766 expref: 37 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.365820:0:7896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ca2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8766 expref: 36 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.365827:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3200) 00010000:00010000:1.0:1789785249.365829:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789785249.365832:0:7896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a65800, rc 0) 00000100:00100000:1.0:1789785249.365909:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+37:11354:x1876725530156544:12345-192.168.203.46@tcp:101:bash.0 Request processed in 4158us (4451us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1789785249.365917:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 107 00000100:00100000:1.0:1789785249.369305:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785249.371700:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530156672 00000100:00100000:0.0:1789785249.371715:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530156672 00000100:00100000:0.0:1789785249.371794:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 43 00000100:00100000:0.0:1789785249.371805:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+7:2398:x1876725530156672:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:0.0:1789785249.371830:0:8805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785249.371850:0:8805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9fcc1ed/0x2f18ee3fd845ca38 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd876d expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789785249.371874:0:8805:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789785249.371903:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=357s v=(0 0) 00010000:00010000:0.0:1789785249.371907:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789785249.371933:0:8805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9fcc1ed/0x2f18ee3fd845ca38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd876d expref: 8 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.371955:0:8805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d9fcc1ed/0x2f18ee3fd845ca38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd876d expref: 8 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.371969:0:8805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81ead400, rc 0) 00000100:00100000:0.0:1789785249.372037:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+8:2398:x1876725530156672:12345-192.168.203.46@tcp:101:bash.0 Request processed in 234us (2741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785249.372045:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 43 00000100:00100000:2.0:1789785249.375985:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785249.376079:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530156800 00000100:00100000:0.0:1789785249.376089:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530156800 00000100:00100000:0.0:1789785249.376189:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 44 00000100:00100000:0.0:1789785249.376201:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+8:11354:x1876725530156800:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:0.0:1789785249.376218:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785249.376238:0:8451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c1c0c1e/0x2f18ee3fd845ca3f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8774 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.376271:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9fcc1ed/0x2f18ee3fd845ca38 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd876d expref: 9 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.376281:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789785249.376285:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789785249.376291:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c1c0c1e/0x2f18ee3fd845ca3f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8774 expref: 9 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.376384:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d9fcc1ed/0x2f18ee3fd845ca38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd876d expref: 9 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.376405:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d9fcc1ed/0x2f18ee3fd845ca38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd876d expref: 9 pid: 8805 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785249.376418:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8451:1876725549107968:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789785249.376515:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab2180 going to sleep for 11 seconds 00000100:00100000:2.0:1789785249.382403:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785249.382529:0:7484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530156928 00000100:00100000:1.0:1789785249.382539:0:7484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530156928 00010000:00010000:1.0:1789785249.382602:0:7484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d9fcc1ed/0x2f18ee3fd845ca38 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd876d expref: 10 pid: 8805 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785249.382646:0:7484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 67 00000100:00100000:1.0:1789785249.382655:0:7484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+10:2397:x1876725530156928:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789785249.382669:0:7484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785249.382691:0:7484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d9fcc1ed/0x2f18ee3fd845ca38 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd876d expref: 10 pid: 8805 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.382705:0:7484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d9fcc1ed/0x2f18ee3fd845ca38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd876d expref: 10 pid: 8805 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.382742:0:7484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789785249.382747:0:7484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789785249.382756:0:7484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c1c0c1e/0x2f18ee3fd845ca3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8774 expref: 10 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.382767:0:7484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c1c0c1e/0x2f18ee3fd845ca3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8774 expref: 10 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.382806:0:7484:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007c1c0c1e/0x2f18ee3fd845ca3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8774 expref: 10 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785249.382832:0:7484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7484:1876725549108096:192.168.203.46@tcp:105: 00000100:00100000:1.0:1789785249.382912:0:7484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1ae3e40 going to sleep for 11 seconds 00010000:00010000:0.0:1789785249.383393:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9fcc1ed/0x2f18ee3fd845ca38 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd876d expref: 10 pid: 8805 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785249.383410:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8451:1876725549107968:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789785249.383448:0:8451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007c1c0c1e/0x2f18ee3fd845ca3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8774 expref: 9 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.383461:0:8451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eac800, rc 0) 00000100:00100000:0.0:1789785249.383504:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+9:11354:x1876725530156800:12345-192.168.203.46@tcp:101:bash.0 Request processed in 7305us (7527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785249.383511:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 44 00000100:00100000:2.0:1789785249.390482:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785249.390574:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530157184 00000100:00100000:0.0:1789785249.390584:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530157184 00000100:00100000:0.0:1789785249.390634:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 25 00000100:00100000:0.0:1789785249.390645:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+37:11354:x1876725530157184:12345-192.168.203.46@tcp:35:bash.0 00000100:00100000:0.0:1789785249.390934:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+38:11354:x1876725530157184:12345-192.168.203.46@tcp:35:bash.0 Request processed in 291us (459us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1789785249.390942:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 25 00000100:00100000:1.0:1789785249.394277:0:7484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7484:1876725549108096:192.168.203.46@tcp:105: 00010000:00010000:1.0:1789785249.394322:0:7484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785249.394409:0:7484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+8:2397:x1876725530156928:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 11753us (12013us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785249.394421:0:7484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 67 00000100:00100000:2.0:1789785249.557275:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785249.557510:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530157312 00000100:00100000:1.0:1789785249.557520:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530157312 00000100:00100000:1.0:1789785249.557628:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 108 00000100:00100000:1.0:1789785249.557639:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+38:11370:x1876725530157312:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789785249.557662:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785249.557684:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845ca46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd877b expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.557762:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845ca4d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.557779:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845ca4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.557791:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845ca4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789785249.557836:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789785249.557840:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789785249.557860:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845ca4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.557884:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845ca46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd877b expref: 40 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.557916:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845ca4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd877b expref: 39 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.557938:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:1.0:1789785249.557941:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789785249.557945:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64a00, rc 0) 00000100:00100000:1.0:1789785249.558009:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+39:11370:x1876725530157312:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 371us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785249.558015:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 108 00000100:00100000:3.0:1789785249.561586:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785249.561756:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530157568 00000100:00100000:1.0:1789785249.561766:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530157568 00000100:00100000:1.0:1789785249.561828:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 109 00000100:00100000:1.0:1789785249.561838:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+39:11370:x1876725530157568:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789785249.561860:0:11254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785249.561880:0:11254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845ca54 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8782 expref: -99 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.562048:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845ca5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.562063:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845ca5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.562076:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845ca5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789785249.562087:0:11254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789785249.562191:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845ca54 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8782 expref: 42 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.562242:0:11254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845ca5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8782 expref: 41 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.562251:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3200) 00010000:00010000:1.0:1789785249.562254:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789785249.562258:0:11254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a65c00, rc 0) 00000100:00100000:1.0:1789785249.562328:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+41:11370:x1876725530157568:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 490us (749us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1789785249.562359:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 109 00000100:00100000:3.0:1789785249.565460:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785249.565650:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530157696 00000100:00100000:0.0:1789785249.565660:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530157696 00000100:00100000:0.0:1789785249.565733:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:0.0:1789785249.565744:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+41:2398:x1876725530157696:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789785249.565758:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785249.565782:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845ca5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8782 expref: 41 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.565799:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3200) 00010000:00010000:0.0:1789785249.565804:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785249.565860:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+40:2398:x1876725530157696:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 119us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785249.565867:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:2.0:1789785249.568521:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785249.568575:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530157952 00000100:00100000:1.0:1789785249.568586:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530157952 00000100:00100000:1.0:1789785249.568651:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 110 00000100:00100000:1.0:1789785249.568661:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+40:11370:x1876725530157952:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789785249.568685:0:7896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785249.568705:0:7896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845ca69 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8789 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.568820:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845ca70 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.568834:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845ca70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.568846:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845ca70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789785249.568859:0:7896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789785249.568972:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845ca69 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8789 expref: 43 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.568991:0:7896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845ca70 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8789 expref: 42 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.568999:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3200) 00010000:00010000:1.0:1789785249.569002:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789785249.569005:0:7896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64000, rc 0) 00000100:00100000:1.0:1789785249.569061:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+42:11370:x1876725530157952:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 401us (548us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1789785249.569068:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 110 00000100:00100000:3.0:1789785249.577036:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785249.577525:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530158080 00000100:00100000:0.0:1789785249.577535:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530158080 00000100:00100000:0.0:1789785249.577602:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 45 00000100:00100000:0.0:1789785249.577870:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+8:2397:x1876725530158080:12345-192.168.203.46@tcp:1:lfs.0 00010000:00010000:0.0:1789785249.577917:0:8805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9fcc1ed/0x2f18ee3fd845ca7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.577938:0:8805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c1c0c1e/0x2f18ee3fd845ca3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8774 expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.577947:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789785249.577951:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789785249.577956:0:8805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9fcc1ed/0x2f18ee3fd845ca7e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.578011:0:8805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c1c0c1e/0x2f18ee3fd845ca3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8774 expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.578026:0:8805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c1c0c1e/0x2f18ee3fd845ca3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8774 expref: 8 pid: 8451 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785249.578042:0:8805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8805:1876725549108224:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789785249.579360:0:8805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab2180 going to sleep for 11 seconds 00000100:00100000:0.0:1789785249.585013:0:8805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8805:1876725549108224:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789785249.585046:0:8805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d9fcc1ed/0x2f18ee3fd845ca7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785249.585755:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785249.586534:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530158208 00000100:00100000:0.0:1789785249.586552:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530158208 00002000:00100000:0.0:1789785249.586599:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9dae844c1880 x1876725530158208/t0(0) o4->026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp:380/0 lens 504/0 e 0 to 0 dl 1789785260 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789785249.586620:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dae844c1880 with x1876725530158208 ext(0->8) 00010000:00010000:0.0:1789785249.586627:0:8455:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007c1c0c1e/0x2f18ee3fd845ca3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8774 expref: 9 pid: 8451 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.586642:0:8455:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007c1c0c1e/0x2f18ee3fd845ca3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8774 expref: 9 pid: 8451 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789785249.586650:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9dae844c1880 00000100:00100000:0.0:1789785249.586688:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 1 00000100:00100000:0.0:1789785249.586697:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:026b2112-ee35-499c-8d01-18663664f08e+9:2397:x1876725530158208:12345-192.168.203.46@tcp:4:lfs.0 00000001:00080000:3.0:1789785249.589514:0:9529:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1789785249.589531:0:9529:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1789785249.590325:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:026b2112-ee35-499c-8d01-18663664f08e+7:2397:x1876725530158208:12345-192.168.203.46@tcp:4:lfs.0 Request processed in 3620us (4564us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789785249.590354:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 1 00002000:00100000:0.0:1789785249.590367:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9dae844c1880 x1876725530158208/t4294967303(0) o4->026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp:380/0 lens 504/448 e 0 to 0 dl 1789785260 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789785249.590377:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dae844c1880 with x1876725530158208 ext(0->8) 00010000:00010000:0.0:1789785249.590387:0:8455:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007c1c0c1e/0x2f18ee3fd845ca3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8774 expref: 7 pid: 8451 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.590406:0:8455:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007c1c0c1e/0x2f18ee3fd845ca3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8774 expref: 7 pid: 8451 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789785249.590415:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9dae844c1880 00000100:00100000:3.0:1789785249.598776:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785249.599020:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530158336 00000100:00100000:0.0:1789785249.599040:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530158336 00010000:00010000:0.0:1789785249.599080:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c1c0c1e/0x2f18ee3fd845ca3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8774 expref: 7 pid: 8451 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785249.599179:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 68 00000100:00100000:0.0:1789785249.599189:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+7:2400:x1876725530158336:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789785249.599204:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789785249.599222:0:6520:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789785249.599225:0:6520:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789785248 00002000:00010000:0.0:1789785249.599239:0:6520:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789785248 00002000:00010000:0.0:1789785249.599242:0:6520:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789785248 00002000:00010000:0.0:1789785249.599244:0:6520:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789785249.599252:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c1c0c1e/0x2f18ee3fd845ca3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8774 expref: 7 pid: 8451 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.599267:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c1c0c1e/0x2f18ee3fd845ca3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8774 expref: 7 pid: 8451 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.599291:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c1c0c1e/0x2f18ee3fd845ca3f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8774 expref: 7 pid: 8451 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.599309:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789785249.599315:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789785249.599321:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9fcc1ed/0x2f18ee3fd845ca7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.599331:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9fcc1ed/0x2f18ee3fd845ca7e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.599416:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785249.599474:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+6:2400:x1876725530158336:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 286us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785249.599482:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 68 00010000:00010000:2.0:1789785249.599580:0:8805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d9fcc1ed/0x2f18ee3fd845ca7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.599591:0:8805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9fcc1ed/0x2f18ee3fd845ca7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.599619:0:8805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9fcc1ed/0x2f18ee3fd845ca7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.599627:0:8805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9fcc1ed/0x2f18ee3fd845ca7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.599635:0:8805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9fcc1ed/0x2f18ee3fd845ca7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.599642:0:8805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81ead400 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:2.0:1789785249.599645:0:8805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9fcc1ed/0x2f18ee3fd845ca7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.599653:0:8805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9fcc1ed/0x2f18ee3fd845ca7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.599664:0:8805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9fcc1ed/0x2f18ee3fd845ca7e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.599683:0:8805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9fcc1ed/0x2f18ee3fd845ca7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785249.599734:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530158080:12345-192.168.203.46@tcp:1:lfs.0 Request processed in 21869us (22706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785249.599741:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 45 00000100:00100000:3.0:1789785249.602879:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549108352:0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.602961:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785249.602998:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549108864:0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.603057:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785249.603078:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549109376:0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.603103:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785249.603122:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549109888:0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.603141:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785249.603160:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789785249.603166:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549108480:0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.603185:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785249.603201:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549108992:0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.603218:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785249.603233:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549109504:0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.603253:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785249.603279:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549108608:0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.603300:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785249.603314:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725549109120:0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.603363:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785249.603378:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549109632:0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.603398:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785249.603418:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789785249.603424:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549108736:0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.603442:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785249.603453:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549109248:0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.603472:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785249.603489:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549109760:0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.603507:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785249.603536:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549109376 00000100:00100000:3.0:1789785249.603542:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549109376 00000100:00100000:3.0:1789785249.603585:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549109888 00000100:00100000:3.0:1789785249.603589:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549109888 00000100:00100000:3.0:1789785249.603603:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549109248 00000100:00100000:3.0:1789785249.603605:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549109248 00000100:00100000:3.0:1789785249.603616:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549109760 00000100:00100000:3.0:1789785249.603618:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549109760 00000100:00100000:3.0:1789785249.603633:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789785249.603641:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549109376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.603691:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549109376:12345-0@lo:400:kworker.0 Request processed in 50us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785249.603698:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789785249.603714:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789785249.603732:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549109888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.603760:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549109888:12345-0@lo:400:kworker.0 Request processed in 40us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785249.603777:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789785249.603790:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789785249.603796:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549109248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.603834:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549109248:12345-0@lo:400:kworker.0 Request processed in 38us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785249.603840:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789785249.603851:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789785249.603857:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549109760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.603882:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549109760:12345-0@lo:400:kworker.0 Request processed in 26us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785249.603887:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:3.0:1789785249.603902:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789785249.603905:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789785249.603931:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549109248:0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.603942:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549109760:0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.603973:0:3659:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1789785249.603977:0:3659:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1789785249.603991:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549109376:0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.604001:0:3659:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:3.0:1789785249.604004:0:3659:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:3.0:1789785249.604020:0:3659:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dafbf50ce00, transno 4294967302 00000100:00100000:3.0:1789785249.604030:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549109888:0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.604138:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549108480 00000100:00100000:3.0:1789785249.604142:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549108480 00000100:00100000:3.0:1789785249.604167:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549108992 00000100:00100000:3.0:1789785249.604169:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549108992 00000100:00100000:3.0:1789785249.604183:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549109504 00000100:00100000:3.0:1789785249.604185:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549109504 00000100:00100000:3.0:1789785249.604195:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549109120 00000100:00100000:3.0:1789785249.604197:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549109120 00000100:00100000:3.0:1789785249.604206:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549109632 00000100:00100000:3.0:1789785249.604209:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549109632 00000100:00100000:3.0:1789785249.604218:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549108736 00000100:00100000:3.0:1789785249.604221:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549108736 00000100:00100000:3.0:1789785249.604233:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789785249.604239:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549108480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.604273:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549108480:12345-0@lo:400:kworker.0 Request processed in 34us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785249.604279:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789785249.604291:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1789785249.604297:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549108992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.604320:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549108992:12345-0@lo:400:kworker.0 Request processed in 24us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785249.604326:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1789785249.604335:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1789785249.604364:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549109504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.604391:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549109504:12345-0@lo:400:kworker.0 Request processed in 28us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785249.604396:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1789785249.604408:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1789785249.604414:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725549109120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.604445:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725549109120:12345-0@lo:400:kworker.0 Request processed in 31us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785249.604456:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1789785249.604469:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789785249.604475:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549109632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.604503:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549109632:12345-0@lo:400:kworker.0 Request processed in 29us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785249.604508:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789785249.604519:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1789785249.604525:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549108736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.604550:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549108736:12345-0@lo:400:kworker.0 Request processed in 25us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785249.604556:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00080000:3.0:1789785249.604571:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789785249.604574:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789785249.604591:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549108736:0@lo:400:kworker.0 00010000:00080000:3.0:1789785249.604604:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae844c0a80 x1876725549109120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785249.604614:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725549109120:0@lo:400:kworker.0 00010000:00080000:3.0:1789785249.604624:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae844c0380 x1876725549109632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785249.604633:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549109632:0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.604660:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549108480:0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.604669:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549108992:0@lo:400:kworker.0 00000100:00100000:3.0:1789785249.604677:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549109504:0@lo:400:kworker.0 00000100:00100000:0.0:1789785249.605474:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549108864 00000100:00100000:0.0:1789785249.605481:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549108864 00000100:00100000:0.0:1789785249.605513:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549108608 00000100:00100000:0.0:1789785249.605516:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549108608 00000100:00100000:0.0:1789785249.605545:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789785249.605553:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549108864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785249.605618:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549108864:12345-0@lo:400:kworker.0 Request processed in 65us (2560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785249.605624:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789785249.605641:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789785249.605647:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549108608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785249.605687:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549108608:12345-0@lo:400:kworker.0 Request processed in 40us (2386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785249.605693:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789785249.605718:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549110016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789785249.605762:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785249.605794:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549110016 00000100:00100000:0.0:1789785249.605798:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549110016 00000100:00100000:0.0:1789785249.605817:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789785249.605823:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549110016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789785249.606706:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789785249.606778:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549110016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 954us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785249.606786:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789785249.607206:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549108352 00000100:00100000:2.0:1789785249.607213:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549108352 00000100:00100000:2.0:1789785249.607252:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1789785249.607260:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:3659:x1876725549108352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785249.607302:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:3659:x1876725549108352:12345-0@lo:400:kworker.0 Request processed in 43us (4341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785249.607307:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1789785249.607385:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789785249.607396:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549110144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789785249.607426:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785249.607455:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549110144 00000100:00100000:2.0:1789785249.607459:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549110144 00000100:00100000:2.0:1789785249.607486:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789785249.607493:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549110144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789785249.607506:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3691950080 00000100:00100000:2.0:1789785249.607540:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549110144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785249.607546:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789785249.607578:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549110144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789785249.607681:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549108352:0@lo:400:kworker.0 00000100:00100000:2.0:1789785249.607691:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549108864:0@lo:400:kworker.0 00000100:00100000:2.0:1789785249.607736:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549108608:0@lo:400:kworker.0 00000100:00100000:0.0:1789785249.608020:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549110016:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789785249.609992:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549110272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789785249.610129:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785249.610302:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549110272 00000100:00100000:0.0:1789785249.610309:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549110272 00000100:00100000:0.0:1789785249.610401:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789785249.610410:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549110272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789785249.610429:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3691950080 00000100:00100000:2.0:1789785249.610966:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785249.611916:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530158592 00000100:00100000:3.0:1789785249.612086:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530158592 00000100:00100000:3.0:1789785249.612133:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 26 00000100:00100000:3.0:1789785249.612141:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf88772050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+42:11370:x1876725530158592:12345-192.168.203.46@tcp:35:lfs.0 00000004:00010000:3.0:1789785249.612193:0:6536:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845ca70 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8789 expref: 42 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785249.612497:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549110272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2086us (2365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785249.612507:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000001:00080000:3.0:1789785249.613784:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1789785249.613848:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1789785249.614223:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:3.0:1789785249.614265:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845ca85 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.614286:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ca2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8766 expref: 46 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.614295:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845ca85 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.614332:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ca2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8766 expref: 46 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.614367:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ca2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8766 expref: 46 pid: 7896 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785249.614381:0:6536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf540380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6536:1876725549110400:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789785249.614862:0:6536:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8398e000 going to sleep for 11 seconds 00000100:00100000:1.0:1789785249.615186:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549110272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789785249.619853:0:6536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf540380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6536:1876725549110400:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789785249.619881:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845ca85 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785249.620029:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785249.620119:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530158720 00000100:00100000:0.0:1789785249.620126:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530158720 00010000:00010000:0.0:1789785249.620157:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ca2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8766 expref: 47 pid: 7896 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785249.620197:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 69 00000100:00100000:0.0:1789785249.620207:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf543480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+47:2398:x1876725530158720:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789785249.620219:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785249.620226:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ca2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8766 expref: 47 pid: 7896 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.620237:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ca2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8766 expref: 47 pid: 7896 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.620257:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ca2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8766 expref: 47 pid: 7896 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.620273:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3200) 00010000:00010000:0.0:1789785249.620278:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845ca85 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.620297:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845ca85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.620304:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845ca85 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.620335:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785249.620441:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf543480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+46:2398:x1876725530158720:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 234us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785249.620449:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 69 00010000:00010000:2.0:1789785249.620616:0:6536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845ca85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.620622:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845ca85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789785249.620731:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1789785249.620839:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1789785249.620988:0:6536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4bf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6536:1876725549110528:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789785249.621033:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785249.621161:0:6536:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf85440840 going to sleep for 11 seconds 00000100:00100000:0.0:1789785249.621203:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549110528 00000100:00100000:0.0:1789785249.621208:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549110528 00000100:00100000:0.0:1789785249.621276:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789785249.621285:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6536:x1876725549110528:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789785249.621497:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6536:x1876725549110528:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 213us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785249.621505:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789785249.621702:0:6536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4bf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6536:1876725549110528:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789785249.621827:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1789785249.621864:0:6536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4bf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6536:1876725549110656:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789785249.621886:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785249.621905:0:6536:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf85440cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789785249.621988:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549110656 00000100:00100000:0.0:1789785249.621993:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549110656 00000100:00100000:0.0:1789785249.622020:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789785249.622027:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6536:x1876725549110656:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789785249.622190:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6536:x1876725549110656:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 159us (298us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789785249.622197:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789785249.622220:0:6536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4bf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6536:1876725549110656:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789785249.622254:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1789785249.622283:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845ca85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.622305:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845ca85 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.622312:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845ca85 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.622317:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bba00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785249.622321:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845ca85 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.622329:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845ca85 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.622473:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3200) 00010000:00010000:2.0:1789785249.622477:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789785249.622482:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845ca85 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.622489:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845ca85 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789785249.622589:0:6536:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789785249.622654:0:6536:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1789785249.622676:0:6536:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 357876336929ns, next at 358876334275ns, rc = 0 00000001:00080000:2.0:1789785249.622682:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1789785249.622707:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3200) 00010000:00010000:2.0:1789785249.622710:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789785249.622716:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845ca70 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8789 expref: 50 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785249.622818:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf88772050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+49:11370:x1876725530158592:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 10678us (11856us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1789785249.622823:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 26 00000020:00080000:2.0:1789785249.622826:0:6536:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789785249.625218:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785249.625317:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530158848 00000100:00100000:1.0:1789785249.625326:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530158848 00000100:00100000:1.0:1789785249.625407:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 111 00000100:00100000:1.0:1789785249.625418:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+49:11370:x1876725530158848:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789785249.625440:0:11254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785249.625471:0:11254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845ca8c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8790 expref: -99 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.625531:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845ca8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8790 expref: 50 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.625552:0:11254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845ca8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8790 expref: 50 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.625586:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:1.0:1789785249.625590:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789785249.625594:0:11254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64400, rc 0) 00000100:00100000:1.0:1789785249.625651:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+50:11370:x1876725530158848:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 235us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785249.625658:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 111 00000100:00100000:3.0:1789785249.632866:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785249.633129:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530159104 00000100:00100000:2.0:1789785249.633139:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530159104 00000100:00100000:2.0:1789785249.633196:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 27 00000100:00100000:2.0:1789785249.633207:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+50:11370:x1876725530159104:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:2.0:1789785249.634034:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+51:11370:x1876725530159104:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 824us (1173us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789785249.634043:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 27 00000100:00100000:2.0:1789785249.719210:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785249.719478:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530159232 00000100:00100000:3.0:1789785249.719590:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530159232 00000100:00100000:3.0:1789785249.719654:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 112 00000100:00100000:3.0:1789785249.719665:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+51:11380:x1876725530159232:12345-192.168.203.46@tcp:34:lfs.0 00010000:00010000:3.0:1789785249.719747:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ca93 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.719765:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ca93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.719776:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ca93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.719787:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845ca9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.719793:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845ca9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.719799:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845ca9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.719872:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845caa1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.719880:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845caa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.719887:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845caa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789785249.719950:0:7896:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845caa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.719962:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ca93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.719968:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ca93 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.719974:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ca93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.719979:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bb600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785249.719983:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ca93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.719990:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ca93 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.720001:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:3.0:1789785249.720004:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785249.720009:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ca93 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.720014:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ca93 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.720028:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845ca9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.720034:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845ca9a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.720100:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845ca9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.720105:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814baa00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785249.720107:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845ca9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.720113:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845ca9a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.720122:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dafac970e00) 00010000:00010000:3.0:1789785249.720124:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785249.720127:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845ca9a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.720132:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845ca9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.720142:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845caa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.720658:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845caa1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.720668:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845caa1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.720673:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bb200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785249.720676:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845caa1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.720692:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845caa1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.720701:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:3.0:1789785249.720703:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785249.720707:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845caa1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.720713:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845caa1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785249.720842:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+51:11380:x1876725530159232:12345-192.168.203.46@tcp:34:lfs.0 Request processed in 1178us (1641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785249.720851:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 112 00000100:00100000:3.0:1789785249.767876:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785249.768065:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530159488 00000100:00100000:2.0:1789785249.768074:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530159488 00000100:00100000:2.0:1789785249.768137:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 113 00000100:00100000:2.0:1789785249.768146:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+51:11383:x1876725530159488:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:2.0:1789785249.768164:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785249.768181:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845caa8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8797 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.768246:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845caaf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.768260:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845caaf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.768299:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845caaf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.768311:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845cab6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.768319:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845cab6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.768325:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845cab6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.768467:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cabd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.768475:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cabd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.768482:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cabd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789785249.768491:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789785249.768554:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845caaf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.768561:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845caaf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.768567:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845caaf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.768573:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785249.768582:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845caaf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.768590:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845caaf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.768601:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:2.0:1789785249.768604:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785249.768608:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845caaf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.768614:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845caaf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.768627:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845cab6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.768632:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845cab6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.768637:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845cab6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.768643:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785249.768646:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845cab6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.768651:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845cab6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.768657:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dafac970e00) 00010000:00010000:2.0:1789785249.768659:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785249.768666:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845cab6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.768672:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845cab6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.768703:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845caa8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8797 expref: 54 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.768909:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cabd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8797 expref: 53 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785249.768969:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:2.0:1789785249.768972:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789785249.768975:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d55200, rc 0) 00000100:00100000:2.0:1789785249.769031:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+53:11383:x1876725530159488:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 886us (1163us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1789785249.769039:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 113 00000100:00100000:2.0:1789785249.771285:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785249.771413:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530159616 00000100:00100000:3.0:1789785249.771422:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530159616 00000100:00100000:3.0:1789785249.771476:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 114 00000100:00100000:3.0:1789785249.771485:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+53:11383:x1876725530159616:12345-192.168.203.46@tcp:54:lfs.0 00010000:00010000:3.0:1789785249.771549:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cacb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.771565:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cacb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.771576:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cacb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.771607:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cacb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.771625:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cacb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.771632:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cacb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.771637:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bb200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785249.771642:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cacb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.771650:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cacb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.771660:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:3.0:1789785249.771663:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789785249.771666:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cacb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.771672:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cacb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785249.771852:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+53:11383:x1876725530159616:12345-192.168.203.46@tcp:54:lfs.0 Request processed in 360us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785249.771860:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 114 00000100:00100000:3.0:1789785249.774576:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785249.778501:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530159872 00000100:00100000:2.0:1789785249.778514:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530159872 00000100:00100000:2.0:1789785249.778591:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 28 00000100:00100000:2.0:1789785249.778601:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+53:11383:x1876725530159872:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:2.0:1789785249.778829:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+54:11383:x1876725530159872:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 228us (4259us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1789785249.778837:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 28 00010000:00010000:0.0:1789785249.794729:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785249.879833:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785249.880153:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530160128 00000100:00100000:3.0:1789785249.880163:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530160128 00000100:00100000:3.0:1789785249.880269:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 115 00000100:00100000:3.0:1789785249.880280:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+54:11393:x1876725530160128:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:3.0:1789785249.880318:0:7896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785249.880320:0:7896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789785249.880383:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845ca4d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd877b expref: 54 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.880403:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:3.0:1789785249.880408:0:7896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789785249.880419:0:7896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845cad2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd879e expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.880519:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cad9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.880541:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cad9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.880551:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cad9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785249.880560:0:7896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789785249.880656:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845cad2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd879e expref: 56 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.880671:0:7896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cad9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd879e expref: 55 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785249.880678:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:3.0:1789785249.880681:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789785249.880684:0:7896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bb200, rc 0) 00000100:00100000:3.0:1789785249.880754:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+55:11393:x1876725530160128:12345-192.168.203.46@tcp:101:bash.0 Request processed in 475us (935us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1789785249.880761:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 115 00000100:00100000:3.0:1789785249.891075:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785249.891812:0:7484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530160256 00000100:00100000:1.0:1789785249.891824:0:7484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530160256 00000100:00100000:1.0:1789785249.891909:0:7484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 8 00000100:00100000:1.0:1789785249.891920:0:7484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf540380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+55:2398:x1876725530160256:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789785249.891936:0:7484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785249.891961:0:7484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cad9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd879e expref: 55 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.891993:0:7484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:1.0:1789785249.891999:0:7484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785249.892067:0:7484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf540380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+54:2398:x1876725530160256:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 149us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785249.892074:0:7484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 8 00000100:00100000:2.0:1789785249.900876:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785249.900963:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530160384 00000100:00100000:0.0:1789785249.900994:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530160384 00000100:00100000:0.0:1789785249.901059:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 116 00000100:00100000:0.0:1789785249.901070:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+54:11393:x1876725530160384:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:0.0:1789785249.901093:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785249.901113:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cae7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd87a5 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.901150:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845caee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.901165:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845caee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.901176:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845caee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.901277:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cae7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87a5 expref: 56 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.901294:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845caee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87a5 expref: 55 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.901302:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:0.0:1789785249.901306:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789785249.901309:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eac800, rc 0) 00000100:00100000:0.0:1789785249.901659:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+55:11393:x1876725530160384:12345-192.168.203.46@tcp:101:bash.0 Request processed in 590us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785249.901667:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 116 00000100:00100000:3.0:1789785249.907459:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785249.907555:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530160640 00000100:00100000:0.0:1789785249.907586:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530160640 00000100:00100000:0.0:1789785249.907634:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 117 00000100:00100000:0.0:1789785249.907643:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+55:11393:x1876725530160640:12345-192.168.203.46@tcp:36:bash.0 00010000:00010000:0.0:1789785249.907694:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785249.907732:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cabd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8797 expref: 55 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.907752:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:0.0:1789785249.907757:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789785249.907944:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845caf5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.907959:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845caf5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.907967:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845caf5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789785249.908019:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:0.0:1789785249.908041:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a216cd7 reply state 00000000544840ee transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845caf5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.908053:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845caf5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785249.908059:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:0.0:1789785249.908062:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789785249.908064:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789785249.908164:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+57:11393:x1876725530160640:12345-192.168.203.46@tcp:36:bash.0 Request processed in 519us (713us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1789785249.908171:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 117 00000020:00080000:0.0:1789785249.908183:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789785249.913296:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785249.913455:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530160768 00000100:00100000:1.0:1789785249.913466:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530160768 00000100:00100000:1.0:1789785249.913526:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 118 00000100:00100000:1.0:1789785249.913547:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+57:11393:x1876725530160768:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:1.0:1789785249.913580:0:7896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785249.913602:0:7896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cafc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd87ac expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.913710:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845cb03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.913735:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845cb03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.913747:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845cb03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789785249.913777:0:7896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789785249.913781:0:7896:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789785249.913800:0:7896:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845cb03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.913828:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cafc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87ac expref: 59 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.913856:0:7896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845cb03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87ac expref: 58 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785249.913865:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:1.0:1789785249.913868:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789785249.913872:0:7896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64200, rc 0) 00000100:00100000:1.0:1789785249.914245:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+58:11393:x1876725530160768:12345-192.168.203.46@tcp:101:bash.0 Request processed in 708us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785249.914253:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 118 00000100:00100000:3.0:1789785249.927524:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785249.927714:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530161024 00000100:00100000:2.0:1789785249.927746:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530161024 00000100:00100000:2.0:1789785249.927804:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 29 00000100:00100000:2.0:1789785249.927815:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+58:11393:x1876725530161024:12345-192.168.203.46@tcp:35:bash.0 00000100:00100000:2.0:1789785249.928326:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+59:11393:x1876725530161024:12345-192.168.203.46@tcp:35:bash.0 Request processed in 510us (810us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1789785249.928334:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 29 00000100:00100000:0.0:1789785250.012158:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785250.021481:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530161152 00000100:00100000:2.0:1789785250.021497:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530161152 00000100:00100000:2.0:1789785250.021589:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 119 00000100:00100000:2.0:1789785250.021602:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+59:11399:x1876725530161152:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:2.0:1789785250.021628:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785250.021648:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845cb0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd87b3 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.021707:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cb11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.021731:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cb11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.021742:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cb11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789785250.021784:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789785250.021787:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789785250.021804:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cb11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.021828:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845cb0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87b3 expref: 61 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.022106:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cb11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87b3 expref: 60 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.022114:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:2.0:1789785250.022117:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789785250.022120:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d54200, rc 0) 00000100:00100000:2.0:1789785250.022190:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+60:11399:x1876725530161152:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 592us (10041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785250.022198:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 119 00000100:00080000:3.0:1789785250.022512:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789785250.028686:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785250.028810:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530161280 00000100:00100000:1.0:1789785250.028826:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530161280 00000100:00100000:1.0:1789785250.029129:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 120 00000100:00100000:1.0:1789785250.029143:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+60:11399:x1876725530161280:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789785250.029163:0:11254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785250.029484:0:11254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845cb18 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd87ba expref: -99 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031279:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cb1f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031300:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cb1f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031313:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cb1f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031325:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845cb26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031333:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845cb26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031355:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845cb26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031429:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cb2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031438:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cb2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031445:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cb2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789785250.031506:0:11254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789785250.031510:0:11254:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789785250.031529:0:11254:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cb2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031541:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cb2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031550:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cb1f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031556:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cb1f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031563:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cb1f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031569:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785250.031573:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cb1f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031581:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cb1f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031592:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:1.0:1789785250.031596:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785250.031600:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cb1f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031605:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cb1f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031629:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845cb26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031636:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845cb26 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031641:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845cb26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031646:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a64a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785250.031649:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845cb26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031654:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845cb26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031663:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dafac970e00) 00010000:00010000:1.0:1789785250.031666:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785250.031669:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845cb26 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031675:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845cb26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031709:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845cb18 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87ba expref: 62 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031734:0:11254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cb2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87ba expref: 61 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.031753:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:1.0:1789785250.031756:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789785250.031759:0:11254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64000, rc 0) 00000100:00100000:1.0:1789785250.031835:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+61:11399:x1876725530161280:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 2694us (3164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785250.031844:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 120 00000100:00100000:0.0:1789785250.044411:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785250.044658:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530161664 00000100:00100000:3.0:1789785250.044671:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530161664 00000100:00100000:3.0:1789785250.044753:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 121 00000100:00100000:3.0:1789785250.044768:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+61:11399:x1876725530161664:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789785250.044797:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785250.044823:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845cb34 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd87c1 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785250.044965:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cb3b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785250.044984:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845cb03 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87ac expref: 62 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785250.044993:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cb2d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87ba expref: 62 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785250.045002:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cb3b lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785250.045115:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cb2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87ba expref: 62 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785250.045151:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cb2d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87ba expref: 62 pid: 11254 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785250.045167:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1876725549110784:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785250.045323:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845cb03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87ac expref: 62 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785250.045334:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845cb03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87ac expref: 62 pid: 7896 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785250.045565:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1876725549110912:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789785250.045602:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8398e780 going to sleep for 11 seconds 00000100:00100000:1.0:1789785250.057237:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785250.057705:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530161408 00000100:00100000:0.0:1789785250.057727:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530161408 00010000:00010000:0.0:1789785250.057788:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cb2d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87ba expref: 63 pid: 11254 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785250.057839:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 70 00000100:00100000:0.0:1789785250.057851:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+63:2397:x1876725530161408:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789785250.057870:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785250.057879:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cb2d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87ba expref: 63 pid: 11254 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785250.057895:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cb2d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87ba expref: 63 pid: 11254 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785250.057924:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:0.0:1789785250.057930:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cb3b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785250.057941:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cb3b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785250.057948:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785250.058026:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+63:2397:x1876725530161408:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 177us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785250.058047:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 70 00010000:00010000:3.0:1789785250.058281:0:6535:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.46@tcp) returned -22 from blocking AST (req@00000000bb7690be x1876725549110784) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cb2d lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87ba expref: 62 pid: 11254 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785250.058289:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00010000:00010000:3.0:1789785250.058306:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cb2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87ba expref: 62 pid: 11254 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785250.058319:0:7484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530161792 00000100:00100000:0.0:1789785250.058324:0:7484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530161792 00000100:00100000:3.0:1789785250.058329:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1876725549110784:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789785250.058371:0:7484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845cb03 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87ac expref: 62 pid: 7896 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785250.058397:0:7484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 71 00000100:00100000:3.0:1789785250.064625:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1876725549110912:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785250.064682:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:3.0:1789785250.064691:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cb3b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785250.064742:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cb3b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785250.064753:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cb3b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785250.066227:0:7484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+62:2397:x1876725530161792:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789785250.066265:0:7484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785250.066278:0:7484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845cb03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87ac expref: 62 pid: 7896 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785250.066299:0:7484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845cb03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87ac expref: 62 pid: 7896 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785250.066330:0:7484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845cb03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87ac expref: 62 pid: 7896 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785250.066369:0:7484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:0.0:1789785250.066375:0:7484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cb3b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785250.066386:0:7484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cb3b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785250.066395:0:7484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cb3b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785250.066442:0:7484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789785250.066487:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cb3b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.066496:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cb3b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789785250.066520:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789785250.066694:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845cb34 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87c1 expref: 63 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.066712:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cb3b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87c1 expref: 62 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.066731:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:1.0:1789785250.066734:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789785250.066736:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bb600, rc 0) 00000100:00100000:1.0:1789785250.066792:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+62:11399:x1876725530161664:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 22027us (22395us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1789785250.066801:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 121 00000100:00100000:0.0:1789785250.067008:0:7484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+61:2397:x1876725530161792:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 8603us (8722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785250.067019:0:7484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 71 00000100:00100000:0.0:1789785250.074164:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785250.074265:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530162048 00000100:00100000:2.0:1789785250.074278:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530162048 00000100:00100000:2.0:1789785250.074401:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00100000:2.0:1789785250.074415:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+61:11399:x1876725530162048:12345-192.168.203.46@tcp:103:lfs.0 00010000:00010000:2.0:1789785250.074434:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785250.074467:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845ca8c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8790 expref: 61 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.074491:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:2.0:1789785250.074497:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785250.074563:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+60:11399:x1876725530162048:12345-192.168.203.46@tcp:103:lfs.0 Request processed in 151us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785250.074571:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00100000:2.0:1789785250.076687:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785250.076794:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530162176 00000100:00100000:0.0:1789785250.076806:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530162176 00000100:00100000:0.0:1789785250.076886:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 122 00000100:00100000:0.0:1789785250.076898:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+60:11399:x1876725530162176:12345-192.168.203.46@tcp:58:lfs.0 00010000:00010000:0.0:1789785250.077046:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cb49 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785250.077067:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cb49 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785250.077082:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cb49 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789785250.077206:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1789785250.077319:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+60:11399:x1876725530162176:12345-192.168.203.46@tcp:58:lfs.0 Request processed in 422us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785250.077329:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 122 00000100:00100000:0.0:1789785250.079274:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785250.079815:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530162304 00000100:00100000:1.0:1789785250.079844:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530162304 00000100:00100000:1.0:1789785250.079913:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 123 00000100:00100000:1.0:1789785250.079924:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+60:11399:x1876725530162304:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789785250.079948:0:11254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785250.079972:0:11254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845cb50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd87c8 expref: -99 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.080169:0:11254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cb49 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.081807:0:11254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845cb50 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87c8 expref: 61 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.081850:0:11254:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cb49 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.081871:0:11254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845cb50 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87c8 expref: 61 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.081889:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:1.0:1789785250.081892:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789785250.081897:0:11254:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845cb50 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87c8 expref: 61 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785250.081906:0:11254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64a00, rc 0) 00000100:00100000:1.0:1789785250.082003:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+61:11399:x1876725530162304:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 2078us (2739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785250.082014:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 123 00010000:00010000:0.0:1789785250.821241:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789785250.946629:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789785250.946641:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789785250.946699:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1789785250.946722:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789785250.946923:0:13813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1876725549111040:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789785250.947201:0:13813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84c40900 going to sleep for 11 seconds 00000100:00100000:0.0:1789785250.955798:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785250.956261:0:13813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1876725549111040:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789785250.957828:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530162432 00000100:00100000:2.0:1789785250.957847:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530162432 00000100:00100000:2.0:1789785250.957968:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 124 00000100:00100000:2.0:1789785250.957981:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+61:11400:x1876725530162432:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789785250.958026:0:6535:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789785250.958195:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+61:11400:x1876725530162432:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 Request processed in 216us (2421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785250.958205:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 124 00000100:00100000:0.0:1789785250.963475:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785250.963625:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530162560 00000100:00100000:2.0:1789785250.963639:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530162560 00000100:00100000:2.0:1789785250.963728:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 125 00000100:00100000:2.0:1789785250.963740:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+61:11400:x1876725530162560:12345-192.168.203.46@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789785250.963835:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cb57 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.963855:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cb57 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.963869:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cb57 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.963885:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54e00/0x2f18ee3fd845cb5e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.963892:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54e00/0x2f18ee3fd845cb5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.963899:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54e00/0x2f18ee3fd845cb5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.963925:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cb65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.963957:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cb65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.963964:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cb65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789785250.964028:0:7896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789785250.964033:0:7896:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789785250.964052:0:7896:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cb65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.964065:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cb57 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.964072:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cb57 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.964079:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cb57 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.964086:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785250.964091:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cb57 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.964101:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cb57 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.964117:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9daf87d6e700) 00010000:00010000:2.0:1789785250.964120:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785250.964125:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cb57 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.964142:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cb57 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.964161:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54e00/0x2f18ee3fd845cb5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.964168:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54e00/0x2f18ee3fd845cb5e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.964173:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54e00/0x2f18ee3fd845cb5e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.964425:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785250.964428:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54e00/0x2f18ee3fd845cb5e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.964434:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54e00/0x2f18ee3fd845cb5e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.964442:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9dae827bdb00) 00010000:00010000:2.0:1789785250.964445:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785250.964447:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54e00/0x2f18ee3fd845cb5e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.964452:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54e00/0x2f18ee3fd845cb5e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.964469:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cb65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.964474:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cb65 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.964486:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cb65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.964492:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785250.964494:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cb65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.964500:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cb65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.964508:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:2.0:1789785250.964510:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785250.964513:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cb65 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.964520:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cb65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785250.964631:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+61:11400:x1876725530162560:12345-192.168.203.46@tcp:34:lhsmtool_posix.0 Request processed in 891us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785250.964642:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 125 00000100:00100000:1.0:1789785250.967124:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785250.967236:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530162816 00000100:00100000:3.0:1789785250.967251:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530162816 00000100:00100000:3.0:1789785250.967329:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 126 00000100:00100000:3.0:1789785250.967397:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+61:11400:x1876725530162816:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789785250.967426:0:11254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785250.967451:0:11254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cb6c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd87cf expref: -99 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785250.967735:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cb73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785250.967755:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cb73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785250.967768:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cb73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785250.967781:0:11254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789785250.967889:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cb73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785250.967897:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cb73 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785250.967924:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cb73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785250.967931:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bae00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785250.967936:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cb73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785250.967944:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cb73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785250.967961:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:3.0:1789785250.967964:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789785250.967970:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cb73 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785250.967976:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cb73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785250.968025:0:11254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cb6c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87cf expref: 63 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785250.968037:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9daf87d6e700) 00010000:00010000:3.0:1789785250.968039:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789785250.968043:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cb6c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87cf expref: 63 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785250.968054:0:11254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814ba200, rc 0) 00000100:00100000:3.0:1789785250.968137:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+62:11400:x1876725530162816:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 798us (1027us total) trans 4294967399 rc 301/301 00000100:00100000:3.0:1789785250.968156:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 126 00000100:00100000:1.0:1789785250.976213:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785250.977087:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530162944 00000100:00100000:0.0:1789785250.977103:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530162944 00000100:00100000:0.0:1789785250.977203:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 127 00000100:00100000:0.0:1789785250.977215:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+62:11400:x1876725530162944:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789785250.977286:0:6533:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789785250.977492:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+62:11400:x1876725530162944:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 Request processed in 279us (1292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785250.977503:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 127 00000100:00100000:0.0:1789785250.983447:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785250.983574:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530163200 00000100:00100000:2.0:1789785250.983588:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530163200 00000100:00100000:2.0:1789785250.983660:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 128 00000100:00100000:2.0:1789785250.983673:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+62:11400:x1876725530163200:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789785250.983701:0:7896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785250.983706:0:7896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789785250.983752:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cb11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87b3 expref: 62 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.983816:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:2.0:1789785250.983822:0:7896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789785250.983838:0:7896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cb81 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd87d6 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789785250.984399:0:7896:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789785250.984579:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54e00/0x2f18ee3fd845cb88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.984597:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54e00/0x2f18ee3fd845cb88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.984610:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54e00/0x2f18ee3fd845cb88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.984672:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cb81 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87d6 expref: 64 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.984690:0:7896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54e00/0x2f18ee3fd845cb88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87d6 expref: 63 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.984699:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:2.0:1789785250.984701:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789785250.984704:0:7896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d54e00, rc 0) 00000100:00100000:2.0:1789785250.984785:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+63:11400:x1876725530163200:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 1114us (1352us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1789785250.984795:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 128 00000100:00100000:1.0:1789785250.993557:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785250.993641:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530163456 00000100:00100000:2.0:1789785250.993654:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530163456 00000100:00100000:2.0:1789785250.993739:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 129 00000100:00100000:2.0:1789785250.993750:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+63:11400:x1876725530163456:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789785250.993823:0:6535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785250.993856:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54e00/0x2f18ee3fd845cb88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87d6 expref: 63 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.993880:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:2.0:1789785250.993892:0:6535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789785250.993918:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cb96 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.993934:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cb96 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.993946:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cb96 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.994126:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cb9d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x94b0018f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.994149:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cb9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x94b0018f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.994163:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cb9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x94b0018f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.994214:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cb96 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.994241:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cb96 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.994248:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cb96 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.994254:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785250.994259:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cb96 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.994267:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cb96 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.994280:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:2.0:1789785250.994283:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785250.994287:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cb96 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.994293:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cb96 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.994310:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cb9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x94b0018f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.994316:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cb9d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x94b0018f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.994322:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cb9d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x94b0018f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.994328:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785250.994417:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cb9d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x94b0018f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.994426:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cb9d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x94b0018f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.994433:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x94b0018f (ffff9dae827bd000) 00010000:00010000:2.0:1789785250.994436:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785250.994438:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cb9d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x94b0018f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785250.994442:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cb9d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x94b0018f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785250.994570:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+62:11400:x1876725530163456:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 818us (1023us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789785250.994578:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 129 00000100:00100000:1.0:1789785250.997769:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785251.009090:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530163584 00000100:00100000:2.0:1789785251.009106:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530163584 00000100:00100000:2.0:1789785251.009176:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 130 00000100:00100000:2.0:1789785251.009187:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8445dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+62:11400:x1876725530163584:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789785251.009209:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785251.009235:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cba4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd87dd expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.009272:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54400/0x2f18ee3fd845cbab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.009285:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54400/0x2f18ee3fd845cbab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.009318:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54400/0x2f18ee3fd845cbab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.009470:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cba4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87dd expref: 64 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.009487:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54400/0x2f18ee3fd845cbab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87dd expref: 63 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.009496:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dae827bd900) 00010000:00010000:2.0:1789785251.009499:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789785251.009503:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d54400, rc 0) 00000100:00100000:2.0:1789785251.009573:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8445dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+63:11400:x1876725530163584:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 388us (11820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785251.009580:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 130 00000100:00100000:0.0:1789785251.014336:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785251.014663:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530163840 00000100:00100000:3.0:1789785251.014677:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530163840 00000100:00100000:3.0:1789785251.014771:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 131 00000100:00100000:3.0:1789785251.014785:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+63:11400:x1876725530163840:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789785251.014903:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cbb2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.014925:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cbb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.014940:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cbb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789785251.015154:0:11254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1789785251.015166:0:11254:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 359268827193ns, next at 360268824163ns, rc = 0 00000004:00010000:3.0:1789785251.015227:0:11254:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4c560fc reply state 000000004d39d6e7 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cbb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.015244:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cbb2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.015252:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dae827bd900) 00010000:00010000:3.0:1789785251.015255:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789785251.015260:0:11254:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789785251.015439:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+65:11400:x1876725530163840:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 655us (1116us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1789785251.015448:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 131 00000100:00100000:1.0:1789785251.023766:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785251.023964:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530163968 00000100:00100000:3.0:1789785251.023994:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530163968 00000100:00100000:3.0:1789785251.024064:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 132 00000100:00100000:3.0:1789785251.024076:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8445d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+65:11400:x1876725530163968:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789785251.024109:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785251.024134:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cbb9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd87e4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.024222:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cbb9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87e4 expref: 66 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.024241:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cbb9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87e4 expref: 66 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.024261:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dae827bd900) 00010000:00010000:3.0:1789785251.024265:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789785251.024269:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bae00, rc 0) 00000100:00100000:3.0:1789785251.024369:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8445d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+66:11400:x1876725530163968:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 263us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785251.024378:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 132 00000100:00100000:1.0:1789785251.031216:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785251.031381:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530164096 00000100:00100000:3.0:1789785251.031396:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530164096 00000100:00100000:3.0:1789785251.031496:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 46 00000100:00100000:3.0:1789785251.031510:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb73a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+6:2398:x1876725530164096:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789785251.031829:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb73a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+7:2398:x1876725530164096:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 Request processed in 322us (628us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789785251.031838:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 46 00000100:00080000:0.0:1789785251.032831:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789785251.038066:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785251.038300:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530164352 00000100:00100000:1.0:1789785251.038313:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530164352 00000100:00100000:1.0:1789785251.038441:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 30 00000100:00100000:1.0:1789785251.038453:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+66:11400:x1876725530164352:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789785251.038747:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+67:11400:x1876725530164352:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 295us (696us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1789785251.038756:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 30 00000100:00100000:2.0:1789785251.047564:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785251.047761:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530164608 00000100:00100000:0.0:1789785251.047770:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530164608 00000100:00100000:0.0:1789785251.047832:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 133 00000100:00100000:0.0:1789785251.047842:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+67:11400:x1876725530164608:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789785251.047955:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+67:11400:x1876725530164608:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 113us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785251.047963:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 133 00000100:00100000:0.0:1789785251.060514:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785251.060589:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530164736 00000100:00100000:2.0:1789785251.060599:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530164736 00000100:00100000:2.0:1789785251.060665:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 134 00000100:00100000:2.0:1789785251.060676:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+67:11400:x1876725530164736:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789785251.060695:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785251.060730:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cbc0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd87eb expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.060817:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cbc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.060840:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cbc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.060851:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cbc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789785251.060897:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789785251.060914:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cbc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.060938:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cbc0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87eb expref: 69 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.060955:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cbc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87eb expref: 68 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.060964:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dae827bd900) 00010000:00010000:2.0:1789785251.060967:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789785251.060970:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d54200, rc 0) 00000100:00100000:2.0:1789785251.061030:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+68:11400:x1876725530164736:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 356us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785251.061037:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 134 00000100:00100000:1.0:1789785251.071128:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785251.071834:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530164864 00000100:00100000:2.0:1789785251.071845:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530164864 00000100:00100000:2.0:1789785251.071896:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 47 00000100:00100000:2.0:1789785251.071905:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8445e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+7:2398:x1876725530164864:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789785251.071921:0:8805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785251.071952:0:8805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035027648/0x2f18ee3fd845cbce lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd87f2 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789785251.071977:0:8805:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aadf4a1, blocks: 0x0 00010000:00010000:2.0:1789785251.071995:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=359s v=(0 0) 00010000:00010000:2.0:1789785251.071999:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785251.072009:0:8805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035027648/0x2f18ee3fd845cbce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87f2 expref: 8 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.072027:0:8805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000035027648/0x2f18ee3fd845cbce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87f2 expref: 8 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.072039:0:8805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d54800, rc 0) 00000100:00100000:2.0:1789785251.072106:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8445e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+8:2398:x1876725530164864:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 193us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785251.072113:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 47 00000100:00100000:1.0:1789785251.083904:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785251.084829:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530165120 00000100:00100000:3.0:1789785251.084855:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530165120 00000100:00100000:3.0:1789785251.084920:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 135 00000100:00100000:3.0:1789785251.084931:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8445c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+68:11400:x1876725530165120:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789785251.085043:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8445c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+68:11400:x1876725530165120:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 113us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785251.085049:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 135 00000100:00100000:1.0:1789785251.097722:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785251.097811:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530165248 00000100:00100000:3.0:1789785251.097821:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530165248 00000100:00100000:3.0:1789785251.097881:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 48 00000100:00100000:3.0:1789785251.097891:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8445ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+8:11400:x1876725530165248:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789785251.097909:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785251.097925:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052a025d3/0x2f18ee3fd845cbd5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd87f9 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.097957:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000035027648/0x2f18ee3fd845cbce lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87f2 expref: 9 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.097967:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785251.097971:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785251.097976:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052a025d3/0x2f18ee3fd845cbd5 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87f9 expref: 9 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.098009:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000035027648/0x2f18ee3fd845cbce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87f2 expref: 9 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.098023:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000035027648/0x2f18ee3fd845cbce lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87f2 expref: 9 pid: 8805 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785251.098051:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8449:1876725549111168:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789785251.098156:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8398e900 going to sleep for 11 seconds 00000100:00100000:3.0:1789785251.101412:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8449:1876725549111168:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785251.101458:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000052a025d3/0x2f18ee3fd845cbd5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87f9 expref: 9 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.101477:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814ba800, rc 0) 00000100:00100000:3.0:1789785251.101532:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8445ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+9:11400:x1876725530165248:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 3642us (3828us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785251.101540:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 48 00000100:00100000:2.0:1789785251.102780:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785251.102912:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530165376 00000100:00100000:1.0:1789785251.102921:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530165376 00010000:00010000:1.0:1789785251.102955:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000035027648/0x2f18ee3fd845cbce lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87f2 expref: 9 pid: 8805 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785251.103012:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 72 00000100:00100000:1.0:1789785251.103023:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+9:2397:x1876725530165376:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789785251.103037:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785251.103056:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000035027648/0x2f18ee3fd845cbce lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87f2 expref: 9 pid: 8805 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.103069:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000035027648/0x2f18ee3fd845cbce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87f2 expref: 9 pid: 8805 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.103091:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035027648/0x2f18ee3fd845cbce lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87f2 expref: 9 pid: 8805 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.103119:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789785251.103123:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789785251.103131:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000052a025d3/0x2f18ee3fd845cbd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87f9 expref: 8 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.103141:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052a025d3/0x2f18ee3fd845cbd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87f9 expref: 8 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.103177:0:6520:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000052a025d3/0x2f18ee3fd845cbd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87f9 expref: 8 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785251.103191:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb416a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6520:1876725549111296:192.168.203.46@tcp:105: 00000100:00100000:1.0:1789785251.103267:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf85828c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789785251.113517:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785251.113666:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb416a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6520:1876725549111296:192.168.203.46@tcp:105: 00010000:00010000:0.0:1789785251.113692:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785251.113763:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+8:2397:x1876725530165376:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 10741us (10987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785251.113774:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 72 00000100:00100000:2.0:1789785251.113935:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530165504 00000100:00100000:2.0:1789785251.113943:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530165504 00002000:00100000:2.0:1789785251.113985:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9dafbb414700 x1876725530165504/t0(0) o4->026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp:382/0 lens 504/0 e 0 to 0 dl 1789785262 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789785251.113995:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dafbb414700 with x1876725530165504 ext(0->12) 00002000:00010000:2.0:1789785251.114000:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dafbb414700 00000100:00100000:2.0:1789785251.114028:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 3 00000100:00100000:2.0:1789785251.114037:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:026b2112-ee35-499c-8d01-18663664f08e+8:2397:x1876725530165504:12345-192.168.203.46@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789785251.115005:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:026b2112-ee35-499c-8d01-18663664f08e+10:2397:x1876725530165504:12345-192.168.203.46@tcp:4:lhsmtool_posix.0 Request processed in 963us (1491us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789785251.115023:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 3 00002000:00100000:2.0:1789785251.115033:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9dafbb414700 x1876725530165504/t4294967310(0) o4->026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp:382/0 lens 504/448 e 0 to 0 dl 1789785262 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789785251.115042:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dafbb414700 with x1876725530165504 ext(0->12) 00002000:00010000:2.0:1789785251.115046:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dafbb414700 00000100:00100000:1.0:1789785251.117857:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785251.118182:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530165632 00000100:00100000:3.0:1789785251.118193:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530165632 00000100:00100000:3.0:1789785251.118283:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 136 00000100:00100000:3.0:1789785251.118294:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+68:11400:x1876725530165632:12345-192.168.203.46@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789785251.120440:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:0.0:1789785251.120458:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:0.0:1789785251.120499:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1789785251.120512:0:6512:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9daf85440840 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1789785251.120517:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dae83a4ea00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9daf85440e40 00000020:00080000:0.0:1789785251.120529:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dae83a4e300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dae83a13c00 00000004:00080000:0.0:1789785251.120553:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789785251.120578:0:6512:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9daf84d82180 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1789785251.120581:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dafbf457200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9daf84d82540 00000020:00080000:0.0:1789785251.120584:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dafbf457300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9daf86573800 00010000:00010000:2.0:1789785251.120658:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845c8da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120669:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845c8da lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120676:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845c8da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120682:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785251.120687:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845c8da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120695:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845c8da lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120718:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9daf94af3100) 00010000:00010000:2.0:1789785251.120721:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785251.120726:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845c8da lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120733:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845c8da lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120758:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c982 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120771:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c982 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120776:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c982 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120781:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eacc00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785251.120784:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c982 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120790:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c982 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120799:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dae827c3a00) 00010000:00010000:2.0:1789785251.120801:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785251.120804:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c982 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120809:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845c982 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120825:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845ca00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120831:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845ca00 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120837:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845ca00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120842:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bac00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785251.120851:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845ca00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120858:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845ca00 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120866:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dafac970e00) 00010000:00010000:2.0:1789785251.120868:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785251.120871:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845ca00 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120877:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845ca00 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120888:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845ca23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120894:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845ca23 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120900:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845ca23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120906:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785251.120909:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845ca23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120915:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845ca23 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120922:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dafac970e00) 00010000:00010000:2.0:1789785251.120925:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785251.120933:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845ca23 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120939:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845ca23 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120955:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845caf5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120961:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845caf5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120966:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845caf5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120971:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81ead400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785251.120973:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845caf5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120978:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845caf5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120986:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:2.0:1789785251.120987:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785251.120990:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845caf5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.120995:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845caf5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.121004:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cbb2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.121010:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cbb2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.121021:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cbb2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.121026:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814ba200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785251.121029:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cbb2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.121034:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cbb2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.121041:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dae827bd900) 00010000:00010000:2.0:1789785251.121043:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789785251.121045:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cbb2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.121050:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cbb2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785251.121253:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549111680:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789785251.121319:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785251.121475:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+16:11400:x1876725530165632:12345-192.168.203.46@tcp:44:lhsmtool_posix.0 Request processed in 3181us (3625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785251.121485:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 136 00000100:00100000:2.0:1789785251.121672:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549111424:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789785251.121703:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785251.121735:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789785251.121741:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549111552:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789785251.121765:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785251.121792:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549111680 00000100:00100000:2.0:1789785251.121798:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549111680 00000100:00100000:2.0:1789785251.121844:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549111424 00000100:00100000:2.0:1789785251.121847:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549111424 00000100:00100000:2.0:1789785251.121861:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549111552 00000100:00100000:2.0:1789785251.121863:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549111552 00000100:00100000:2.0:1789785251.121888:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789785251.121896:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3661:x1876725549111680:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789785251.121918:0:8450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:2.0:1789785251.121947:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aadf4a0, atime: 0x6aadf4a0, ctime: 0x6aadf4a0, blocks: 0x8 00010000:00010000:2.0:1789785251.121954:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d4abf1c/0x2f18ee3fd845cbdc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.121968:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=359s v=(0 0) 00010000:00010000:2.0:1789785251.121973:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785251.121979:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d4abf1c/0x2f18ee3fd845cbdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.121993:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d4abf1c/0x2f18ee3fd845cbdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.122003:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d4abf1c/0x2f18ee3fd845cbdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.122010:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d4abf1c/0x2f18ee3fd845cbdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.122026:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789785251.122287:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3661:x1876725549111680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 391us (967us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789785251.122294:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789785251.122310:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789785251.122318:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3659:x1876725549111424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789785251.122352:0:8450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:2.0:1789785251.122366:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008b667a7/0x2f18ee3fd845cbe3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.122379:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009ad73925/0x2f18ee3fd845c990 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8751 expref: 9 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.122386:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789785251.122389:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789785251.122391:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008b667a7/0x2f18ee3fd845cbe3 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.122416:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009ad73925/0x2f18ee3fd845c990 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8751 expref: 9 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.122440:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009ad73925/0x2f18ee3fd845c990 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8751 expref: 9 pid: 8449 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785251.122451:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83982a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8450:1876725549111808:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789785251.122494:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf854400c0 going to sleep for 11 seconds 00000100:00080000:2.0:1789785251.122508:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789785251.122512:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789785251.122520:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789785251.122526:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d4abf1c/0x2f18ee3fd845cbdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.122532:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55e00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:2.0:1789785251.122542:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d4abf1c/0x2f18ee3fd845cbdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.122550:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d4abf1c/0x2f18ee3fd845cbdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.122564:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d4abf1c/0x2f18ee3fd845cbdc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.122571:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d4abf1c/0x2f18ee3fd845cbdc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.122586:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785251.122588:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785251.122589:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785251.122601:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789785251.122609:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3659:x1876725549111552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789785251.122676:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789785251.122680:0:8451:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789785250 00002000:00010000:2.0:1789785251.122682:0:8451:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789785251.122684:0:8451:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789785249 -> 1789785250 00002000:00010000:2.0:1789785251.122686:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789785251.122729:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3659:x1876725549111552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 121us (962us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789785251.122736:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00080000:2.0:1789785251.122786:0:3659:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dae844c0000/2, rc 0, transno 4294967311 00000100:00100000:2.0:1789785251.122792:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549111552:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1789785251.123008:0:3661:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dae844c2300/2, rc 0, transno 4294967305 00000100:00100000:0.0:1789785251.123014:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549111680:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1789785251.123420:0:6565:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1789785251.123462:0:6565:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789785251.128905:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785251.128948:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785251.128975:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530165888 00000100:00100000:1.0:1789785251.128983:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530165888 00000100:00100000:1.0:1789785251.129042:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 52 00000100:00100000:1.0:1789785251.129053:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+10:2398:x1876725530165888:12345-192.168.203.46@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789785251.129384:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530165760 00000100:00100000:0.0:1789785251.129389:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530165760 00010000:00010000:0.0:1789785251.129416:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ad73925/0x2f18ee3fd845c990 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8751 expref: 11 pid: 8449 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785251.129455:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 73 00000100:00100000:0.0:1789785251.129462:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+11:2398:x1876725530165760:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789785251.129473:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785251.129479:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ad73925/0x2f18ee3fd845c990 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8751 expref: 11 pid: 8449 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.129493:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ad73925/0x2f18ee3fd845c990 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8751 expref: 11 pid: 8449 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.129516:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789785251.129521:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789785251.129535:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000008b667a7/0x2f18ee3fd845cbe3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.129545:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008b667a7/0x2f18ee3fd845cbe3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.129566:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785251.129622:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+11:2398:x1876725530165760:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 160us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785251.129628:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 73 00010000:00010000:3.0:1789785251.131124:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ad73925/0x2f18ee3fd845c990 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8751 expref: 10 pid: 8449 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785251.131206:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83982a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8450:1876725549111808:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785251.131242:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000008b667a7/0x2f18ee3fd845cbe3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.131252:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000008b667a7/0x2f18ee3fd845cbe3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.131259:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008b667a7/0x2f18ee3fd845cbe3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.131269:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008b667a7/0x2f18ee3fd845cbe3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.131277:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008b667a7/0x2f18ee3fd845cbe3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.131370:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789785251.131837:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3659:x1876725549111424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9518us (10131us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789785251.131846:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:1.0:1789785251.132812:0:3659:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dae844c3800/2, rc 0, transno 4294967312 00000100:00100000:1.0:1789785251.132822:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549111424:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1789785251.133129:0:8445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1789785251.133137:0:8445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:1.0:1789785251.133266:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+6:2398:x1876725530165888:12345-192.168.203.46@tcp:16:lhsmtool_posix.0 Request processed in 4213us (4314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785251.133275:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 52 00010000:00010000:0.0:1789785251.135581:0:9538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789785251.135594:0:9538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008b667a7/0x2f18ee3fd845cbe3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.135606:0:9538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54600 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:0.0:1789785251.135611:0:9538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008b667a7/0x2f18ee3fd845cbe3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.135622:0:9538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008b667a7/0x2f18ee3fd845cbe3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.135643:0:9538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008b667a7/0x2f18ee3fd845cbe3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.135651:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008b667a7/0x2f18ee3fd845cbe3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.135693:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785251.135695:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785251.135697:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785251.137791:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785251.137856:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530166144 00000100:00100000:2.0:1789785251.137865:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530166144 00000100:00100000:2.0:1789785251.137924:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 137 00000100:00100000:2.0:1789785251.137934:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae828fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+16:11400:x1876725530166144:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789785251.137981:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785251.138006:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cbc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87eb expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.138025:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dae827bd900) 00010000:00010000:2.0:1789785251.138030:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789785251.138058:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cbea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.138071:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cbea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.138081:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cbea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789785251.138282:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011e1f867 reply state 0000000068791eab transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cbea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.138295:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cbea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.138301:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dae827bd900) 00010000:00010000:2.0:1789785251.138304:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789785251.138320:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789785251.138580:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae828fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+17:11400:x1876725530166144:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 646us (796us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1789785251.138587:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 137 00000100:00100000:0.0:1789785251.139033:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789785251.139243:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549112064:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789785251.139287:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785251.139327:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549112064 00000100:00100000:3.0:1789785251.139332:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549112064 00000100:00100000:3.0:1789785251.139392:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789785251.139400:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549112064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789785251.139417:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3691974656 00000100:00100000:3.0:1789785251.139970:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549112064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 570us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785251.139978:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:3.0:1789785251.140006:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789785251.140094:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549112064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789785251.140283:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789785251.140294:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549112192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789785251.140327:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785251.140436:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549112192 00000100:00100000:2.0:1789785251.140442:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549112192 00000100:00100000:2.0:1789785251.140471:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789785251.140478:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf44b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549112192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789785251.140502:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1789785251.140537:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf44b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549112192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785251.140544:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789785251.140665:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549112192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789785251.141830:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549111936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789785251.141879:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785251.141971:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549111936 00000100:00100000:1.0:1789785251.141977:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549111936 00000100:00100000:1.0:1789785251.142025:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789785251.142034:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1876725549111936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789785251.142051:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1789785251.142286:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1876725549111936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 252us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785251.142294:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789785251.143276:0:3661:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1789785251.143284:0:3661:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dae844c0000, transno 4294967311 00000100:00100000:0.0:1789785251.143353:0:3661:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9dae844c3800 x1876725549111424/t4294967312(4294967312) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789785267 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785251.143373:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549111936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789785251.146016:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785251.146091:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530166272 00000100:00100000:3.0:1789785251.146099:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530166272 00000100:00100000:3.0:1789785251.146154:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 53 00000100:00100000:3.0:1789785251.146165:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+6:2397:x1876725530166272:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789785251.146301:0:8449:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789785251.146305:0:8449:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1789785250 -> 1789785248 00002000:00010000:3.0:1789785251.146307:0:8449:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789785248 00002000:00010000:3.0:1789785251.146309:0:8449:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789785250 -> 1789785248 00002000:00010000:3.0:1789785251.146311:0:8449:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789785251.146617:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+7:2397:x1876725530166272:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 Request processed in 452us (609us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789785251.146626:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 53 00000100:00100000:0.0:1789785251.152682:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785251.152786:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530166528 00000100:00100000:3.0:1789785251.152796:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530166528 00000100:00100000:3.0:1789785251.152883:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 138 00000100:00100000:3.0:1789785251.152894:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+17:11400:x1876725530166528:12345-192.168.203.46@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789785251.152958:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cbf1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.152973:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54400/0x2f18ee3fd845cbab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87dd expref: 17 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.152984:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cbf1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.153026:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54400/0x2f18ee3fd845cbab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87dd expref: 17 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.153039:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54400/0x2f18ee3fd845cbab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87dd expref: 17 pid: 6534 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785251.153054:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1876725549112320:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789785251.153136:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8398e000 going to sleep for 11 seconds 00000100:00100000:2.0:1789785251.157540:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785251.157724:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1876725549112320:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785251.157751:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cbf1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785251.157804:0:7484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530166656 00000100:00100000:0.0:1789785251.157810:0:7484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530166656 00010000:00010000:0.0:1789785251.157845:0:7484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54400/0x2f18ee3fd845cbab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87dd expref: 18 pid: 6534 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785251.157922:0:7484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 74 00000100:00100000:0.0:1789785251.157933:0:7484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+18:2398:x1876725530166656:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789785251.157946:0:7484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785251.157953:0:7484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54400/0x2f18ee3fd845cbab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87dd expref: 18 pid: 6534 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.157966:0:7484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54400/0x2f18ee3fd845cbab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87dd expref: 18 pid: 6534 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.158003:0:7484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54400/0x2f18ee3fd845cbab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87dd expref: 18 pid: 6534 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.158019:0:7484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dae827bd900) 00010000:00010000:0.0:1789785251.158024:0:7484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cbf1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.158033:0:7484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cbf1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.158041:0:7484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cbf1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.158070:0:7484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785251.158128:0:7484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+17:2398:x1876725530166656:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 197us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785251.158136:0:7484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 74 00010000:00010000:3.0:1789785251.158182:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cbf1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.158190:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cbf1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.158225:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cbf1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.158233:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cbf1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.158240:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cbf1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.158245:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814ba400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785251.158250:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cbf1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.158265:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cbf1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.158275:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dae827bd900) 00010000:00010000:3.0:1789785251.158278:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789785251.158282:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cbf1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.158288:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cbf1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785251.158324:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+16:11400:x1876725530166528:12345-192.168.203.46@tcp:55:lhsmtool_posix.0 Request processed in 5432us (5651us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789785251.158332:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 138 00000100:00100000:2.0:1789785251.160622:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785251.160807:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530166784 00000100:00100000:3.0:1789785251.160815:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530166784 00000100:00100000:3.0:1789785251.160866:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 54 00000100:00100000:3.0:1789785251.160875:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+7:2397:x1876725530166784:12345-192.168.203.46@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789785251.160912:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006c36fb99/0x2f18ee3fd845cbf8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.160931:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000052a025d3/0x2f18ee3fd845cbd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87f9 expref: 7 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.160941:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785251.160945:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789785251.160949:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c36fb99/0x2f18ee3fd845cbf8 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.160991:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000052a025d3/0x2f18ee3fd845cbd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87f9 expref: 7 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.161004:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000052a025d3/0x2f18ee3fd845cbd5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87f9 expref: 7 pid: 8449 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785251.161018:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8450:1876725549112448:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789785251.161083:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8398e000 going to sleep for 11 seconds 00000100:00100000:2.0:1789785251.164335:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785251.164786:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530166912 00000100:00100000:0.0:1789785251.164796:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530166912 00010000:00010000:0.0:1789785251.164836:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000052a025d3/0x2f18ee3fd845cbd5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87f9 expref: 8 pid: 8449 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785251.164876:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 75 00000100:00100000:0.0:1789785251.164886:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+8:2397:x1876725530166912:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789785251.164900:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785251.164920:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000052a025d3/0x2f18ee3fd845cbd5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87f9 expref: 8 pid: 8449 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.164953:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000052a025d3/0x2f18ee3fd845cbd5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87f9 expref: 8 pid: 8449 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.164978:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789785251.164983:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789785251.164989:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006c36fb99/0x2f18ee3fd845cbf8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.164999:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c36fb99/0x2f18ee3fd845cbf8 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.165020:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785251.165071:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+8:2397:x1876725530166912:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 186us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785251.165080:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 75 00010000:00010000:3.0:1789785251.166261:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052a025d3/0x2f18ee3fd845cbd5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87f9 expref: 7 pid: 8449 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785251.166281:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8450:1876725549112448:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785251.166304:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006c36fb99/0x2f18ee3fd845cbf8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.166630:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006c36fb99/0x2f18ee3fd845cbf8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.166640:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c36fb99/0x2f18ee3fd845cbf8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.166662:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006c36fb99/0x2f18ee3fd845cbf8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.166670:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c36fb99/0x2f18ee3fd845cbf8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.166691:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c36fb99/0x2f18ee3fd845cbf8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.166698:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814ba000 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:0.0:1789785251.166702:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c36fb99/0x2f18ee3fd845cbf8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.166719:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c36fb99/0x2f18ee3fd845cbf8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.166736:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c36fb99/0x2f18ee3fd845cbf8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.166744:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c36fb99/0x2f18ee3fd845cbf8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785251.166846:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+6:2397:x1876725530166784:12345-192.168.203.46@tcp:1:lhsmtool_posix.0 Request processed in 5970us (6231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785251.166854:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 54 00000100:00100000:3.0:1789785251.168835:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785251.168893:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530167168 00000100:00100000:0.0:1789785251.168902:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530167168 00000100:00100000:0.0:1789785251.168958:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 139 00000100:00100000:0.0:1789785251.168968:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+16:11400:x1876725530167168:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789785251.169036:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cbff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.169065:0:11254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845caee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87a5 expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.169075:0:11254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cbff lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.169118:0:11254:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845caee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87a5 expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.169132:0:11254:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845caee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87a5 expref: 16 pid: 6534 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785251.169146:0:11254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11254:1876725549112576:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789785251.169445:0:11254:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789785251.173016:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785251.173478:0:11254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11254:1876725549112576:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789785251.173506:0:11254:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cbff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785251.173909:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530167296 00000100:00100000:2.0:1789785251.173916:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530167296 00010000:00010000:2.0:1789785251.173953:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845caee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87a5 expref: 17 pid: 6534 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785251.173990:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 76 00000100:00100000:2.0:1789785251.174000:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+17:2398:x1876725530167296:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789785251.174014:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785251.174021:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845caee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87a5 expref: 17 pid: 6534 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.174052:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845caee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87a5 expref: 17 pid: 6534 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.174074:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845caee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87a5 expref: 17 pid: 6534 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.174090:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:2.0:1789785251.174195:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845cb50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87c8 expref: 16 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.174208:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cbff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.174216:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cbff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.174224:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cbff lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785251.174252:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785251.174296:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+16:2398:x1876725530167296:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 297us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785251.174304:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 76 00010000:00010000:0.0:1789785251.174370:0:11254:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cbff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.174378:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cbff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.174545:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845cc06 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.174557:0:11254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cbb9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87e4 expref: 16 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.174572:0:11254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845cc06 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.174599:0:11254:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cbb9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87e4 expref: 16 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.174613:0:11254:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cbb9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87e4 expref: 16 pid: 6535 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785251.174625:0:11254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11254:1876725549112704:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789785251.174673:0:11254:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab2480 going to sleep for 11 seconds 00000100:00100000:3.0:1789785251.184392:0:11254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11254:1876725549112704:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785251.184423:0:11254:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845cc06 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785251.184622:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785251.184831:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530167424 00000100:00100000:0.0:1789785251.184840:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530167424 00010000:00010000:0.0:1789785251.184874:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cbb9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87e4 expref: 17 pid: 6535 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785251.184995:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 77 00000100:00100000:1.0:1789785251.185008:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:026b2112-ee35-499c-8d01-18663664f08e+17:2397:x1876725530167424:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789785251.185022:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785251.185030:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cbb9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87e4 expref: 17 pid: 6535 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.185042:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cbb9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87e4 expref: 17 pid: 6535 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.185064:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cbb9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87e4 expref: 17 pid: 6535 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.185079:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dae827bd900) 00010000:00010000:1.0:1789785251.185084:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845cc06 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.185094:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845cc06 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.185113:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845cc06 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.185133:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785251.185185:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:026b2112-ee35-499c-8d01-18663664f08e+16:2397:x1876725530167424:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 180us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785251.185192:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 77 00010000:00010000:3.0:1789785251.186055:0:11254:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845cc06 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.186066:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845cc06 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789785251.186202:0:11254:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1789785251.186319:0:11254:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:3.0:1789785251.186386:0:11254:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1789785251.186986:0:11254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11254:1876725549112832:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789785251.187056:0:11254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785251.187092:0:11254:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafacab2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789785251.187183:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549112832 00000100:00100000:2.0:1789785251.187189:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549112832 00000100:00100000:2.0:1789785251.187234:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789785251.187243:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11254:x1876725549112832:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789785251.187331:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11254:x1876725549112832:12345-0@lo:1000:mdt00_004.0 Request processed in 88us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785251.187370:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789785251.187463:0:11254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11254:1876725549112832:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1789785251.187574:0:11254:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1789785251.187631:0:11254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11254:1876725549112960:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789785251.187660:0:11254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785251.187683:0:11254:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84d82840 going to sleep for 11 seconds 00000100:00100000:2.0:1789785251.187919:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549112960 00000100:00100000:2.0:1789785251.187924:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549112960 00000100:00100000:2.0:1789785251.187952:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789785251.187960:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11254:x1876725549112960:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789785251.188056:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:11254:x1876725549112960:12345-0@lo:1000:mdt00_004.0 Request processed in 96us (394us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789785251.188063:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789785251.188133:0:11254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11254:1876725549112960:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1789785251.188163:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845cc06 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.188172:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845cc06 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.188180:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845cc06 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.188187:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81ead400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785251.188191:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845cc06 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.188199:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845cc06 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.188215:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dae827bd900) 00010000:00010000:1.0:1789785251.188218:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789785251.188222:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845cc06 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.188229:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845cc06 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.188249:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cb49 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.188265:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cb49 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.188271:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cb49 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.188277:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eace00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785251.188280:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cb49 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.188287:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cb49 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.188295:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:1.0:1789785251.188297:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789785251.188304:0:11254:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845cb50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87c8 expref: 19 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.188315:0:11254:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845cb50 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87c8 expref: 19 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.188325:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845cb50 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87c8 expref: 19 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.188377:0:11254:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845cb50 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87c8 expref: 19 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785251.188389:0:11254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11254:1876725549113088:192.168.203.46@tcp:105: 00000100:00100000:1.0:1789785251.188457:0:11254:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84d82840 going to sleep for 11 seconds 00000100:00100000:1.0:1789785251.194742:0:11254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11254:1876725549113088:192.168.203.46@tcp:105: 00010000:00010000:1.0:1789785251.194777:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cb49 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.194788:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cb49 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.194818:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cc0d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.194832:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cc0d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.194843:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cc0d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.194854:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cc0d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.194861:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cc0d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.194868:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cc0d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.194874:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785251.194879:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cc0d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.194887:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cc0d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.194917:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:1.0:1789785251.194920:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785251.194924:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cc0d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.194930:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cc0d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.194940:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cbff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.194947:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cbff lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.194953:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cbff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.194959:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eac400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785251.194962:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cbff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.194969:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cbff lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.194976:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:1.0:1789785251.194979:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789785251.194982:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cbff lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.194987:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cbff lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785251.195159:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+19:11400:x1876725530167168:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 26190us (26330us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1789785251.195170:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 139 00000020:00080000:1.0:1789785251.195176:0:11254:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789785251.195805:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789785251.195811:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789785251.196479:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789785251.196489:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789785251.198451:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785251.198601:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785251.199325:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530167552 00000100:00100000:1.0:1789785251.199335:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530167552 00000100:00100000:1.0:1789785251.199412:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530167808 00000100:00100000:1.0:1789785251.199416:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530167808 00000100:00100000:1.0:1789785251.199448:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 31 00000100:00100000:1.0:1789785251.199458:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+20:11399:x1876725530167552:12345-192.168.203.46@tcp:49:lfs.0 00000100:00100000:1.0:1789785251.199579:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+20:11399:x1876725530167552:12345-192.168.203.46@tcp:49:lfs.0 Request processed in 122us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785251.199587:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 31 00000100:00100000:1.0:1789785251.199605:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 32 00000100:00100000:1.0:1789785251.199612:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf88772450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+19:11400:x1876725530167808:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789785251.199828:0:6536:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789785251.199858:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:1.0:1789785251.199887:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cc14 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.199900:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cc14 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.199910:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cc14 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.199917:0:6536:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cc14 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.199937:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cc14 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.199942:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cc14 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.199959:0:6536:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789785251.200573:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789785251.200581:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cc14 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.200589:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65800 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:0.0:1789785251.200593:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cc14 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.200612:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cc14 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.200623:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dae827bd900) 00010000:00010000:0.0:1789785251.200625:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789785251.200630:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cc14 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.200634:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cc14 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785251.200645:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785251.200647:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785251.200648:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785251.200792:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf88772450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+21:11400:x1876725530167808:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 1177us (2187us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1789785251.200800:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 32 00000020:00080000:1.0:1789785251.200805:0:6536:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789785251.203694:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785251.203791:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530168064 00000100:00100000:0.0:1789785251.203800:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530168064 00000100:00100000:0.0:1789785251.203855:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 140 00000100:00100000:0.0:1789785251.203866:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+21:11399:x1876725530168064:12345-192.168.203.46@tcp:58:lfs.0 00000040:00080000:0.0:1789785251.204011:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1789785251.204185:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+21:11399:x1876725530168064:12345-192.168.203.46@tcp:58:lfs.0 Request processed in 320us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785251.204194:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 140 00000100:00100000:0.0:1789785251.238865:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785251.239190:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530168192 00000100:00100000:3.0:1789785251.239201:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530168192 00000100:00100000:3.0:1789785251.239263:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 141 00000100:00100000:3.0:1789785251.239274:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+21:11402:x1876725530168192:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789785251.239297:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785251.239316:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba800/0x2f18ee3fd845cc1b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8800 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.239410:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cc22 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.239424:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cc22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.239558:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cc22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.239573:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cc29 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.239581:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cc29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.239588:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cc29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.239652:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb400/0x2f18ee3fd845cc30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.239676:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cb3b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87c1 expref: 22 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.239683:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb400/0x2f18ee3fd845cc30 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.239725:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cb3b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87c1 expref: 22 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.239737:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cb3b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87c1 expref: 22 pid: 6535 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785251.239749:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1876725549113216:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789785251.239848:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8398ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789785251.248616:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785251.249551:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530168448 00000100:00100000:0.0:1789785251.249561:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530168448 00000100:00100000:0.0:1789785251.249617:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 33 00000100:00100000:0.0:1789785251.249627:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+23:6166:x1876725530168448:12345-192.168.203.46@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789785251.249826:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+24:6166:x1876725530168448:12345-192.168.203.46@tcp:35:ldlm_bl.0 Request processed in 200us (1218us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1789785251.249845:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 33 00000100:00100000:3.0:1789785251.252794:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1876725549113216:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785251.252825:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb400/0x2f18ee3fd845cc30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785251.257053:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785251.257685:0:7484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530168576 00000100:00100000:1.0:1789785251.257695:0:7484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530168576 00010000:00010000:1.0:1789785251.257756:0:7484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cb3b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87c1 expref: 24 pid: 6535 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785251.257801:0:7484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 78 00000100:00100000:1.0:1789785251.257811:0:7484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+24:2398:x1876725530168576:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789785251.257825:0:7484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785251.257831:0:7484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cb3b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87c1 expref: 24 pid: 6535 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.257842:0:7484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cb3b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87c1 expref: 24 pid: 6535 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.257864:0:7484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cb3b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87c1 expref: 24 pid: 6535 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.257899:0:7484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:1.0:1789785251.257905:0:7484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb400/0x2f18ee3fd845cc30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.257913:0:7484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb400/0x2f18ee3fd845cc30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.257920:0:7484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb400/0x2f18ee3fd845cc30 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785251.257955:0:7484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785251.258009:0:7484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+23:2398:x1876725530168576:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 199us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785251.258017:0:7484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 78 00010000:00010000:3.0:1789785251.258142:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb400/0x2f18ee3fd845cc30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.258151:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb400/0x2f18ee3fd845cc30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785251.258198:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789785251.258202:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789785251.258221:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb400/0x2f18ee3fd845cc30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.258244:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb400/0x2f18ee3fd845cc30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.258254:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cc22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.258262:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cc22 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.258268:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cc22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.258274:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814ba400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785251.258278:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cc22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.258285:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cc22 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.258293:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:3.0:1789785251.258296:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785251.258300:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cc22 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.258306:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cc22 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.258315:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cc29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.258321:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cc29 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.258381:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cc29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.258387:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bbe00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785251.258390:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cc29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.258397:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cc29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.258406:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dafac970900) 00010000:00010000:3.0:1789785251.258408:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785251.258411:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cc29 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.258417:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cc29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.258450:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba800/0x2f18ee3fd845cc1b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8800 expref: 23 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.258465:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb400/0x2f18ee3fd845cc30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8800 expref: 22 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785251.258473:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:3.0:1789785251.258475:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789785251.258477:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bb400, rc 0) 00000100:00100000:3.0:1789785251.258502:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+22:11402:x1876725530168192:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 19231us (19646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785251.258519:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 141 00010000:00010000:2.0:1789785251.844007:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789785252.091898:0:14324:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789785252.091906:0:14324:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789785252.091948:0:14324:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789785252.091957:0:14324:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789785252.227489:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789785252.227497:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789785252.227524:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789785252.227532:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789785252.227658:0:13813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf87814000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1876725549113344:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789785252.227787:0:13813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafb6226840 going to sleep for 11 seconds 00000100:00100000:3.0:1789785252.236690:0:13813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf87814000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1876725549113344:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789785252.244037:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785252.244083:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530168704 00000100:00100000:2.0:1789785252.244118:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530168704 00000100:00100000:2.0:1789785252.244182:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 142 00000100:00100000:2.0:1789785252.244194:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+22:11415:x1876725530168704:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789785252.244230:0:11254:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789785252.244368:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+22:11415:x1876725530168704:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 Request processed in 175us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785252.244377:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 142 00000100:00080000:3.0:1789785252.246414:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789785252.253965:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785252.254544:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530168960 00000100:00100000:3.0:1789785252.254555:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530168960 00000100:00100000:3.0:1789785252.254616:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 143 00000100:00100000:3.0:1789785252.254626:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+22:11415:x1876725530168960:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789785252.254648:0:7896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785252.254668:0:7896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cc37 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8807 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785252.254787:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba800/0x2f18ee3fd845cc3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785252.254801:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba800/0x2f18ee3fd845cc3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785252.254813:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba800/0x2f18ee3fd845cc3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785252.254824:0:7896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789785252.254924:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cc37 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8807 expref: 25 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785252.254942:0:7896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba800/0x2f18ee3fd845cc3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8807 expref: 24 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785252.254951:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:3.0:1789785252.254967:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789785252.254971:0:7896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814ba800, rc 0) 00000100:00100000:3.0:1789785252.255034:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+24:11415:x1876725530168960:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 409us (1077us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1789785252.255042:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 143 00000100:00100000:2.0:1789785252.262864:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785252.265451:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530169216 00000100:00100000:2.0:1789785252.265465:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530169216 00000100:00100000:2.0:1789785252.265527:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 144 00000100:00100000:2.0:1789785252.265539:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+24:11415:x1876725530169216:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789785252.265621:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845cc4c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785252.265639:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845cc4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785252.265651:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845cc4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785252.265820:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845cc4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785252.265828:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845cc4c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785252.265835:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845cc4c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785252.265854:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785252.265859:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845cc4c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785252.265867:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845cc4c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785252.265880:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:2.0:1789785252.265883:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789785252.265888:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845cc4c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785252.265894:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845cc4c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785252.266020:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+25:11415:x1876725530169216:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 483us (3163us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1789785252.266029:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 144 00000040:00080000:3.0:1789785252.268325:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789785252.268334:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789785252.271259:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789785252.271278:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789785252.273578:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785252.273672:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785252.274269:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530169344 00000100:00100000:1.0:1789785252.274280:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530169344 00000100:00100000:1.0:1789785252.274370:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:1.0:1789785252.274382:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87816300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:026b2112-ee35-499c-8d01-18663664f08e+25:2397:x1876725530169344:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789785252.274397:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789785252.274494:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530169600 00000100:00100000:2.0:1789785252.274499:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530169600 00000100:00100000:2.0:1789785252.274530:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 34 00000100:00100000:2.0:1789785252.274537:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+26:11415:x1876725530169600:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789785252.274752:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+27:11415:x1876725530169600:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 214us (1079us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1789785252.274760:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 34 00010000:00010000:1.0:1789785252.275148:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba800/0x2f18ee3fd845cc3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8807 expref: 25 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785252.275168:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:1.0:1789785252.275181:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785252.275204:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87816300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:026b2112-ee35-499c-8d01-18663664f08e+25:2397:x1876725530169344:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 825us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785252.275211:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 10 00010000:00010000:0.0:1789785252.866907:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785253.361568:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785253.361615:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785253.361634:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785253.361666:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785253.361689:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785253.361723:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785253.361753:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785253.361783:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530169856 00000100:00100000:2.0:1789785253.361792:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530169856 00000100:00100000:2.0:1789785253.361837:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530170368 00000100:00100000:2.0:1789785253.361840:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530170368 00000100:00100000:2.0:1789785253.361863:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530169984 00000100:00100000:2.0:1789785253.361866:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530169984 00000100:00100000:2.0:1789785253.361878:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530170496 00000100:00100000:2.0:1789785253.361880:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530170496 00000100:00100000:2.0:1789785253.361898:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 300 00000100:00100000:2.0:1789785253.361908:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+25:2398:x1876725530169856:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785253.361986:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+25:2398:x1876725530169856:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 79us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785253.361994:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 300 00000100:00100000:2.0:1789785253.362012:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 301 00000100:00100000:2.0:1789785253.362018:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530170368:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785253.362045:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530170368:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 26us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785253.362051:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 301 00000100:00100000:2.0:1789785253.362063:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 302 00000100:00100000:2.0:1789785253.362070:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530169984:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785253.362111:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530169984:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 41us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785253.362118:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 302 00000100:00100000:2.0:1789785253.362130:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 303 00000100:00100000:2.0:1789785253.362137:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530170496:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785253.362160:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530170496:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 24us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785253.362166:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 303 00000100:00100000:2.0:1789785253.362182:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530169728 00000100:00100000:2.0:1789785253.362185:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530169728 00000100:00100000:2.0:1789785253.362207:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 384 00000100:00100000:2.0:1789785253.362213:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2398:x1876725530169728:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785253.362234:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2398:x1876725530169728:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 21us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785253.362240:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 384 00000100:00100000:2.0:1789785253.362266:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530170112 00000100:00100000:2.0:1789785253.362270:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530170112 00000100:00100000:2.0:1789785253.362294:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530170240 00000100:00100000:2.0:1789785253.362297:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530170240 00000100:00100000:2.0:1789785253.362317:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 122 00000100:00100000:2.0:1789785253.362322:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+6:2398:x1876725530170112:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785253.362373:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+6:2398:x1876725530170112:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 50us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785253.362380:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 122 00000100:00100000:2.0:1789785253.362391:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 123 00000100:00100000:2.0:1789785253.362402:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530170240:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785253.362424:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+5:2398:x1876725530170240:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 23us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785253.362430:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 123 00000100:00080000:2.0:1789785253.362449:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789785253.362453:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789785253.362455:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789785253.362457:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789785253.894734:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789785254.009044:0:14375:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789785254.009054:0:14375:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789785254.009084:0:14375:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789785254.009091:0:14375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789785254.196246:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785254.196426:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530170752 00000100:00100000:3.0:1789785254.196436:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530170752 00000100:00100000:2.0:1789785254.196663:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 145 00000100:00100000:2.0:1789785254.196675:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb5ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+25:11435:x1876725530170752:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:2.0:1789785254.196704:0:7896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785254.196722:0:7896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54e00/0x2f18ee3fd845cc53 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd880e expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785254.196825:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55a00/0x2f18ee3fd845cc5a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785254.196839:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55a00/0x2f18ee3fd845cc5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785254.196849:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55a00/0x2f18ee3fd845cc5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789785254.196859:0:7896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789785254.196970:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54e00/0x2f18ee3fd845cc53 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd880e expref: 28 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785254.196989:0:7896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55a00/0x2f18ee3fd845cc5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd880e expref: 27 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785254.197012:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:2.0:1789785254.197016:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789785254.197019:0:7896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d55a00, rc 0) 00000100:00100000:2.0:1789785254.197080:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb5ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+27:11435:x1876725530170752:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 407us (844us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1789785254.197087:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 145 00000100:00080000:3.0:1789785254.197278:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789785254.202508:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785254.202759:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530170880 00000100:00100000:0.0:1789785254.202769:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530170880 00000100:00100000:0.0:1789785254.202825:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 146 00000100:00100000:0.0:1789785254.202835:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+27:11435:x1876725530170880:12345-192.168.203.46@tcp:54:lfs.0 00010000:00010000:0.0:1789785254.202910:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cc68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785254.202926:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cc68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785254.202937:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cc68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785254.202970:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cc68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785254.202977:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cc68 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785254.202984:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cc68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785254.202990:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eac400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785254.202994:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cc68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785254.203019:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cc68 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785254.203033:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:0.0:1789785254.203036:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789785254.203041:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cc68 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785254.203048:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cc68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785254.203122:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+27:11435:x1876725530170880:12345-192.168.203.46@tcp:54:lfs.0 Request processed in 288us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785254.203130:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 146 00000100:00100000:1.0:1789785254.274907:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785254.275473:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530171008 00000100:00100000:2.0:1789785254.275489:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530171008 00000100:00100000:2.0:1789785254.275575:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 55 00000100:00100000:2.0:1789785254.275587:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf987fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+6:2398:x1876725530171008:12345-192.168.203.46@tcp:101:cat.0 00010000:00010000:2.0:1789785254.275611:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785254.275630:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005dd45b96/0x2f18ee3fd845cc6f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8815 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789785254.275668:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aadf4a0, atime: 0x6aadf4a0, ctime: 0x6aadf4a0, blocks: 0x8 00010000:00010000:2.0:1789785254.275700:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=362s v=(0 0) 00010000:00010000:2.0:1789785254.275705:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785254.275714:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005dd45b96/0x2f18ee3fd845cc6f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8815 expref: 7 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785254.275733:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005dd45b96/0x2f18ee3fd845cc6f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8815 expref: 7 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785254.275747:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d54e00, rc 0) 00000100:00100000:2.0:1789785254.275825:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf987fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+7:2398:x1876725530171008:12345-192.168.203.46@tcp:101:cat.0 Request processed in 241us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785254.275833:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 55 00000100:00100000:3.0:1789785254.283231:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785254.283374:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530171136 00000100:00100000:0.0:1789785254.283387:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530171136 00002000:00100000:0.0:1789785254.283462:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9dae844c0380 x1876725530171136/t0(0) o3->026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp:385/0 lens 488/0 e 0 to 0 dl 1789785265 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789785254.283476:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dae844c0380 with x1876725530171136 ext(0->4095) 00002000:00010000:0.0:1789785254.283483:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dae844c0380 00000100:00100000:0.0:1789785254.283517:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 4 00000100:00100000:0.0:1789785254.283527:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:026b2112-ee35-499c-8d01-18663664f08e+7:2397:x1876725530171136:12345-192.168.203.46@tcp:3:cat.0 00000100:00100000:0.0:1789785254.283764:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:026b2112-ee35-499c-8d01-18663664f08e+7:2397:x1876725530171136:12345-192.168.203.46@tcp:3:cat.0 Request processed in 236us (698us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789785254.284896:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 4 00002000:00100000:0.0:1789785254.284917:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9dae844c0380 x1876725530171136/t0(0) o3->026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp:385/0 lens 488/4536 e 0 to 0 dl 1789785265 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789785254.284953:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dae844c0380 with x1876725530171136 ext(0->4095) 00002000:00010000:0.0:1789785254.284959:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dae844c0380 00000040:00080000:3.0:1789785254.338677:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789785254.338699:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789785254.338725:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789785254.338735:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789785254.722671:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549113472:0@lo:400:kworker.0 00000100:00100000:3.0:1789785254.722708:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1876725549113856:0@lo:400:kworker.0 00000100:00100000:1.0:1789785254.722856:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1876725549113600:0@lo:400:kworker.0 00000040:00080000:0.0:1789785254.724024:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789785254.724224:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549113728:0@lo:400:kworker.0 00000100:00100000:3.0:1789785254.730099:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785254.730229:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549113856 00000100:00100000:1.0:1789785254.730245:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549113856 00000100:00100000:1.0:1789785254.730460:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789785254.730473:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1876725549113856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785254.730697:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549114368:0@lo:400:kworker.0 00000100:00100000:3.0:1789785254.730750:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785254.730784:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1876725549114880:0@lo:400:kworker.0 00000100:00100000:3.0:1789785254.730808:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785254.730838:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549115392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789785254.730864:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785254.730900:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785254.730922:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549113984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789785254.730961:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785254.732384:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549114624:0@lo:400:kworker.0 00000100:00100000:3.0:1789785254.732663:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785254.732714:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf42ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549115136:0@lo:400:kworker.0 00000100:00100000:3.0:1789785254.732737:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785254.732764:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789785254.732771:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549115008:0@lo:400:kworker.0 00000100:00100000:3.0:1789785254.732814:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785254.732856:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549115392 00000100:00100000:3.0:1789785254.732864:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549115392 00000100:00100000:3.0:1789785254.732915:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549113984 00000100:00100000:3.0:1789785254.732918:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549113984 00000100:00100000:3.0:1789785254.732935:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789785254.732944:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3660:x1876725549115392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789785254.733498:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785254.733574:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785254.734362:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3660:x1876725549115392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1395us (3473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785254.734374:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789785254.734574:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789785254.734586:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549113984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789785254.734607:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785254.734650:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549113984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (3688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785254.734657:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789785254.734702:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549114624 00000100:00100000:3.0:1789785254.734709:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549114624 00000100:00100000:3.0:1789785254.734762:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549115136 00000100:00100000:3.0:1789785254.734765:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549115136 00000100:00100000:3.0:1789785254.734776:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549115008 00000100:00100000:3.0:1789785254.734779:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549115008 00000100:00100000:3.0:1789785254.734793:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789785254.734799:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3662:x1876725549114624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785254.734836:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3662:x1876725549114624:12345-0@lo:400:kworker.0 Request processed in 37us (2174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785254.734843:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789785254.734856:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789785254.734862:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3662:x1876725549115136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785254.734889:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3662:x1876725549115136:12345-0@lo:400:kworker.0 Request processed in 28us (2152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785254.734895:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789785254.734905:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789785254.734911:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549115008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785254.734937:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549115008:12345-0@lo:400:kworker.0 Request processed in 26us (2123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785254.734942:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789785254.734965:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549114368 00000100:00100000:3.0:1789785254.734969:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549114368 00000100:00100000:3.0:1789785254.735003:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549114880 00000100:00100000:3.0:1789785254.735006:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549114880 00000100:00100000:3.0:1789785254.735019:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549113600 00000100:00100000:3.0:1789785254.735021:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549113600 00000100:00100000:3.0:1789785254.735034:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789785254.735041:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1876725549114368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785254.735083:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1876725549114368:12345-0@lo:400:kworker.0 Request processed in 43us (4333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785254.735095:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789785254.735106:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1789785254.735112:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1876725549114880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785254.735139:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1876725549114880:12345-0@lo:400:kworker.0 Request processed in 28us (4331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785254.735145:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1789785254.735161:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1789785254.735167:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1876725549113600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785254.737276:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549114112:0@lo:400:kworker.0 00000100:00100000:0.0:1789785254.742209:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785254.742271:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549114240:0@lo:400:kworker.0 00000100:00100000:0.0:1789785254.742309:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785254.742319:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549114752:0@lo:400:kworker.0 00000100:00100000:0.0:1789785254.742351:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785254.742362:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549115264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789785254.742382:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785254.742454:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549113728 00000100:00100000:0.0:1789785254.742464:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549113728 00000100:00100000:0.0:1789785254.743569:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549115264 00000100:00100000:0.0:1789785254.743580:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549115264 00000100:00100000:0.0:1789785254.743613:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789785254.743623:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549113728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785254.743731:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549113728:12345-0@lo:400:kworker.0 Request processed in 109us (1533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785254.743740:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789785254.743756:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789785254.743763:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf85534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549115264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789785254.743791:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789785254.743828:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf85534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549115264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785254.743853:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789785254.743912:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549113728:0@lo:400:kworker.0 00000100:00100000:0.0:1789785254.743930:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549115264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789785254.744084:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549114240 00000100:00100000:0.0:1789785254.744088:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549114240 00000100:00100000:0.0:1789785254.744114:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549114752 00000100:00100000:0.0:1789785254.744116:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549114752 00000100:00100000:0.0:1789785254.744129:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789785254.744135:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549114240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785254.744170:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549114240:12345-0@lo:400:kworker.0 Request processed in 35us (1859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785254.744176:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789785254.744185:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1789785254.744190:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf85534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549114752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785254.744210:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf85534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549114752:12345-0@lo:400:kworker.0 Request processed in 21us (1873us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785254.744216:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1789785254.744238:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549114240:0@lo:400:kworker.0 00000100:00100000:0.0:1789785254.744247:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549114752:0@lo:400:kworker.0 00000100:00080000:0.0:1789785254.744477:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789785254.744482:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789785254.744486:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789785254.744489:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789785254.744533:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549115392:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789785254.744567:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae844c2a00 x1876725549114368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785254.744579:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549114368:0@lo:400:kworker.0 00010000:00080000:0.0:1789785254.744592:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae8393ce00 x1876725549114880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785254.744601:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1876725549114880:0@lo:400:kworker.0 00000100:00100000:0.0:1789785254.744654:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549113472 00000100:00100000:0.0:1789785254.744659:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549113472 00000100:00100000:0.0:1789785254.744707:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1789785254.744714:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:3661:x1876725549113472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785254.744752:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:3661:x1876725549113472:12345-0@lo:400:kworker.0 Request processed in 39us (11184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785254.744758:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1789785254.744829:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549115008:0@lo:400:kworker.0 00000100:00100000:0.0:1789785254.744845:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549113984:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789785254.744859:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549114624:0@lo:400:kworker.0 00000100:00100000:0.0:1789785254.744871:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf42ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549115136:0@lo:400:kworker.0 00000100:00100000:3.0:1789785254.745334:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1876725549113600:12345-0@lo:400:kworker.0 Request processed in 10157us (14422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785254.745368:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1789785254.745435:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1876725549113600:0@lo:400:kworker.0 00000100:00100000:2.0:1789785254.755625:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785254.755648:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1876725549113856:12345-0@lo:400:kworker.0 Request processed in 25173us (26243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785254.755665:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1789785254.755739:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1876725549113856:0@lo:400:kworker.0 00000100:00100000:2.0:1789785254.755761:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549114496:0@lo:400:kworker.0 00000100:00100000:2.0:1789785254.755801:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785254.755848:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549113472:0@lo:400:kworker.0 00000100:00100000:0.0:1789785254.755861:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549114496 00000100:00100000:0.0:1789785254.755868:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549114496 00000100:00100000:0.0:1789785254.755953:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789785254.755963:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549114496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785254.756043:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549114496:12345-0@lo:400:kworker.0 Request processed in 82us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785254.756049:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789785254.756120:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549114496:0@lo:400:kworker.0 00000100:00100000:3.0:1789785254.756593:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549114112 00000100:00100000:3.0:1789785254.756609:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549114112 00000100:00100000:3.0:1789785254.756679:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789785254.756704:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549114112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785254.756809:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549114112:12345-0@lo:400:kworker.0 Request processed in 108us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785254.756817:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789785254.756876:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549114112:0@lo:400:kworker.0 00000100:00080000:1.0:1789785254.759142:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789785254.922936:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789785255.750173:0:9529:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:3.0:1789785255.942543:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785256.258937:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549115648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789785256.259011:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785256.259071:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789785256.259078:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549115520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789785256.259102:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785256.262804:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549115648 00000100:00100000:2.0:1789785256.262820:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549115648 00000100:00100000:2.0:1789785256.262898:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789785256.262910:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf987ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3662:x1876725549115648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789785256.262939:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789785256.263021:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf987ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3662:x1876725549115648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (4010us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785256.263028:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:0.0:1789785256.269009:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789785256.269221:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549115648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789785256.271224:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549115520 00000100:00100000:0.0:1789785256.271237:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549115520 00000100:00100000:0.0:1789785256.271312:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789785256.271321:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf987ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549115520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789785256.271393:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789785256.271693:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf987ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549115520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 372us (12588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785256.271701:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789785256.271800:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549115520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789785256.274099:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549115776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789785256.274169:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785256.277260:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549115776 00000100:00100000:1.0:1789785256.277275:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549115776 00000100:00100000:1.0:1789785256.277391:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789785256.277401:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549115776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789785256.277427:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789785256.277517:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549115776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (3347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785256.277525:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789785256.277868:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549115776:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789785256.277944:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789785256.778894:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1789785256.778945:0:6512:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9daf858286c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1789785256.778951:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dafbf457100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9daf85828540 00000020:00080000:0.0:1789785256.778955:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dafbf457c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dae8384d200 00000020:00080000:0.0:1789785256.779004:0:6512:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:0.0:1789785256.779037:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cbea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785256.779048:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cbea lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785256.779066:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cbea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785256.779301:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785256.779309:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cbea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785256.779319:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cbea lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785256.779383:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dae827bd900) 00010000:00010000:0.0:1789785256.779387:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785256.779392:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cbea lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785256.779399:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cbea lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789785256.779452:0:6565:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1789785256.779515:0:6565:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1789785256.789217:0:8445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:1.0:1789785256.789233:0:8445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00010000:00010000:3.0:1789785256.963291:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785257.986781:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785258.486126:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785258.486226:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785258.486274:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785258.486359:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530171648 00000100:00100000:3.0:1789785258.486380:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530171648 00000100:00100000:3.0:1789785258.486462:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 128 00000100:00100000:3.0:1789785258.486476:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae845cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+6:2399:x1876725530171648:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785258.486570:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae845cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+6:2399:x1876725530171648:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 98us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785258.486579:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 128 00000100:00100000:0.0:1789785258.487747:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530171392 00000100:00100000:0.0:1789785258.487759:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530171392 00000100:00100000:0.0:1789785258.487814:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530171904 00000100:00100000:0.0:1789785258.487819:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530171904 00000100:00100000:0.0:1789785258.487853:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 310 00000100:00100000:0.0:1789785258.487863:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae845cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+13:2399:x1876725530171392:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785258.487939:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae845cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+13:2399:x1876725530171392:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 65us (1814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785258.487946:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 310 00000100:00100000:0.0:1789785258.487970:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 311 00000100:00100000:0.0:1789785258.487976:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae845cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2399:x1876725530171904:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785258.488003:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae845cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2399:x1876725530171904:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 27us (1728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785258.488009:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 311 00000100:00080000:0.0:1789785258.488029:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789785258.488034:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789785258.492134:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785258.492186:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785258.492297:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530171264 00000100:00100000:2.0:1789785258.492308:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530171264 00000100:00100000:2.0:1789785258.492406:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 386 00000100:00100000:2.0:1789785258.492443:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2400:x1876725530171264:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785258.492523:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2400:x1876725530171264:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 91us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785258.492531:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 386 00000100:00100000:3.0:1789785258.492938:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785258.492969:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785258.493016:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530171776 00000100:00100000:0.0:1789785258.493029:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530171776 00000100:00100000:0.0:1789785258.493113:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 129 00000100:00100000:0.0:1789785258.493125:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530171776:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785258.493193:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530171776:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 71us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785258.493200:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 129 00000100:00080000:2.0:1789785258.493558:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789785258.495287:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530171520 00000100:00100000:1.0:1789785258.495300:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530171520 00000100:00100000:1.0:1789785258.495492:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530172032 00000100:00100000:1.0:1789785258.495496:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530172032 00000100:00100000:3.0:1789785258.495552:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 312 00000100:00100000:3.0:1789785258.495564:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530171520:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785258.495650:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530171520:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 76us (3451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785258.495665:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 312 00000100:00080000:2.0:1789785258.498137:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789785258.498302:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 313 00000100:00100000:1.0:1789785258.498315:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2400:x1876725530172032:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785258.498421:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2400:x1876725530172032:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 109us (5451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785258.498429:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 313 00010000:00010000:1.0:1789785259.013565:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785259.325665:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785259.325807:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530172160 00000100:00100000:3.0:1789785259.325821:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530172160 00000100:00100000:3.0:1789785259.325910:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 147 00000100:00100000:3.0:1789785259.325923:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+13:11080:x1876725530172160:12345-192.168.203.46@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789785259.326051:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+13:11080:x1876725530172160:12345-192.168.203.46@tcp:60:lhsmtool_posix.0 Request processed in 131us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785259.326060:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 147 00000100:00100000:0.0:1789785259.330962:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785259.334012:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530172288 00000100:00100000:2.0:1789785259.334032:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530172288 00000100:00100000:2.0:1789785259.334144:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 148 00000100:00100000:2.0:1789785259.334156:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+5:11080:x1876725530172288:12345-192.168.203.46@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789785259.334315:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+5:11080:x1876725530172288:12345-192.168.203.46@tcp:60:lhsmtool_posix.0 Request processed in 160us (3360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785259.334324:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 148 00000100:00100000:0.0:1789785259.345662:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785259.347536:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530172544 00000100:00100000:2.0:1789785259.347556:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530172544 00000100:00100000:2.0:1789785259.347644:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 35 00000100:00100000:2.0:1789785259.347669:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+13:11080:x1876725530172544:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789785259.347977:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+14:11080:x1876725530172544:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 310us (2336us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1789785259.347986:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 35 00000100:00100000:3.0:1789785259.662283:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785259.663088:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530172672 00000100:00100000:0.0:1789785259.663114:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530172672 00000100:00100000:0.0:1789785259.663205:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 149 00000100:00100000:0.0:1789785259.663227:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:11894:x1876725530172672:12345-192.168.203.46@tcp:101:lsof.0 00010000:00010000:0.0:1789785259.663259:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785259.663287:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cc76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd881c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785259.663423:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cc7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785259.663464:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cc7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785259.663478:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cc7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785259.663543:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789785259.663557:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789785259.663607:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cc7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785259.663635:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cc76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd881c expref: 7 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785259.663666:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cc7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd881c expref: 6 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785259.663676:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafbaaba900) 00010000:00010000:0.0:1789785259.663679:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789785259.663683:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eac400, rc 0) 00000100:00100000:0.0:1789785259.663769:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+6:11894:x1876725530172672:12345-192.168.203.46@tcp:101:lsof.0 Request processed in 555us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785259.663777:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 149 00000100:00100000:0.0:1789785259.844783:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549115904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789785259.844885:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785259.844972:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789785259.844980:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549116288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789785259.845006:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785259.845071:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549115904 00000100:00100000:0.0:1789785259.845081:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549115904 00000100:00100000:0.0:1789785259.845159:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549116288 00000100:00100000:0.0:1789785259.845163:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549116288 00000100:00100000:0.0:1789785259.845188:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789785259.845199:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8393ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549115904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789785259.845246:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785259.845291:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8393ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549115904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785259.845299:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789785259.845316:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789785259.845322:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8393df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549116288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789785259.845331:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785259.845379:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8393df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549116288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785259.845385:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789785259.845454:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549116288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789785259.845464:0:3660:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1789785259.845469:0:3660:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1789785259.845495:0:3660:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dae844c2300, transno 4294967305 00000100:00100000:0.0:1789785259.845510:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549115904:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789785259.845582:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789785259.845597:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae845cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549116160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789785259.845627:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785259.845659:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789785259.845666:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549116032:0@lo:400:kworker.0 00000100:00100000:0.0:1789785259.846629:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785259.846705:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549116032 00000100:00100000:0.0:1789785259.846713:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549116032 00000100:00100000:0.0:1789785259.846759:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1789785259.846767:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:3662:x1876725549116032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785259.846817:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:3662:x1876725549116032:12345-0@lo:400:kworker.0 Request processed in 51us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785259.846825:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1789785259.846881:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549116032:0@lo:400:kworker.0 00000100:00100000:0.0:1789785259.847087:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549116160 00000100:00100000:0.0:1789785259.847092:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549116160 00000100:00100000:0.0:1789785259.847209:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789785259.847288:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8393fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549116160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789785259.847328:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789785259.847470:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8393fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549116160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 254us (1842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785259.847477:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789785259.847516:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae845cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549116160:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789785259.850796:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549116544:0@lo:400:kworker.0 00000100:00100000:3.0:1789785259.850888:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785259.850950:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549117056:0@lo:400:kworker.0 00000100:00100000:3.0:1789785259.850976:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785259.851001:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789785259.851006:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549116672:0@lo:400:kworker.0 00000100:00100000:3.0:1789785259.851030:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785259.851045:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549117184:0@lo:400:kworker.0 00000100:00100000:3.0:1789785259.851063:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785259.851095:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549116544 00000100:00100000:3.0:1789785259.851115:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549116544 00000100:00100000:3.0:1789785259.851168:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789785259.851177:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549116544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785259.851399:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549116544:12345-0@lo:400:kworker.0 Request processed in 221us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785259.851408:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789785259.851433:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549117056 00000100:00100000:3.0:1789785259.851436:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549117056 00000100:00100000:3.0:1789785259.851481:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549117184 00000100:00100000:3.0:1789785259.851484:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549117184 00000100:00100000:3.0:1789785259.851502:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789785259.851508:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549117056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785259.851537:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549117056:12345-0@lo:400:kworker.0 Request processed in 29us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785259.851543:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789785259.851553:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789785259.851558:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549117184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785259.851577:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549117184:12345-0@lo:400:kworker.0 Request processed in 19us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785259.851593:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789785259.851635:0:3661:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967314 gen 2 00000004:00080000:3.0:1789785259.851640:0:3661:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dae844c3800, transno 4294967312 00000004:00080000:3.0:1789785259.851662:0:3661:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967314 committed transno 4294967314 00000100:00100000:3.0:1789785259.851692:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549117184:0@lo:400:kworker.0 00000100:00100000:3.0:1789785259.851704:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549116544:0@lo:400:kworker.0 00000100:00100000:3.0:1789785259.851711:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549117056:0@lo:400:kworker.0 00000100:00080000:3.0:1789785259.851839:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789785259.851851:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549116672 00000100:00100000:3.0:1789785259.851854:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549116672 00000100:00100000:3.0:1789785259.851881:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1789785259.851887:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549116672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785259.851921:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549116672:12345-0@lo:400:kworker.0 Request processed in 34us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785259.851928:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1789785259.851953:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549116672:0@lo:400:kworker.0 00000100:00100000:1.0:1789785259.852386:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549116800:0@lo:400:kworker.0 00000100:00100000:1.0:1789785259.852427:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785259.852461:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549117312:0@lo:400:kworker.0 00000100:00100000:1.0:1789785259.852481:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785259.852502:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789785259.852508:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549116416:0@lo:400:kworker.0 00000100:00100000:1.0:1789785259.852538:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785259.852551:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549116928:0@lo:400:kworker.0 00000100:00100000:1.0:1789785259.852568:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785259.852579:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1876725549117440:0@lo:400:kworker.0 00000100:00100000:1.0:1789785259.852596:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785259.852615:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549116800 00000100:00100000:1.0:1789785259.852618:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549116800 00000100:00100000:1.0:1789785259.852658:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549117312 00000100:00100000:1.0:1789785259.852661:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549117312 00000100:00100000:1.0:1789785259.852676:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549116416 00000100:00100000:1.0:1789785259.852678:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549116416 00000100:00100000:1.0:1789785259.852687:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549116928 00000100:00100000:1.0:1789785259.852689:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549116928 00000100:00100000:1.0:1789785259.852700:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549117440 00000100:00100000:1.0:1789785259.852703:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549117440 00000100:00100000:1.0:1789785259.852716:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1789785259.852723:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae845cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549116800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785259.852767:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae845cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549116800:12345-0@lo:400:kworker.0 Request processed in 43us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785259.852774:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1789785259.852789:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1789785259.852795:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae845cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549117312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785259.852820:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae845cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549117312:12345-0@lo:400:kworker.0 Request processed in 25us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785259.852825:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1789785259.852837:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789785259.852842:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae845cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549116416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785259.852880:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae845cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549116416:12345-0@lo:400:kworker.0 Request processed in 38us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785259.852886:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789785259.852899:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1789785259.852905:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae845ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549116928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785259.852933:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae845ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549116928:12345-0@lo:400:kworker.0 Request processed in 28us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785259.852938:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1789785259.852949:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789785259.852955:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae845cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876725549117440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785259.852979:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae845cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876725549117440:12345-0@lo:400:kworker.0 Request processed in 24us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785259.852984:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789785259.853013:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549116416:0@lo:400:kworker.0 00010000:00080000:1.0:1789785259.853026:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae846a3100 x1876725549116928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785259.853037:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549116928:0@lo:400:kworker.0 00010000:00080000:1.0:1789785259.853048:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae846a2d80 x1876725549117440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785259.853055:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1876725549117440:0@lo:400:kworker.0 00000100:00100000:1.0:1789785259.853063:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549116800:0@lo:400:kworker.0 00000100:00100000:1.0:1789785259.853072:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549117312:0@lo:400:kworker.0 00000100:00080000:3.0:1789785259.853386:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789785259.853393:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789785260.034547:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785261.058656:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785261.379068:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789785261.379102:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549117568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789785261.379212:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785261.379467:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549117568 00000100:00100000:2.0:1789785261.379479:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549117568 00000100:00100000:2.0:1789785261.379575:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789785261.379588:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549117568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789785261.379657:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789785261.379717:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549117568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785261.379725:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789785261.379788:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549117568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789785261.380421:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae845cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549117824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789785261.380468:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785261.380511:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549117824 00000100:00100000:1.0:1789785261.380516:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549117824 00000100:00100000:1.0:1789785261.380566:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789785261.380574:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb6190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549117824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789785261.380588:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789785261.380622:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb6190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549117824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785261.380628:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789785261.380885:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae845cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549117824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789785261.380903:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae845cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549117696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789785261.380942:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785261.382315:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549117696 00000100:00100000:0.0:1789785261.382330:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549117696 00000100:00100000:0.0:1789785261.382425:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789785261.382435:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae845cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549117696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789785261.382479:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789785261.382584:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae845cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549117696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (1640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785261.382592:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:0.0:1789785261.382615:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789785261.382976:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae845cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549117696:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789785262.082556:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789785262.926444:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:1.0:1789785262.926468:0:6512:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1789785262.926589:0:6565:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1789785262.926602:0:6565:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1789785263.108992:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789785263.570566:0:14574:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 22:34:20 (1789785260) 00000100:00100000:1.0:1789785263.604724:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785263.604764:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785263.604795:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530172928 00000100:00100000:1.0:1789785263.604798:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785263.604813:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530172928 00000100:00100000:1.0:1789785263.604829:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785263.604847:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785263.604862:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785263.604883:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785263.604911:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530173184 00000100:00100000:1.0:1789785263.604930:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530173184 00000100:00100000:1.0:1789785263.604984:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530173312 00000100:00100000:1.0:1789785263.604986:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530173312 00000100:00100000:1.0:1789785263.605008:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 132 00000100:00100000:1.0:1789785263.605026:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae845cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+6:2397:x1876725530173184:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785263.605068:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530173440 00000100:00100000:3.0:1789785263.605093:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530173440 00000100:00100000:1.0:1789785263.605099:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae845cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+6:2397:x1876725530173184:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 81us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785263.605111:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 132 00000100:00100000:1.0:1789785263.605135:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 133 00000100:00100000:1.0:1789785263.605145:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae845cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530173312:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785263.605172:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530173056 00000100:00100000:1.0:1789785263.605177:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae845cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530173312:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 35us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785263.605179:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530173056 00000100:00100000:1.0:1789785263.605191:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 133 00000100:00100000:1.0:1789785263.605210:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530173568 00000100:00100000:1.0:1789785263.605214:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530173568 00000100:00100000:3.0:1789785263.605406:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 320 00000100:00100000:3.0:1789785263.605427:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae845cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+13:2397:x1876725530172928:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785263.605507:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae845cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+13:2397:x1876725530172928:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 92us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785263.605514:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 320 00000100:00100000:3.0:1789785263.605530:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 321 00000100:00100000:3.0:1789785263.605551:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae845ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+6:2397:x1876725530173440:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785263.605582:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae845ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+6:2397:x1876725530173440:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 31us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785263.605588:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 321 00000100:00100000:3.0:1789785263.605597:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 322 00000100:00100000:0.0:1789785263.607899:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530172800 00000100:00100000:0.0:1789785263.607912:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530172800 00000100:00100000:0.0:1789785263.607963:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 388 00000100:00100000:0.0:1789785263.607971:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2397:x1876725530172800:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785263.608030:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2397:x1876725530172800:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 60us (3202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785263.608036:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 388 00000100:00080000:0.0:1789785263.608077:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789785263.608731:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 323 00000100:00100000:1.0:1789785263.608740:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae845ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2397:x1876725530173568:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785263.608778:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae845ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2397:x1876725530173568:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 39us (3894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785263.608784:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 323 00000100:00100000:3.0:1789785263.609138:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae845cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530173056:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785263.609300:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae845cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530173056:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 3695us (4449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785263.609310:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 322 00000100:00080000:0.0:1789785263.609735:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789785263.609742:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789785263.609745:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789785264.132970:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789785264.578556:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789785264.578564:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789785264.578679:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1789785264.578686:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789785264.911864:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785264.913153:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530173824 00000100:00100000:0.0:1789785264.913169:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530173824 00000100:00100000:0.0:1789785264.913255:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 150 00000100:00100000:0.0:1789785264.913268:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae845cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+13:12161:x1876725530173824:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789785264.913293:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785264.913317:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845cc84 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8823 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785264.913444:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845cc8b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785264.913458:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845cc8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785264.913471:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845cc8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785264.913486:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cc92 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785264.913493:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cc92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785264.913500:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cc92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785264.913590:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845cc99 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785264.913599:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845cc99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785264.913606:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845cc99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785264.913626:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789785264.913718:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845cc8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785264.913725:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845cc8b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785264.913738:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845cc8b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785264.913742:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eac800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785264.913747:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845cc8b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785264.913753:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845cc8b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785264.913764:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dae827c0300) 00010000:00010000:0.0:1789785264.913767:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785264.913771:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845cc8b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785264.913776:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845cc8b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785264.913787:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cc92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785264.913792:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cc92 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785264.913796:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cc92 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785264.913801:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eace00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785264.913803:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cc92 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785264.913816:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cc92 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785264.913823:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9dae82670500) 00010000:00010000:0.0:1789785264.913824:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785264.913827:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cc92 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785264.913832:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cc92 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785264.914099:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845cc84 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8823 expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785264.914113:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845cc99 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8823 expref: 15 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785264.914120:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9daf87d6e700) 00010000:00010000:0.0:1789785264.914123:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785264.914125:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eada00, rc 0) 00000100:00100000:0.0:1789785264.914192:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae845cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+15:12161:x1876725530173824:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 927us (2345us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789785264.914201:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 150 00000100:00100000:1.0:1789785264.918962:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785264.919143:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785264.925237:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530174080 00000100:00100000:0.0:1789785264.925252:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530174080 00000100:00100000:0.0:1789785264.925329:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 151 00000100:00100000:0.0:1789785264.925366:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae845cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+15:12161:x1876725530174080:12345-192.168.203.46@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789785264.925416:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530173952 00000100:00100000:2.0:1789785264.925432:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530173952 00000100:00100000:0.0:1789785264.925504:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae845cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+16:12161:x1876725530174080:12345-192.168.203.46@tcp:59:lhsmtool_posix.0 Request processed in 164us (6358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785264.925517:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:0.0:1789785264.925517:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 151 00000100:00100000:2.0:1789785264.925541:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+15:2400:x1876725530173952:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789785264.925559:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785264.925594:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845cc99 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8823 expref: 15 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785264.933328:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9daf87d6e700) 00010000:00010000:2.0:1789785264.933351:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785264.933866:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+14:2400:x1876725530173952:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 8327us (14917us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785264.933878:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:1.0:1789785264.944716:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785264.944810:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530174208 00000100:00100000:3.0:1789785264.944820:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530174208 00000100:00100000:3.0:1789785264.944872:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 152 00000100:00100000:3.0:1789785264.944881:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae845cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+5:12161:x1876725530174208:12345-192.168.203.46@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789785264.946093:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae845cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+5:12161:x1876725530174208:12345-192.168.203.46@tcp:59:lhsmtool_posix.0 Request processed in 1207us (1381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785264.946102:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 152 00000040:00080000:1.0:1789785264.963074:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789785264.963388:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549117952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789785264.963454:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785264.963541:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549117952 00000100:00100000:0.0:1789785264.963549:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549117952 00000100:00100000:3.0:1789785264.963554:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549118080:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789785264.963617:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789785264.963629:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549117952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789785264.963656:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785264.963708:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549117952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785264.963715:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:0.0:1789785264.963744:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789785264.963745:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785264.963913:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549117952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789785264.963930:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc1b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549118208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789785264.963979:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785264.964074:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789785264.964085:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549118336:0@lo:400:kworker.0 00000100:00100000:2.0:1789785264.964121:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785264.964194:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876725549118464:0@lo:400:kworker.0 00000100:00100000:2.0:1789785264.964222:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785264.964406:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb53b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549118592:0@lo:400:kworker.0 00000100:00100000:2.0:1789785264.964431:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785264.964479:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb53a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725549118720:0@lo:400:kworker.0 00000100:00100000:2.0:1789785264.964502:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785264.964546:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549118848:0@lo:400:kworker.0 00000100:00100000:2.0:1789785264.964580:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785264.964702:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83a23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549118976:0@lo:400:kworker.0 00000100:00100000:2.0:1789785264.964733:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785264.964765:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549118464 00000100:00100000:2.0:1789785264.964772:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549118464 00000100:00100000:2.0:1789785264.964816:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549118720 00000100:00100000:2.0:1789785264.964819:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549118720 00000100:00100000:2.0:1789785264.964832:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549118848 00000100:00100000:2.0:1789785264.964834:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549118848 00000100:00100000:1.0:1789785264.965055:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549118336 00000100:00100000:1.0:1789785264.965060:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549118336 00000100:00100000:1.0:1789785264.965097:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1789785264.965108:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:3660:x1876725549118336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785264.965269:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:3660:x1876725549118336:12345-0@lo:400:kworker.0 Request processed in 162us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785264.965277:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1789785264.965524:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549118976 00000100:00100000:2.0:1789785264.965528:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549118976 00000100:00100000:1.0:1789785264.965585:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549118336:0@lo:400:kworker.0 00000100:00100000:2.0:1789785264.965720:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789785264.965730:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876725549118464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785264.965825:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876725549118464:12345-0@lo:400:kworker.0 Request processed in 97us (1602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785264.965832:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789785264.965845:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789785264.965850:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb53bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725549118720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785264.965885:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb53bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725549118720:12345-0@lo:400:kworker.0 Request processed in 35us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785264.965893:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789785264.965903:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789785264.965922:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549118848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785264.965950:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549118848:12345-0@lo:400:kworker.0 Request processed in 29us (1380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785264.965956:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789785264.965968:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1789785264.965974:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1876725549118976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785264.965999:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1876725549118976:12345-0@lo:400:kworker.0 Request processed in 25us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785264.966004:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1789785264.966036:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb53a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725549118720:0@lo:400:kworker.0 00000100:00100000:2.0:1789785264.966061:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549118848:0@lo:400:kworker.0 00000100:00100000:1.0:1789785264.966173:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876725549118464:0@lo:400:kworker.0 00010000:00080000:1.0:1789785264.966194:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83a23800 x1876725549118976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785264.966208:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83a23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549118976:0@lo:400:kworker.0 00000100:00100000:1.0:1789785264.966538:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549118208 00000100:00100000:1.0:1789785264.966544:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549118208 00000100:00100000:1.0:1789785264.966581:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549118592 00000100:00100000:1.0:1789785264.966585:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549118592 00000100:00100000:1.0:1789785264.966679:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789785264.966687:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549118208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789785264.966723:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789785264.966776:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549118208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (2800us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785264.966783:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789785264.966798:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789785264.966805:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb538700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549118592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785264.966838:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb538700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549118592:12345-0@lo:400:kworker.0 Request processed in 34us (2405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785264.966855:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789785264.966999:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc1b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549118208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789785264.967032:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb53b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549118592:0@lo:400:kworker.0 00000100:00100000:1.0:1789785264.967114:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549119104:0@lo:400:kworker.0 00000100:00100000:1.0:1789785264.967154:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785264.967313:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789785264.967320:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb53b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549119232:0@lo:400:kworker.0 00000100:00100000:1.0:1789785264.967373:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785264.967416:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549119104 00000100:00100000:1.0:1789785264.967421:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549119104 00000100:00100000:1.0:1789785264.967453:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549119232 00000100:00100000:1.0:1789785264.967456:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549119232 00000100:00100000:1.0:1789785264.967479:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789785264.967485:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc1b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549119104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785264.967521:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc1b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549119104:12345-0@lo:400:kworker.0 Request processed in 35us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785264.967527:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789785264.967540:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789785264.967547:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549119232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785264.967574:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549119232:12345-0@lo:400:kworker.0 Request processed in 28us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785264.967579:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789785264.967687:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb53b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549119232:0@lo:400:kworker.0 00000100:00100000:1.0:1789785264.967698:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549119104:0@lo:400:kworker.0 00000100:00100000:1.0:1789785264.967902:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549119360:0@lo:400:kworker.0 00000100:00100000:1.0:1789785264.967935:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785264.967997:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549119360 00000100:00100000:2.0:1789785264.968001:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549119360 00000100:00100000:2.0:1789785264.968032:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789785264.968039:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549119360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785264.968114:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549119360:12345-0@lo:400:kworker.0 Request processed in 75us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785264.968121:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789785264.968164:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb53a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1876725549119488:0@lo:400:kworker.0 00000100:00100000:2.0:1789785264.968188:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785264.968325:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549119488 00000100:00100000:2.0:1789785264.968329:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549119488 00000100:00100000:2.0:1789785264.968380:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789785264.968387:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb53b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1876725549119488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785264.968423:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb53b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1876725549119488:12345-0@lo:400:kworker.0 Request processed in 37us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785264.968429:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00010000:00080000:2.0:1789785264.968464:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb53a300 x1876725549119488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785264.968477:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb53a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1876725549119488:0@lo:400:kworker.0 00000100:00080000:2.0:1789785264.968536:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789785264.968543:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789785264.968545:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789785264.969118:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549118080 00000100:00100000:3.0:1789785264.969134:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549118080 00000100:00080000:3.0:1789785264.969197:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789785264.969251:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789785264.969262:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549118080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789785264.969292:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785264.969401:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549118080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 141us (5660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785264.969409:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789785264.969470:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549118080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789785264.969702:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549119360:0@lo:400:kworker.0 00010000:00010000:1.0:1789785265.158271:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789785265.611521:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789785265.611531:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789785265.612106:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1789785265.612122:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789785266.178531:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785266.499275:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789785266.499302:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549119616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789785266.499741:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785266.499886:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549119616 00000100:00100000:0.0:1789785266.499894:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549119616 00000100:00100000:0.0:1789785266.499948:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789785266.499956:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549119616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789785266.499989:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789785266.500041:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549119616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785266.500048:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789785266.500089:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549119616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789785266.501421:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549119744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789785266.501495:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785266.501535:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549119744 00000100:00100000:0.0:1789785266.501540:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549119744 00000100:00100000:0.0:1789785266.501578:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789785266.501586:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549119744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789785266.501619:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789785266.501654:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549119744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785266.501662:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789785266.501704:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549119744:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789785266.501736:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789785266.505681:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789785266.519652:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549119872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789785266.519777:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785266.520090:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549119872 00000100:00100000:3.0:1789785266.520100:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549119872 00000100:00100000:3.0:1789785266.520200:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789785266.520241:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549119872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789785266.520266:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789785266.520365:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549119872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785266.520374:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789785266.520432:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549119872:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789785266.521044:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789785267.220496:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785267.263624:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785267.263705:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530174336 00000100:00100000:2.0:1789785267.263714:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530174336 00000100:00100000:2.0:1789785267.263784:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 153 00000100:00100000:2.0:1789785267.263794:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+14:12203:x1876725530174336:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:2.0:1789785267.263821:0:11254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785267.263843:0:11254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cca7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd882a expref: -99 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.263906:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845ccae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.263934:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845ccae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.263959:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845ccae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.263975:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54a00/0x2f18ee3fd845ccb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.263983:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54a00/0x2f18ee3fd845ccb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.263991:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54a00/0x2f18ee3fd845ccb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.264035:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845ccae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.264042:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845ccae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.264049:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845ccae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.264055:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785267.264060:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845ccae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.264069:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845ccae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.264083:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafbaaba900) 00010000:00010000:2.0:1789785267.264087:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785267.264092:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845ccae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.264107:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845ccae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.264119:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54a00/0x2f18ee3fd845ccb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.264126:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54a00/0x2f18ee3fd845ccb5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.264131:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54a00/0x2f18ee3fd845ccb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.264136:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785267.264139:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54a00/0x2f18ee3fd845ccb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.264145:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54a00/0x2f18ee3fd845ccb5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.264152:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9dae827bd100) 00010000:00010000:2.0:1789785267.264155:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785267.264157:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54a00/0x2f18ee3fd845ccb5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.264162:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54a00/0x2f18ee3fd845ccb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.264193:0:11254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cca7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd882a expref: 15 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.264216:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafbaaba900) 00010000:00010000:2.0:1789785267.264219:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785267.264223:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cca7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd882a expref: 15 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.264234:0:11254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d54200, rc 0) 00000100:00100000:2.0:1789785267.264304:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+14:12203:x1876725530174336:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 510us (689us total) trans 0 rc 301/301 00000100:00100000:2.0:1789785267.264312:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 153 00000100:00080000:1.0:1789785267.264732:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789785267.275715:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785267.275838:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530174592 00000100:00100000:2.0:1789785267.275848:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530174592 00000100:00100000:2.0:1789785267.275903:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 154 00000100:00100000:2.0:1789785267.275913:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+14:12203:x1876725530174592:12345-192.168.203.46@tcp:36:lfs.0 00010000:00010000:2.0:1789785267.275962:0:7896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785267.275985:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845c5fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd864e expref: 14 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.276002:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafbaaba900) 00010000:00010000:2.0:1789785267.276007:0:7896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789785267.276061:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845ccbc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.276076:0:7896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cc7d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd881c expref: 5 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.276084:0:7896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845ccbc lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.276126:0:7896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cc7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd881c expref: 5 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.276139:0:7896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cc7d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd881c expref: 5 pid: 6535 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785267.276154:0:7896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb53a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7896:1876725549120000:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789785267.276244:0:7896:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafac70bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789785267.282844:0:7896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb53a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7896:1876725549120000:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789785267.282872:0:7896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845ccbc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785267.284715:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785267.284894:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530174720 00000100:00100000:0.0:1789785267.284903:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530174720 00010000:00010000:0.0:1789785267.284964:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cc7d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd881c expref: 6 pid: 6535 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785267.285009:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 79 00000100:00100000:0.0:1789785267.285020:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+6:2398:x1876725530174720:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789785267.285033:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785267.285041:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cc7d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd881c expref: 6 pid: 6535 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.285066:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cc7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd881c expref: 6 pid: 6535 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.285106:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cc7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd881c expref: 6 pid: 6535 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.285121:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafbaaba900) 00010000:00010000:0.0:1789785267.285127:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845ccbc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.285136:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845ccbc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.285144:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845ccbc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.285171:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785267.285220:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2398:x1876725530174720:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 201us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785267.285227:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 79 00010000:00010000:0.0:1789785267.285253:0:7896:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845ccbc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.285272:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845ccbc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.285295:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845ccc3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.285304:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845ccc3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.285312:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845ccc3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.285981:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845ccca lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.285992:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845ccca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.286001:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845ccca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789785267.286016:0:7896:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8bfb837 reply state 00000000c073b997 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845ccca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.286027:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845ccca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.286033:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:0.0:1789785267.286036:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789785267.286039:0:7896:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00080000:2.0:1789785267.286525:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1789785267.287680:0:7896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789785267.287700:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845ccbc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.287709:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845ccbc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.287717:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845ccbc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.287722:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785267.287727:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845ccbc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.288315:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845ccbc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.288330:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafbaaba900) 00010000:00010000:0.0:1789785267.288333:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785267.288356:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845ccbc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.288364:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845ccbc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789785267.288384:0:7896:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8bfb837 reply state 00000000c073b997 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845ccc3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.288395:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845ccc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.288402:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9dae82670500) 00010000:00010000:0.0:1789785267.288405:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789785267.288407:0:7896:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789785267.289014:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+15:12203:x1876725530174592:12345-192.168.203.46@tcp:36:lfs.0 Request processed in 13098us (13306us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1789785267.289024:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 154 00000100:00100000:3.0:1789785267.427292:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785267.427498:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530174848 00000100:00100000:1.0:1789785267.427512:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530174848 00000100:00100000:1.0:1789785267.427586:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 155 00000100:00100000:1.0:1789785267.427608:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+15:12211:x1876725530174848:12345-192.168.203.46@tcp:101:lctl.0 00010000:00010000:1.0:1789785267.427646:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785267.427677:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845ccd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8831 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.427765:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845ccd8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.427782:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845ccd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.427797:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845ccd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789785267.427866:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789785267.427870:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789785267.427900:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845ccd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.427955:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845ccd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8831 expref: 17 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.427978:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845ccd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8831 expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.427988:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dae827c3c00) 00010000:00010000:1.0:1789785267.427991:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789785267.427996:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64400, rc 0) 00000100:00100000:1.0:1789785267.428077:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+16:12211:x1876725530174848:12345-192.168.203.46@tcp:101:lctl.0 Request processed in 471us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785267.428086:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 155 00000100:00100000:1.0:1789785267.500066:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785267.500856:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530174976 00000100:00100000:2.0:1789785267.500970:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530174976 00000100:00100000:3.0:1789785267.501481:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 156 00000100:00100000:3.0:1789785267.501496:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+16:12217:x1876725530174976:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:3.0:1789785267.501552:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785267.501579:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845ccdf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8838 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.501684:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cce6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.501702:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cce6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.501716:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cce6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.501727:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845cced lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.501735:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845cced lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.501742:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845cced lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.501843:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba800/0x2f18ee3fd845ccf4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.501852:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba800/0x2f18ee3fd845ccf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.501859:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba800/0x2f18ee3fd845ccf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785267.502803:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789785267.502825:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789785267.502854:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba800/0x2f18ee3fd845ccf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.503065:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cce6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.503073:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cce6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.503081:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cce6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.503088:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bbe00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785267.503094:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cce6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.503104:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cce6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.503121:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dae827c3c00) 00010000:00010000:3.0:1789785267.503123:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785267.503130:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cce6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.503137:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cce6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.503157:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845cced lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.503164:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845cced lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.503180:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845cced lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.503186:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bb000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785267.503189:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845cced lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.503196:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845cced lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.503204:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9dae82670500) 00010000:00010000:3.0:1789785267.503207:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785267.503210:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845cced lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.503215:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845cced lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.503259:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845ccdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8838 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.503282:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba800/0x2f18ee3fd845ccf4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8838 expref: 17 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.503290:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:3.0:1789785267.503292:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789785267.503295:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814ba800, rc 0) 00000100:00100000:3.0:1789785267.503697:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+17:12217:x1876725530174976:12345-192.168.203.46@tcp:101:bash.0 Request processed in 2202us (3643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785267.503717:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 156 00000100:00100000:2.0:1789785267.510853:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785267.511321:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530175232 00000100:00100000:0.0:1789785267.511368:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530175232 00000100:00100000:0.0:1789785267.511567:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 157 00000100:00100000:0.0:1789785267.511600:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb53a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+17:12217:x1876725530175232:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:0.0:1789785267.511627:0:7896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785267.511665:0:7896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845ccfb lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd883f expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.511838:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cd02 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.511856:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cd02 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.512796:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cd02 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.518395:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845cd09 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.518427:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845cd09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.518444:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845cd09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789785267.518998:0:7896:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:1.0:1789785267.519173:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cd10 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.519183:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cd10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.519203:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cd10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.519249:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cd02 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.519256:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cd02 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.519263:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cd02 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.519270:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eace00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785267.519275:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cd02 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.519283:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cd02 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.519299:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:1.0:1789785267.519302:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785267.519308:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cd02 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.519315:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845cd02 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789785267.519329:0:7896:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b115517f reply state 00000000e8700f6f transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845cd09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.519385:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845cd09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.519398:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dae827c3300) 00010000:00010000:1.0:1789785267.519400:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789785267.519404:0:7896:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789785267.519452:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845ccfb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd883f expref: 20 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.519468:0:7896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cd10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd883f expref: 19 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.519477:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3e00) 00010000:00010000:1.0:1789785267.519480:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789785267.519482:0:7896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a65800, rc 0) 00000100:00100000:1.0:1789785267.519578:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb53a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+20:12217:x1876725530175232:12345-192.168.203.46@tcp:101:bash.0 Request processed in 8000us (8738us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1789785267.519600:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 157 00000100:00100000:2.0:1789785267.525068:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785267.525170:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530175360 00000100:00100000:1.0:1789785267.525183:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530175360 00000100:00100000:1.0:1789785267.525307:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 56 00000100:00100000:1.0:1789785267.525327:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb539f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530175360:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:1.0:1789785267.525390:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785267.525417:0:8451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f10123fd/0x2f18ee3fd845cd1e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8846 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789785267.525451:0:8451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789785267.525478:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=375s v=(0 0) 00010000:00010000:1.0:1789785267.525483:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789785267.525515:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f10123fd/0x2f18ee3fd845cd1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8846 expref: 6 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.525709:0:8451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f10123fd/0x2f18ee3fd845cd1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8846 expref: 6 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.525728:0:8451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a65000, rc 0) 00000100:00100000:1.0:1789785267.525794:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb539f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+6:2397:x1876725530175360:12345-192.168.203.46@tcp:101:bash.0 Request processed in 476us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785267.525803:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 56 00000100:00080000:2.0:1789785267.527679:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789785267.530181:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785267.530421:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530175488 00000100:00100000:2.0:1789785267.530433:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530175488 00000100:00100000:2.0:1789785267.530504:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 57 00000100:00100000:2.0:1789785267.530516:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+6:12217:x1876725530175488:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:2.0:1789785267.530547:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785267.530572:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845cd25 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd884d expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.530622:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f10123fd/0x2f18ee3fd845cd1e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8846 expref: 7 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.530652:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785267.530657:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785267.530663:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845cd25 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd884d expref: 7 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.530708:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f10123fd/0x2f18ee3fd845cd1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8846 expref: 7 pid: 8451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.530723:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f10123fd/0x2f18ee3fd845cd1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8846 expref: 7 pid: 8451 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785267.530739:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf453100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8449:1876725549120128:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789785267.531022:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafac70bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789785267.534484:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785267.534768:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530175616 00000100:00100000:3.0:1789785267.534777:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530175616 00000100:00100000:2.0:1789785267.534789:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf453100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8449:1876725549120128:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785267.534831:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f10123fd/0x2f18ee3fd845cd1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8846 expref: 8 pid: 8451 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.534832:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845cd25 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd884d expref: 8 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.534872:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d55400, rc 0) 00000100:00100000:3.0:1789785267.534937:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 80 00000100:00100000:3.0:1789785267.534949:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:026b2112-ee35-499c-8d01-18663664f08e+8:2398:x1876725530175616:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789785267.534968:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789785267.534982:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+8:12217:x1876725530175488:12345-192.168.203.46@tcp:101:bash.0 Request processed in 4466us (4822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785267.534991:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 57 00010000:00010000:3.0:1789785267.535010:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f10123fd/0x2f18ee3fd845cd1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8846 expref: 7 pid: 8451 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.535028:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f10123fd/0x2f18ee3fd845cd1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8846 expref: 7 pid: 8451 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.535060:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f10123fd/0x2f18ee3fd845cd1e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8846 expref: 7 pid: 8451 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.535077:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785267.535082:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785267.535090:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845cd25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd884d expref: 6 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.535103:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845cd25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd884d expref: 6 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.535163:0:6519:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845cd25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd884d expref: 6 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785267.535179:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1876725549120256:192.168.203.46@tcp:105: 00000100:00100000:3.0:1789785267.535315:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb41e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789785267.539929:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785267.539984:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530175872 00000100:00100000:2.0:1789785267.539995:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530175872 00000100:00100000:2.0:1789785267.540064:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 36 00000100:00100000:2.0:1789785267.540092:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+20:12217:x1876725530175872:12345-192.168.203.46@tcp:35:bash.0 00000100:00100000:2.0:1789785267.540778:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+21:12217:x1876725530175872:12345-192.168.203.46@tcp:35:bash.0 Request processed in 684us (857us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1789785267.540790:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 36 00000100:00100000:3.0:1789785267.541639:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6519:1876725549120256:192.168.203.46@tcp:105: 00010000:00010000:3.0:1789785267.541675:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785267.541926:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:026b2112-ee35-499c-8d01-18663664f08e+6:2398:x1876725530175616:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 6977us (7455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785267.541938:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 80 00000100:00100000:1.0:1789785267.600988:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785267.601818:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530176128 00000100:00100000:2.0:1789785267.601834:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530176128 00000100:00100000:2.0:1789785267.601932:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 158 00000100:00100000:2.0:1789785267.601947:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae81eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+21:12227:x1876725530176128:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:2.0:1789785267.601984:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785267.602013:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55000/0x2f18ee3fd845cd2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8854 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785267.603128:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789785267.603292:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55000/0x2f18ee3fd845cd2c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8854 expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.603312:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dae827c3c00) 00010000:00010000:3.0:1789785267.603315:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789785267.603320:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55000/0x2f18ee3fd845cd2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8854 expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.603374:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d55000, rc 0) 00000100:00100000:3.0:1789785267.603473:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae81eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+22:12227:x1876725530176128:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 1529us (2499us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1789785267.603482:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 158 00000100:00100000:2.0:1789785267.607082:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785267.608160:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530176384 00000100:00100000:0.0:1789785267.608176:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530176384 00000100:00100000:0.0:1789785267.608256:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 37 00000100:00100000:0.0:1789785267.608273:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+22:12227:x1876725530176384:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:0.0:1789785267.608685:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+23:12227:x1876725530176384:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 412us (1615us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1789785267.608694:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 37 00000100:00100000:1.0:1789785267.705669:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785267.709548:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530176512 00000100:00100000:3.0:1789785267.709564:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530176512 00000100:00100000:3.0:1789785267.709651:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 159 00000100:00100000:3.0:1789785267.709663:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+23:12233:x1876725530176512:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789785267.709715:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785267.709783:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cd3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd885b expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.709853:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845cd41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.709869:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845cd41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.709881:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845cd41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785267.709925:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789785267.709929:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789785267.709948:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845cd41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.709975:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cd3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd885b expref: 25 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.709999:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845cd41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd885b expref: 24 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.710009:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:3.0:1789785267.710012:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789785267.710015:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bb000, rc 0) 00000100:00100000:3.0:1789785267.710079:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+24:12233:x1876725530176512:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 419us (4419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785267.710086:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 159 00000100:00100000:1.0:1789785267.716578:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785267.716698:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530176768 00000100:00100000:2.0:1789785267.716709:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530176768 00000100:00100000:2.0:1789785267.716775:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 160 00000100:00100000:2.0:1789785267.716786:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+24:12233:x1876725530176768:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:2.0:1789785267.716808:0:7896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785267.716830:0:7896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55000/0x2f18ee3fd845cd48 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8862 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.716935:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845cd4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.716950:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845cd4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.716960:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845cd4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789785267.716985:0:7896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789785267.717096:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55000/0x2f18ee3fd845cd48 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8862 expref: 27 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.717114:0:7896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845cd4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8862 expref: 26 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.717122:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3e00) 00010000:00010000:2.0:1789785267.717124:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789785267.717128:0:7896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d55c00, rc 0) 00000100:00100000:2.0:1789785267.717692:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+26:12233:x1876725530176768:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 905us (1120us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1789785267.717701:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 160 00000100:00100000:0.0:1789785267.728798:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785267.728895:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530177024 00000100:00100000:3.0:1789785267.728906:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530177024 00000100:00100000:3.0:1789785267.728967:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 161 00000100:00100000:3.0:1789785267.728978:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+26:12233:x1876725530177024:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789785267.729002:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785267.729022:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cd5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8869 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.729126:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cd64 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.729141:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cd64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.729153:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cd64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785267.729166:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789785267.729287:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cd5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8869 expref: 29 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.729313:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cd64 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8869 expref: 28 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.729321:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3e00) 00010000:00010000:3.0:1789785267.729325:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789785267.729328:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bbe00, rc 0) 00000100:00100000:3.0:1789785267.729432:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+28:12233:x1876725530177024:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 456us (644us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1789785267.729457:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 161 00000100:00100000:1.0:1789785267.736698:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785267.736771:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530177152 00000100:00100000:0.0:1789785267.736781:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530177152 00000100:00100000:0.0:1789785267.736843:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00100000:0.0:1789785267.736853:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+28:2398:x1876725530177152:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789785267.736868:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785267.736892:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845cd4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8862 expref: 28 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.736928:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3e00) 00010000:00010000:0.0:1789785267.736933:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785267.736989:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+27:2398:x1876725530177152:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 138us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785267.736997:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00100000:1.0:1789785267.743840:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785267.743941:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530177280 00000100:00100000:2.0:1789785267.743951:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530177280 00000100:00100000:2.0:1789785267.744008:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 58 00000100:00100000:2.0:1789785267.744019:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+6:2397:x1876725530177280:12345-192.168.203.46@tcp:1:lfs.0 00010000:00010000:2.0:1789785267.744065:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005765067b/0x2f18ee3fd845cd72 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.744089:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845cd25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd884d expref: 6 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.744097:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785267.744101:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789785267.744106:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005765067b/0x2f18ee3fd845cd72 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.744155:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845cd25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd884d expref: 6 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.744170:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845cd25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd884d expref: 6 pid: 8449 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785267.744184:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf453b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8451:1876725549120384:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789785267.744297:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385f240 going to sleep for 11 seconds 00000100:00100000:2.0:1789785267.746614:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785267.746705:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530177408 00000100:00100000:0.0:1789785267.746714:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530177408 00002000:00100000:0.0:1789785267.746762:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9dafbf451f80 x1876725530177408/t0(0) o4->026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp:398/0 lens 504/0 e 0 to 0 dl 1789785278 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789785267.746774:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dafbf451f80 with x1876725530177408 ext(0->12) 00010000:00010000:0.0:1789785267.746782:0:8455:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845cd25 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd884d expref: 7 pid: 8449 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.746799:0:8455:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845cd25 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd884d expref: 7 pid: 8449 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789785267.746807:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9dafbf451f80 00000100:00100000:0.0:1789785267.746841:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 2 00000100:00100000:0.0:1789785267.746851:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:026b2112-ee35-499c-8d01-18663664f08e+7:2397:x1876725530177408:12345-192.168.203.46@tcp:4:lfs.0 00000100:00100000:0.0:1789785267.747880:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:026b2112-ee35-499c-8d01-18663664f08e+9:2397:x1876725530177408:12345-192.168.203.46@tcp:4:lfs.0 Request processed in 1018us (1265us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789785267.747896:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 2 00002000:00100000:0.0:1789785267.747911:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9dafbf451f80 x1876725530177408/t4294967306(0) o4->026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp:398/0 lens 504/448 e 0 to 0 dl 1789785278 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789785267.747938:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dafbf451f80 with x1876725530177408 ext(0->12) 00010000:00010000:0.0:1789785267.747949:0:8455:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845cd25 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd884d expref: 9 pid: 8449 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.747969:0:8455:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845cd25 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd884d expref: 9 pid: 8449 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789785267.747990:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9dafbf451f80 00000100:00100000:0.0:1789785267.751447:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785267.752455:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530177536 00000100:00100000:2.0:1789785267.752472:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530177536 00010000:00010000:2.0:1789785267.752532:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845cd25 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd884d expref: 9 pid: 8449 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785267.752602:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 81 00000100:00100000:2.0:1789785267.752615:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+9:2397:x1876725530177536:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789785267.752635:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789785267.752660:0:6520:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789785267.752664:0:6520:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789785266 00002000:00010000:2.0:1789785267.752666:0:6520:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789785266 00002000:00010000:2.0:1789785267.752668:0:6520:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789785266 00002000:00010000:2.0:1789785267.752670:0:6520:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789785267.752677:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845cd25 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd884d expref: 9 pid: 8449 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.752718:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845cd25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd884d expref: 9 pid: 8449 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.752753:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(1 0) 00010000:00010000:2.0:1789785267.752759:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 1) 00010000:00010000:2.0:1789785267.752765:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005765067b/0x2f18ee3fd845cd72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.752777:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005765067b/0x2f18ee3fd845cd72 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.752803:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785267.753183:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+9:2397:x1876725530177536:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 570us (1750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785267.753193:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 81 00010000:00010000:1.0:1789785267.756010:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845cd25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd884d expref: 8 pid: 8449 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785267.756038:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf453b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8451:1876725549120384:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789785267.756065:0:8451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005765067b/0x2f18ee3fd845cd72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.756078:0:8451:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005765067b/0x2f18ee3fd845cd72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.756103:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005765067b/0x2f18ee3fd845cd72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.756138:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005765067b/0x2f18ee3fd845cd72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.756147:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005765067b/0x2f18ee3fd845cd72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.756156:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005765067b/0x2f18ee3fd845cd72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.756163:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54400 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785267.756167:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005765067b/0x2f18ee3fd845cd72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.756394:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005765067b/0x2f18ee3fd845cd72 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.756419:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005765067b/0x2f18ee3fd845cd72 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.756427:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005765067b/0x2f18ee3fd845cd72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785267.756528:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+7:2397:x1876725530177280:12345-192.168.203.46@tcp:1:lfs.0 Request processed in 12509us (12697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785267.756538:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 58 00000100:00100000:2.0:1789785267.769322:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785267.769450:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530177792 00000100:00100000:1.0:1789785267.769465:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530177792 00000100:00100000:1.0:1789785267.769539:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 38 00000100:00100000:1.0:1789785267.769551:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf88770050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+27:12233:x1876725530177792:12345-192.168.203.46@tcp:35:lfs.0 00000004:00010000:1.0:1789785267.769630:0:6536:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cd64 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8869 expref: 27 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789785267.769820:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1789785267.769854:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1789785267.770223:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1789785267.770260:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cd79 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.770284:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cd10 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd883f expref: 31 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.770294:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cd79 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.770327:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cd10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd883f expref: 31 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.770386:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cd10 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd883f expref: 31 pid: 7896 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785267.770424:0:6536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b5bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6536:1876725549120512:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789785267.770510:0:6536:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf9017b540 going to sleep for 11 seconds 00000100:00100000:2.0:1789785267.774959:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785267.775104:0:6536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b5bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6536:1876725549120512:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789785267.775139:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cd79 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785267.775377:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530177920 00000100:00100000:0.0:1789785267.775386:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530177920 00010000:00010000:0.0:1789785267.775433:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cd10 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd883f expref: 32 pid: 7896 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785267.775469:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 82 00000100:00100000:0.0:1789785267.775480:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf453b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+32:2397:x1876725530177920:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789785267.775497:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785267.775505:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cd10 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd883f expref: 32 pid: 7896 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.775519:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cd10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd883f expref: 32 pid: 7896 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.775546:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cd10 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd883f expref: 32 pid: 7896 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.775600:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3e00) 00010000:00010000:0.0:1789785267.775606:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cd79 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.775616:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cd79 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.775625:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cd79 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785267.775663:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785267.775739:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf453b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+31:2397:x1876725530177920:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 260us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785267.775748:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 82 00010000:00010000:2.0:1789785267.776684:0:6536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cd79 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.776700:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cd79 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789785267.776847:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:2.0:1789785267.776984:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1789785267.777106:0:6536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf3e9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6536:1876725549120640:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789785267.777420:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785267.778227:0:6536:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf83f30000 going to sleep for 11 seconds 00000100:00100000:3.0:1789785267.783332:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549120640 00000100:00100000:3.0:1789785267.783565:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549120640 00000100:00100000:0.0:1789785267.783733:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789785267.783747:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6536:x1876725549120640:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789785267.783929:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6536:x1876725549120640:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 185us (6509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785267.783938:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:2.0:1789785267.783990:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789785267.784147:0:6536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf3e9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6536:1876725549120640:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789785267.784381:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1789785267.784474:0:6536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6536:1876725549120768:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789785267.784517:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785267.784546:0:6536:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf83072000 going to sleep for 11 seconds 00000100:00100000:1.0:1789785267.784677:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549120768 00000100:00100000:1.0:1789785267.784683:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549120768 00000100:00100000:1.0:1789785267.784719:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789785267.784727:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6536:x1876725549120768:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789785267.784870:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6536:x1876725549120768:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 143us (352us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789785267.784877:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789785267.785031:0:6536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6536:1876725549120768:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789785267.785091:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1789785267.785130:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cd79 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.785141:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cd79 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.785149:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cd79 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.785265:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a64000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785267.785272:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cd79 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.785282:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cd79 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.785302:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3e00) 00010000:00010000:3.0:1789785267.785305:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789785267.785331:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cd79 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.785361:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cd79 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789785267.785500:0:6536:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789785267.785567:0:6536:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1789785267.785578:0:6536:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 376039239005ns, next at 377039236903ns, rc = 0 00000001:00080000:3.0:1789785267.785584:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1789785267.785619:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3e00) 00010000:00010000:3.0:1789785267.785622:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789785267.785630:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cd64 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8869 expref: 35 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785267.785788:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf88770050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+34:12233:x1876725530177792:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 16240us (16483us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1789785267.785799:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 38 00000020:00080000:3.0:1789785267.785803:0:6536:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789785267.792718:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785267.792971:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530178048 00000100:00100000:1.0:1789785267.793089:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530178048 00000100:00100000:1.0:1789785267.793171:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 162 00000100:00100000:1.0:1789785267.793184:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+34:12233:x1876725530178048:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789785267.793219:0:11254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785267.793257:0:11254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845cd80 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8870 expref: -99 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.793528:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845cd80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8870 expref: 35 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.793547:0:11254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845cd80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8870 expref: 35 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.793606:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:1.0:1789785267.793610:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789785267.793616:0:11254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a65200, rc 0) 00000100:00100000:1.0:1789785267.793702:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+35:12233:x1876725530178048:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 520us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785267.793710:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 162 00000100:00100000:1.0:1789785267.796989:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785267.797270:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530178304 00000100:00100000:2.0:1789785267.797284:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530178304 00000100:00100000:2.0:1789785267.798100:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 39 00000100:00100000:2.0:1789785267.798115:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+35:12233:x1876725530178304:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:2.0:1789785267.798567:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+36:12233:x1876725530178304:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 455us (1603us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1789785267.798577:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 39 00000100:00100000:3.0:1789785267.886503:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785267.886649:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530178560 00000100:00100000:2.0:1789785267.886663:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530178560 00000100:00100000:2.0:1789785267.886751:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 163 00000100:00100000:2.0:1789785267.886764:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+36:12243:x1876725530178560:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:2.0:1789785267.886799:0:7896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785267.886830:0:7896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cd87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8877 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789785267.886967:0:7896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789785267.887103:0:7896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cd87 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8877 expref: 38 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.887120:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dae827c3c00) 00010000:00010000:2.0:1789785267.887123:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789785267.887129:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cd87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8877 expref: 38 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.887168:0:7896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d54200, rc 0) 00000100:00100000:2.0:1789785267.887253:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+37:12243:x1876725530178560:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 491us (765us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1789785267.887261:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 163 00000100:00100000:0.0:1789785267.890554:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785267.890742:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530178688 00000100:00100000:2.0:1789785267.890754:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530178688 00000100:00100000:2.0:1789785267.890823:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 164 00000100:00100000:2.0:1789785267.890835:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+37:12243:x1876725530178688:12345-192.168.203.46@tcp:34:lfs.0 00010000:00010000:2.0:1789785267.890937:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cd95 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.890960:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cd95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.890975:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cd95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.890987:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cd9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.890995:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cd9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.891001:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cd9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.891102:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845cda3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.891129:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845cda3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.891137:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845cda3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789785267.891201:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845cda3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.891218:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cd95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.891225:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cd95 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.891233:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cd95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.891240:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785267.891245:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cd95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.891253:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cd95 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.891269:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:2.0:1789785267.891273:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785267.891278:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cd95 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.891285:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cd95 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.891309:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cd9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.891315:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cd9c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.891334:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cd9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.893189:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785267.893197:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cd9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.893209:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cd9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.893230:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dae827c3300) 00010000:00010000:2.0:1789785267.893233:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785267.893238:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cd9c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.893246:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cd9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.893269:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845cda3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.893275:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845cda3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.893283:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845cda3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.893308:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785267.893311:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845cda3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.893318:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845cda3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.893326:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:2.0:1789785267.893329:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785267.893331:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845cda3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785267.893833:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845cda3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785267.893968:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+37:12243:x1876725530178688:12345-192.168.203.46@tcp:34:lfs.0 Request processed in 3127us (3419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785267.893980:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 164 00000100:00100000:1.0:1789785267.900893:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785267.901095:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530178944 00000100:00100000:3.0:1789785267.901111:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530178944 00000100:00100000:3.0:1789785267.901190:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 40 00000100:00100000:3.0:1789785267.901202:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+37:12243:x1876725530178944:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:3.0:1789785267.901552:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+38:12243:x1876725530178944:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 352us (674us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1789785267.901561:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 40 00000100:00100000:3.0:1789785267.954173:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785267.954880:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530179200 00000100:00100000:1.0:1789785267.954894:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530179200 00000100:00100000:1.0:1789785267.955080:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 165 00000100:00100000:1.0:1789785267.955092:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+38:12246:x1876725530179200:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789785267.955132:0:11254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785267.955156:0:11254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cdaa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd887e expref: -99 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.955261:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cdb1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.955277:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cdb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.955291:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cdb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.955304:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cdb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.955368:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cdb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.955376:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cdb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.955522:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cdbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.955531:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cdbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.955538:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cdbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789785267.955548:0:11254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789785267.955645:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cdb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.955653:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cdb1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.955660:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cdb1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.955787:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785267.955794:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cdb1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.955804:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cdb1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.955842:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:1.0:1789785267.955845:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785267.955851:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cdb1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.955857:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cdb1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.955876:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cdb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.955883:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cdb8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.955889:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cdb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.955894:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785267.955897:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cdb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.955903:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cdb8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.955911:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dae827c3300) 00010000:00010000:1.0:1789785267.955914:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785267.955917:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cdb8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.955924:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cdb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.955981:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cdaa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd887e expref: 41 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.956009:0:11254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cdbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd887e expref: 40 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785267.956017:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:1.0:1789785267.956019:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789785267.956022:0:11254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64000, rc 0) 00000100:00100000:1.0:1789785267.956111:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+40:12246:x1876725530179200:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 1021us (1953us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1789785267.956120:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 165 00000100:00100000:0.0:1789785267.962520:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785267.962661:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530179328 00000100:00100000:3.0:1789785267.962698:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530179328 00000100:00100000:3.0:1789785267.962865:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 166 00000100:00100000:3.0:1789785267.962885:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+40:12246:x1876725530179328:12345-192.168.203.46@tcp:54:lfs.0 00010000:00010000:3.0:1789785267.962976:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cdcd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.963293:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cdcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.963309:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cdcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.963631:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cdcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.963640:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cdcd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.963648:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cdcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.963655:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bbe00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785267.963660:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cdcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.963977:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cdcd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.964640:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:3.0:1789785267.964647:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789785267.964654:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cdcd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785267.964808:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cdcd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785267.965002:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+40:12246:x1876725530179328:12345-192.168.203.46@tcp:54:lfs.0 Request processed in 2107us (2653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785267.965014:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 166 00000100:00100000:0.0:1789785267.979462:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785267.983779:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530179584 00000100:00100000:2.0:1789785267.983802:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530179584 00000100:00100000:2.0:1789785267.983903:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 41 00000100:00100000:2.0:1789785267.983917:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+40:12246:x1876725530179584:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:2.0:1789785267.984261:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+41:12246:x1876725530179584:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 346us (4814us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1789785267.984271:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 41 00010000:00010000:1.0:1789785268.226774:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785268.303596:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785268.309871:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530179840 00000100:00100000:3.0:1789785268.309884:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530179840 00000100:00100000:2.0:1789785268.313642:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 167 00000100:00100000:2.0:1789785268.313657:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+41:12277:x1876725530179840:12345-192.168.203.46@tcp:101:cat.0 00010000:00010000:2.0:1789785268.313700:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785268.313722:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cdd4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8885 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785268.314057:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cddb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785268.314073:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785268.314085:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789785268.314098:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789785268.314201:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cdd4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8885 expref: 44 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785268.314218:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cddb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8885 expref: 43 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785268.314227:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:2.0:1789785268.314230:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789785268.314233:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d55e00, rc 0) 00000100:00100000:2.0:1789785268.314633:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+43:12277:x1876725530179840:12345-192.168.203.46@tcp:101:cat.0 Request processed in 978us (11108us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1789785268.314642:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 167 00000100:00100000:0.0:1789785268.331405:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785268.331569:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530180096 00000100:00100000:2.0:1789785268.331579:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530180096 00000100:00100000:2.0:1789785268.331644:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 42 00000100:00100000:2.0:1789785268.331668:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+43:12277:x1876725530180096:12345-192.168.203.46@tcp:35:cat.0 00000100:00100000:2.0:1789785268.331928:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+44:12277:x1876725530180096:12345-192.168.203.46@tcp:35:cat.0 Request processed in 261us (533us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1789785268.331936:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 42 00000100:00100000:2.0:1789785268.334141:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785268.339165:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530180224 00000100:00100000:0.0:1789785268.339180:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530180224 00000100:00100000:0.0:1789785268.339309:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 13 00000100:00100000:0.0:1789785268.339319:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:026b2112-ee35-499c-8d01-18663664f08e+44:2400:x1876725530180224:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789785268.339371:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785268.339399:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845cddb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8885 expref: 44 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785268.339420:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:0.0:1789785268.339425:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785268.339495:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:026b2112-ee35-499c-8d01-18663664f08e+43:2400:x1876725530180224:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 177us (5362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785268.339503:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 13 00000100:00100000:0.0:1789785268.433949:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785268.434077:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530180480 00000100:00100000:1.0:1789785268.434091:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530180480 00000100:00100000:1.0:1789785268.434188:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 168 00000100:00100000:1.0:1789785268.434200:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+43:12283:x1876725530180480:12345-192.168.203.46@tcp:101:dd.0 00010000:00010000:1.0:1789785268.434242:0:11254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785268.434246:0:11254:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789785268.434282:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845cd41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd885b expref: 43 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785268.434509:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:1.0:1789785268.434516:0:11254:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789785268.434535:0:11254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cde9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd888c expref: -99 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785268.434710:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cdf0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785268.434739:0:11254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cdbf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd887e expref: 43 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785268.434749:0:11254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cdf0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785268.434791:0:11254:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cdbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd887e expref: 43 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785268.434807:0:11254:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cdbf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd887e expref: 43 pid: 11254 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785268.434825:0:11254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf445500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11254:1876725549120896:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789785268.434954:0:11254:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf9017b480 going to sleep for 11 seconds 00000100:00100000:2.0:1789785268.438764:0:11254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf445500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11254:1876725549120896:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789785268.438794:0:11254:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cdf0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785268.441538:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785268.442089:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530180608 00000100:00100000:2.0:1789785268.442104:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530180608 00010000:00010000:2.0:1789785268.442159:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cdbf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd887e expref: 44 pid: 11254 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785268.442262:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 83 00000100:00100000:2.0:1789785268.442284:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+44:2397:x1876725530180608:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789785268.442303:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785268.442310:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cdbf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd887e expref: 44 pid: 11254 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785268.442325:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cdbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd887e expref: 44 pid: 11254 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785268.442387:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845cdbf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd887e expref: 44 pid: 11254 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785268.442406:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:2.0:1789785268.442424:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cdf0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785268.442435:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cdf0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785268.442443:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cdf0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785268.442482:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789785268.442551:0:11254:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cdf0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785268.442567:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cdf0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785268.442568:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+43:2397:x1876725530180608:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 284us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785268.442598:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 83 00000004:00200000:0.0:1789785268.443544:0:11254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789785268.444049:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cde9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd888c expref: 44 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785268.444183:0:11254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cdf0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd888c expref: 43 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785268.444196:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:0.0:1789785268.444199:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789785268.444267:0:11254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a65c00, rc 0) 00000100:00100000:0.0:1789785268.444682:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+43:12283:x1876725530180480:12345-192.168.203.46@tcp:101:dd.0 Request processed in 10482us (10745us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1789785268.445877:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 168 00000100:00100000:0.0:1789785268.448003:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785268.448260:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530180736 00000100:00100000:3.0:1789785268.448274:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530180736 00000100:00100000:3.0:1789785268.448456:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 169 00000100:00100000:3.0:1789785268.448470:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+43:12283:x1876725530180736:12345-192.168.203.46@tcp:101:dd.0 00010000:00010000:3.0:1789785268.448506:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785268.448534:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cdfe lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8893 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.448591:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845ce05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.448611:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845ce05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.448626:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845ce05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.448794:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845cdfe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8893 expref: 45 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.448817:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845ce05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8893 expref: 44 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.448835:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:3.0:1789785268.448838:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789785268.448843:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bbe00, rc 0) 00000100:00100000:3.0:1789785268.448913:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+44:12283:x1876725530180736:12345-192.168.203.46@tcp:101:dd.0 Request processed in 446us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785268.448922:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 169 00000100:00100000:3.0:1789785268.452678:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785268.452851:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530180992 00000100:00100000:2.0:1789785268.452864:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530180992 00000100:00100000:2.0:1789785268.452967:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 170 00000100:00100000:2.0:1789785268.452979:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+44:12283:x1876725530180992:12345-192.168.203.46@tcp:36:dd.0 00010000:00010000:2.0:1789785268.453297:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845ce0c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785268.453319:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845ce0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785268.453332:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845ce0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789785268.453417:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1789785268.453442:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b309ba1 reply state 0000000016d0b385 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845ce0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785268.453456:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845ce0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785268.453481:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:2.0:1789785268.453484:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789785268.453489:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789785268.453610:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+47:12283:x1876725530180992:12345-192.168.203.46@tcp:36:dd.0 Request processed in 631us (945us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1789785268.453619:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 170 00000020:00080000:2.0:1789785268.453625:0:6535:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789785268.735812:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785268.735869:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785268.735985:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530181376 00000100:00100000:1.0:1789785268.736012:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530181376 00000100:00100000:1.0:1789785268.736114:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 136 00000100:00080000:3.0:1789785268.736119:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789785268.736126:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+6:2399:x1876725530181376:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785268.736231:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+6:2399:x1876725530181376:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 107us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785268.736240:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 136 00000100:00100000:2.0:1789785268.737456:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785268.737668:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785268.738286:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785268.738324:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530181120 00000100:00100000:2.0:1789785268.738326:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785268.738368:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530181120 00000100:00100000:0.0:1789785268.738449:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 390 00000100:00100000:0.0:1789785268.738462:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2399:x1876725530181120:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785268.738538:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2399:x1876725530181120:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 78us (2735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785268.738547:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 390 00000100:00100000:0.0:1789785268.738723:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530181504 00000100:00100000:0.0:1789785268.738727:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530181504 00000100:00100000:0.0:1789785268.738759:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 137 00000100:00100000:0.0:1789785268.738767:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+7:2399:x1876725530181504:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785268.738804:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+7:2399:x1876725530181504:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 38us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785268.738811:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 137 00000100:00100000:2.0:1789785268.749028:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785268.762099:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530181632 00000100:00100000:3.0:1789785268.762115:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530181632 00000100:00100000:3.0:1789785268.762570:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530181248 00000100:00100000:3.0:1789785268.762576:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530181248 00000100:00100000:3.0:1789785268.762622:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530181760 00000100:00100000:3.0:1789785268.762625:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530181760 00000100:00100000:3.0:1789785268.762649:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 330 00000100:00100000:3.0:1789785268.762659:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2399:x1876725530181632:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785268.762738:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2399:x1876725530181632:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 80us (26829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785268.762745:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 330 00000100:00100000:3.0:1789785268.762765:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 331 00000100:00100000:3.0:1789785268.762772:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+5:2399:x1876725530181248:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785268.762799:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+5:2399:x1876725530181248:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 28us (25133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785268.762805:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 331 00000100:00100000:3.0:1789785268.763189:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 332 00000100:00100000:3.0:1789785268.763206:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2399:x1876725530181760:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785268.763234:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2399:x1876725530181760:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 31us (24909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785268.763240:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 332 00000100:00080000:3.0:1789785268.763261:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789785268.767912:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530181888 00000100:00100000:3.0:1789785268.767927:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530181888 00000100:00100000:3.0:1789785268.768042:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 171 00000100:00100000:3.0:1789785268.768054:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+47:12297:x1876725530181888:12345-192.168.203.46@tcp:101:stat.0 00010000:00010000:3.0:1789785268.768080:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785268.768102:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845ce13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd889a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.768171:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ce1a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.768185:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ce1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.768197:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ce1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.768209:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845ce21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.768216:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845ce21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.768221:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845ce21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.768400:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.768411:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cdf0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd888c expref: 48 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.768419:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce28 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.768451:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cdf0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd888c expref: 48 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.768464:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cdf0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd888c expref: 48 pid: 11254 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785268.768476:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1876725549121024:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789785268.768597:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf854403c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785268.779102:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785268.779140:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530182144 00000100:00100000:3.0:1789785268.779149:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530182144 00000100:00100000:3.0:1789785268.779199:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 43 00000100:00100000:3.0:1789785268.779210:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+49:6166:x1876725530182144:12345-192.168.203.46@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789785268.779845:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+50:6166:x1876725530182144:12345-192.168.203.46@tcp:35:ldlm_bl.0 Request processed in 634us (750us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1789785268.779855:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 43 00000100:00100000:2.0:1789785268.780187:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1876725549121024:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789785268.780215:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785268.785879:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785268.787296:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530182272 00000100:00100000:1.0:1789785268.787309:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530182272 00010000:00010000:1.0:1789785268.787414:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cdf0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd888c expref: 50 pid: 11254 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785268.787450:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 84 00000100:00100000:1.0:1789785268.787460:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+50:2398:x1876725530182272:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789785268.787473:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785268.787481:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cdf0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd888c expref: 50 pid: 11254 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785268.787505:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cdf0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd888c expref: 50 pid: 11254 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785268.787527:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cdf0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd888c expref: 50 pid: 11254 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785268.787545:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:1.0:1789785268.787550:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785268.787559:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785268.787567:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce28 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785268.787614:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785268.787675:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+49:2398:x1876725530182272:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 216us (1807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785268.787685:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 84 00010000:00010000:3.0:1789785268.787695:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.787729:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785268.787812:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789785268.787817:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789785268.787851:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.787868:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.787879:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ce1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.787887:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ce1a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.787894:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ce1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.787901:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bb600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785268.787906:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ce1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.787914:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ce1a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.787932:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:3.0:1789785268.787936:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785268.787941:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ce1a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.787959:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ce1a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.787979:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845ce21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.787985:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845ce21 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.787991:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845ce21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.787996:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bae00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785268.788000:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845ce21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.788006:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845ce21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.788020:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dae827c3300) 00010000:00010000:3.0:1789785268.788023:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785268.788026:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845ce21 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.788032:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845ce21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.788077:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845ce13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd889a expref: 49 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.788093:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd889a expref: 48 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.788107:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:3.0:1789785268.788110:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789785268.788113:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814ba000, rc 0) 00000100:00100000:3.0:1789785268.791472:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+48:12297:x1876725530181888:12345-192.168.203.46@tcp:101:stat.0 Request processed in 23401us (42432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785268.791489:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 171 00000100:00100000:0.0:1789785268.895978:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785268.896164:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530182528 00000100:00100000:3.0:1789785268.896175:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530182528 00000100:00100000:3.0:1789785268.896238:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 172 00000100:00100000:3.0:1789785268.896249:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+48:12304:x1876725530182528:12345-192.168.203.46@tcp:36:truncate.0 00010000:00010000:3.0:1789785268.896307:0:6535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785268.896336:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd889a expref: 48 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.896414:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:3.0:1789785268.896419:0:6535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789785268.896611:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845ce2f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.896626:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845ce2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.896636:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845ce2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789785268.896679:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1789785268.896699:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005446c237 reply state 000000008d07f327 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845ce2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.896725:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845ce2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785268.896731:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:3.0:1789785268.896734:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789785268.896737:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789785268.896839:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+50:12304:x1876725530182528:12345-192.168.203.46@tcp:36:truncate.0 Request processed in 591us (870us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1789785268.896847:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 172 00000020:00080000:3.0:1789785268.896852:0:6535:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789785269.139079:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785269.143525:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530182656 00000100:00100000:1.0:1789785269.143539:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530182656 00000100:00100000:1.0:1789785269.143738:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 173 00000100:00100000:1.0:1789785269.143750:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+50:12318:x1876725530182656:12345-192.168.203.46@tcp:101:stat.0 00010000:00010000:1.0:1789785269.143774:0:7896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785269.143793:0:7896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845ce36 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd88a1 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.143877:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ce3d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.143892:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ce3d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.143903:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ce3d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.143915:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845ce44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.143922:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845ce44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.143928:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845ce44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.143991:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845ce4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.144011:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845ce4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.144038:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845ce4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789785269.144091:0:7896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1789785269.144095:0:7896:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789785269.144126:0:7896:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845ce4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.144144:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845ce4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.144152:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ce3d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.144158:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ce3d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.144163:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ce3d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.144169:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785269.144172:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ce3d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.144179:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ce3d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.144190:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:1.0:1789785269.144193:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785269.144197:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ce3d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.144212:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ce3d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.144225:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845ce44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.144231:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845ce44 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.144237:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845ce44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.144242:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a64200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785269.144245:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845ce44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.144251:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845ce44 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.144259:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dae827c3300) 00010000:00010000:1.0:1789785269.144262:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785269.144265:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845ce44 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.144272:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845ce44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.144313:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845ce36 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88a1 expref: 52 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.144327:0:7896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845ce4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88a1 expref: 51 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.144397:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:1.0:1789785269.144400:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789785269.145783:0:7896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64000, rc 0) 00000100:00100000:1.0:1789785269.145864:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+51:12318:x1876725530182656:12345-192.168.203.46@tcp:101:stat.0 Request processed in 2113us (7312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785269.145872:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 173 00000100:00080000:3.0:1789785269.152896:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789785269.216454:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785269.217862:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530182912 00000100:00100000:3.0:1789785269.217881:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530182912 00000100:00100000:3.0:1789785269.217983:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 174 00000100:00100000:3.0:1789785269.217995:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+51:12328:x1876725530182912:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789785269.218024:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785269.218050:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd88a8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785269.218322:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789785269.218477:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce52 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88a8 expref: 53 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.218499:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dae827c3c00) 00010000:00010000:3.0:1789785269.218503:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789785269.218511:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88a8 expref: 53 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.218549:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814ba000, rc 0) 00000100:00100000:3.0:1789785269.218647:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+52:12328:x1876725530182912:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 653us (2216us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1789785269.218655:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 174 00000100:00100000:2.0:1789785269.223247:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785269.223326:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530183168 00000100:00100000:3.0:1789785269.223375:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530183168 00000100:00100000:3.0:1789785269.223466:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 44 00000100:00100000:3.0:1789785269.223479:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf88773850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+52:12328:x1876725530183168:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:3.0:1789785269.223797:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf88773850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+53:12328:x1876725530183168:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 320us (559us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1789785269.223805:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 44 00010000:00010000:0.0:1789785269.250645:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785269.287404:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785269.287628:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530183424 00000100:00100000:0.0:1789785269.287642:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530183424 00000100:00100000:0.0:1789785269.287922:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 175 00000100:00100000:0.0:1789785269.287937:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+53:12334:x1876725530183424:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:0.0:1789785269.287970:0:11254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785269.288016:0:11254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845ce60 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd88af expref: -99 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785269.288383:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845ce67 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785269.288402:0:11254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845ce4b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88a1 expref: 54 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785269.288414:0:11254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845ce67 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785269.288459:0:11254:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845ce4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88a1 expref: 54 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785269.288475:0:11254:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845ce4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88a1 expref: 54 pid: 7896 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785269.288491:0:11254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11254:1876725549121152:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789785269.289068:0:11254:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf987f5000 going to sleep for 11 seconds 00000100:00100000:1.0:1789785269.292195:0:11254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11254:1876725549121152:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789785269.292236:0:11254:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845ce67 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785269.293598:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785269.293844:0:7484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530183552 00000100:00100000:0.0:1789785269.293855:0:7484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530183552 00010000:00010000:0.0:1789785269.293906:0:7484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845ce4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88a1 expref: 55 pid: 7896 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785269.293955:0:7484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 85 00000100:00100000:0.0:1789785269.293971:0:7484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf445500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+55:2397:x1876725530183552:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789785269.293998:0:7484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785269.294025:0:7484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845ce4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88a1 expref: 55 pid: 7896 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785269.294039:0:7484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845ce4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88a1 expref: 55 pid: 7896 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785269.294069:0:7484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845ce4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88a1 expref: 55 pid: 7896 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785269.294090:0:7484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:0.0:1789785269.294096:0:7484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845ce67 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785269.294109:0:7484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845ce67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785269.294117:0:7484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845ce67 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785269.294148:0:7484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785269.294218:0:7484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf445500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+54:2397:x1876725530183552:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 252us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785269.294226:0:7484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 85 00010000:00010000:1.0:1789785269.294538:0:11254:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845ce67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.294548:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845ce67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789785269.294572:0:11254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1789785269.294749:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845ce60 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88af expref: 55 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.294766:0:11254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845ce67 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88af expref: 54 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.294775:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:1.0:1789785269.294787:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789785269.294790:0:11254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81ead400, rc 0) 00000100:00100000:1.0:1789785269.294829:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+54:12334:x1876725530183424:12345-192.168.203.46@tcp:101:bash.0 Request processed in 6897us (7441us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1789785269.294837:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 175 00000100:00100000:1.0:1789785269.298872:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785269.298974:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530183808 00000100:00100000:3.0:1789785269.299047:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530183808 00000100:00100000:3.0:1789785269.299128:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 176 00000100:00100000:3.0:1789785269.299142:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+54:12334:x1876725530183808:12345-192.168.203.46@tcp:36:bash.0 00010000:00010000:3.0:1789785269.299742:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce75 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.299766:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.299780:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789785269.299834:0:7896:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:3.0:1789785269.299859:0:7896:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc52a755 reply state 00000000f776c721 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.299893:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.299902:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:3.0:1789785269.299905:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789785269.299909:0:7896:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789785269.300254:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+57:12334:x1876725530183808:12345-192.168.203.46@tcp:36:bash.0 Request processed in 1112us (1394us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1789785269.300264:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 176 00000020:00080000:3.0:1789785269.300270:0:7896:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789785269.306088:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785269.306239:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530183936 00000100:00100000:2.0:1789785269.306252:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530183936 00000100:00100000:2.0:1789785269.306333:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 177 00000100:00100000:2.0:1789785269.306377:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+57:12334:x1876725530183936:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:2.0:1789785269.306409:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785269.306435:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845ce7c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd88b6 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.306592:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54400/0x2f18ee3fd845ce83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.306612:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845ce67 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88af expref: 58 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.306623:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54400/0x2f18ee3fd845ce83 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.306668:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845ce67 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88af expref: 58 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.306684:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845ce67 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88af expref: 58 pid: 11254 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785269.306700:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1876725549121280:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789785269.306806:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf83f30540 going to sleep for 11 seconds 00000100:00100000:2.0:1789785269.309583:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785269.309724:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530184064 00000100:00100000:1.0:1789785269.309736:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530184064 00010000:00010000:1.0:1789785269.309784:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845ce67 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88af expref: 59 pid: 11254 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785269.309832:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 86 00000100:00100000:1.0:1789785269.309845:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+59:2398:x1876725530184064:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789785269.309862:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785269.309870:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845ce67 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88af expref: 59 pid: 11254 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.309886:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845ce67 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88af expref: 59 pid: 11254 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.309913:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:1.0:1789785269.309920:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54400/0x2f18ee3fd845ce83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.309932:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54400/0x2f18ee3fd845ce83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.309942:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54400/0x2f18ee3fd845ce83 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.309993:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785269.310065:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+59:2398:x1876725530184064:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 221us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785269.310074:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 86 00010000:00010000:3.0:1789785269.311481:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845ce67 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88af expref: 58 pid: 11254 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785269.311508:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1876725549121280:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785269.311558:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54400/0x2f18ee3fd845ce83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.311569:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54400/0x2f18ee3fd845ce83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.311583:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54400/0x2f18ee3fd845ce83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785269.311657:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789785269.311662:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789785269.311688:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54400/0x2f18ee3fd845ce83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.311733:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845ce7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88b6 expref: 58 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.311769:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54400/0x2f18ee3fd845ce83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88b6 expref: 57 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.311778:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:3.0:1789785269.311781:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789785269.311785:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d54400, rc 0) 00000100:00100000:3.0:1789785269.311852:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+57:12334:x1876725530183936:12345-192.168.203.46@tcp:101:bash.0 Request processed in 5480us (5778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785269.311862:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 177 00000100:00100000:2.0:1789785269.315898:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785269.316017:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530184320 00000100:00100000:1.0:1789785269.316030:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530184320 00000100:00100000:1.0:1789785269.316106:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 45 00000100:00100000:1.0:1789785269.316119:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+57:12334:x1876725530184320:12345-192.168.203.46@tcp:35:bash.0 00000100:00100000:1.0:1789785269.316468:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+58:12334:x1876725530184320:12345-192.168.203.46@tcp:35:bash.0 Request processed in 350us (584us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1789785269.316477:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 45 00000100:00100000:2.0:1789785269.444884:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785269.445702:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530184576 00000100:00100000:1.0:1789785269.445716:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530184576 00000100:00100000:1.0:1789785269.445801:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 178 00000100:00100000:1.0:1789785269.445813:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+58:12344:x1876725530184576:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789785269.445846:0:11254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785269.445874:0:11254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ce8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd88bd expref: -99 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789785269.446516:0:11254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789785269.446692:0:11254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ce8a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88bd expref: 60 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.446711:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dae827c3c00) 00010000:00010000:1.0:1789785269.446714:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789785269.446726:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ce8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88bd expref: 60 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.446747:0:11254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a65800, rc 0) 00000100:00100000:1.0:1789785269.446887:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+59:12344:x1876725530184576:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 1076us (2018us total) trans 4294967453 rc 301/301 00000100:00100000:1.0:1789785269.446897:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 178 00000100:00100000:2.0:1789785269.457534:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785269.457663:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530184704 00000100:00100000:3.0:1789785269.457676:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530184704 00000100:00100000:3.0:1789785269.457772:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 179 00000100:00100000:3.0:1789785269.457784:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+59:12344:x1876725530184704:12345-192.168.203.46@tcp:34:lfs.0 00010000:00010000:3.0:1789785269.457880:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845ce98 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.457902:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845ce98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.457933:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845ce98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.457946:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ce9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.457955:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ce9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.458256:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ce9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.458465:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cea6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.458476:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cea6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.458484:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cea6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789785269.458547:0:7896:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cea6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.458563:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845ce98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.458569:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845ce98 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.458588:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845ce98 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.458594:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bae00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785269.458599:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845ce98 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.458608:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845ce98 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.458624:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:3.0:1789785269.458633:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785269.458639:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845ce98 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.458645:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845ce98 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.458659:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ce9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.458664:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ce9f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.458670:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ce9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.458675:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bb600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785269.458677:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ce9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.458683:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ce9f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.458691:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dae827c3300) 00010000:00010000:3.0:1789785269.458693:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785269.458696:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ce9f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.458702:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ce9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.458713:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cea6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.458724:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cea6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.458729:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cea6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.458734:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814ba200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785269.458737:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cea6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.458742:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cea6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.458750:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:3.0:1789785269.458752:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785269.458755:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cea6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.458760:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cea6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785269.458864:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+59:12344:x1876725530184704:12345-192.168.203.46@tcp:34:lfs.0 Request processed in 1079us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785269.458875:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 179 00000100:00100000:3.0:1789785269.464792:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785269.465108:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530184960 00000100:00100000:2.0:1789785269.465120:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530184960 00000100:00100000:2.0:1789785269.465186:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 46 00000100:00100000:2.0:1789785269.465197:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+59:12344:x1876725530184960:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:2.0:1789785269.465497:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+60:12344:x1876725530184960:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 301us (718us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789785269.465522:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 46 00000100:00100000:2.0:1789785269.530196:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785269.530371:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530185216 00000100:00100000:3.0:1789785269.530386:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530185216 00000100:00100000:3.0:1789785269.530545:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 180 00000100:00100000:3.0:1789785269.530559:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+60:12347:x1876725530185216:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789785269.530624:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785269.530651:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cead lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd88c4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.530774:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ceb4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.530794:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ceb4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.530808:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ceb4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.530820:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cebb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.530828:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cebb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.530835:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cebb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.531176:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845cec2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.531187:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845cec2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.531196:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845cec2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785269.531208:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789785269.531313:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ceb4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.531321:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ceb4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.531329:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ceb4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.531393:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bb600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785269.531399:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ceb4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.531408:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ceb4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.531424:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:3.0:1789785269.531428:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785269.531434:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ceb4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.531588:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845ceb4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.531606:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cebb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.531613:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cebb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.531619:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cebb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.531625:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bae00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785269.531636:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cebb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.531643:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cebb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.531652:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dae827c3300) 00010000:00010000:3.0:1789785269.531655:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785269.531658:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cebb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.531665:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cebb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.531713:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cead lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88c4 expref: 63 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.531728:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845cec2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88c4 expref: 62 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.531736:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:3.0:1789785269.531738:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789785269.531741:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bac00, rc 0) 00000100:00100000:3.0:1789785269.531873:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+62:12347:x1876725530185216:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 1317us (1692us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1789785269.531881:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 180 00000100:00100000:0.0:1789785269.539779:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785269.539848:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785269.539950:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530185472 00000100:00100000:1.0:1789785269.540020:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530185472 00000100:00100000:1.0:1789785269.540093:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 181 00000100:00100000:1.0:1789785269.540105:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+62:12347:x1876725530185472:12345-192.168.203.46@tcp:54:lfs.0 00010000:00010000:1.0:1789785269.540557:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ced0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.540588:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ced0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.540601:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ced0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.540649:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ced0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.540656:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ced0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.540664:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ced0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.540669:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785269.540674:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ced0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.540697:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ced0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.540712:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:1.0:1789785269.540716:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789785269.540721:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ced0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.540728:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ced0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785269.540912:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+62:12347:x1876725530185472:12345-192.168.203.46@tcp:54:lfs.0 Request processed in 808us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785269.540922:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 181 00000100:00100000:2.0:1789785269.541004:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530185344 00000100:00100000:2.0:1789785269.541011:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530185344 00000100:00100000:2.0:1789785269.541060:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 14 00000100:00100000:2.0:1789785269.541069:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+62:2397:x1876725530185344:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789785269.541081:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785269.541099:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845cec2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88c4 expref: 62 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.541112:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:2.0:1789785269.541116:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785269.541139:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+61:2397:x1876725530185344:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 71us (1375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785269.541146:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 14 00000100:00100000:0.0:1789785269.553663:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785269.553775:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530185728 00000100:00100000:2.0:1789785269.553788:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530185728 00000100:00100000:2.0:1789785269.553857:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 47 00000100:00100000:2.0:1789785269.553870:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+61:12347:x1876725530185728:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:2.0:1789785269.554187:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+62:12347:x1876725530185728:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 318us (537us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1789785269.554196:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 47 00000100:00100000:3.0:1789785269.708327:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785269.709381:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530185984 00000100:00100000:1.0:1789785269.709396:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530185984 00000100:00100000:1.0:1789785269.709545:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 182 00000100:00100000:1.0:1789785269.709558:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+62:12365:x1876725530185984:12345-192.168.203.46@tcp:101:cat.0 00010000:00010000:1.0:1789785269.709600:0:7896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785269.709625:0:7896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ced7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd88cb expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.709755:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cede lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.709775:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cede lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.709789:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cede lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789785269.709819:0:7896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789785269.709973:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845ced7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88cb expref: 65 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.709996:0:7896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cede lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88cb expref: 64 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.710006:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:1.0:1789785269.710009:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789785269.710013:0:7896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a65400, rc 0) 00000100:00100000:1.0:1789785269.710089:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+64:12365:x1876725530185984:12345-192.168.203.46@tcp:101:cat.0 Request processed in 533us (1776us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1789785269.710097:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 182 00000001:00080000:0.0:1789785269.723830:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000004:00080000:0.0:1789785269.723899:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:2.0:1789785269.726228:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845ccc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.726246:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845ccc3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.726270:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845ccc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.726276:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eacc00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785269.726281:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845ccc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.726290:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845ccc3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.726305:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9dae82670500) 00010000:00010000:2.0:1789785269.726308:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785269.726313:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845ccc3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.726319:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845ccc3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.726368:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845ccca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.726374:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845ccca lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.726380:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845ccca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.726384:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eada00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785269.726387:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845ccca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.726404:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845ccca lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.726413:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:2.0:1789785269.726415:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785269.726418:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845ccca lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.726424:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845ccca lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.726442:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845cd09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.726448:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845cd09 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.726454:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845cd09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.726458:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a64600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785269.726461:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845cd09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.726466:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845cd09 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.726474:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dae827c3300) 00010000:00010000:2.0:1789785269.726476:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785269.726479:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845cd09 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.727100:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845cd09 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.727128:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845ce0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.727134:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845ce0c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.727139:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845ce0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.727152:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785269.727155:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845ce0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.727161:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845ce0c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.727170:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:2.0:1789785269.727173:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785269.727176:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845ce0c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.727181:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845ce0c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.727191:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845ce2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.727196:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845ce2f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.727210:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845ce2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.727215:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814ba400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785269.727218:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845ce2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.727223:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845ce2f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.727230:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:2.0:1789785269.727232:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785269.727235:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845ce2f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.727240:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845ce2f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.727250:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.727256:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce75 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.727261:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.727265:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814ba000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785269.727268:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.727283:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce75 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.727292:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:2.0:1789785269.727295:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785269.727297:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce75 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.727303:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845ce75 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785269.728804:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549121408:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789785269.728882:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785269.729633:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549121408 00000100:00100000:2.0:1789785269.729643:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549121408 00000100:00100000:2.0:1789785269.729703:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789785269.729713:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3660:x1876725549121408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789785269.729869:0:8805:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:2.0:1789785269.729905:0:8805:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aadf4b2, atime: 0x6aadf4b2, ctime: 0x6aadf4b2, blocks: 0x8 00010000:00010000:2.0:1789785269.729914:0:8805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845ceec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.729930:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=377s v=(0 0) 00010000:00010000:2.0:1789785269.729935:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785269.729941:0:8805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845ceec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.729997:0:8805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845ceec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.730027:0:8805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845ceec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789785269.730049:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:0.0:1789785269.730648:0:6512:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dafbb41ec00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1789785269.730662:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dafc1ab0100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dafbb41ee40 00000020:00080000:0.0:1789785269.730665:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dafc1ab0c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dae844ff600 00000020:00080000:1.0:1789785269.730831:0:6565:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1789785269.730924:0:6565:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1789785269.730931:0:8805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845ceec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785269.730955:0:8805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789785269.731075:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789785269.731083:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845ceec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.731090:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55000 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785269.731094:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845ceec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.731102:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845ceec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.731126:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845ceec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.731133:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845ceec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785269.731142:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3660:x1876725549121408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1429us (2259us total) trans 4294967308 rc 0/0 00010000:00010000:1.0:1789785269.731151:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785269.731153:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785269.731154:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785269.731161:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000004:00080000:3.0:1789785269.731221:0:3660:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dae83b59180/2, rc 0, transno 4294967308 00000100:00100000:3.0:1789785269.731227:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549121408:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789785269.747904:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785269.748044:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530186112 00000100:00100000:3.0:1789785269.748055:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530186112 00000100:00100000:3.0:1789785269.748115:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 183 00000100:00100000:3.0:1789785269.748125:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+18:12366:x1876725530186112:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789785269.748149:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785269.748171:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845cef3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd88d2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.748237:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cefa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.748250:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cefa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.748262:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cefa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785269.748300:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789785269.748303:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789785269.748319:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cefa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.748381:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845cef3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88d2 expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.748398:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cefa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88d2 expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785269.748406:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:3.0:1789785269.748421:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789785269.748425:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814ba200, rc 0) 00000100:00100000:3.0:1789785269.748481:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+19:12366:x1876725530186112:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 357us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785269.748488:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 183 00000100:00100000:3.0:1789785269.756791:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785269.759523:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530186496 00000100:00100000:2.0:1789785269.759546:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530186496 00000100:00100000:2.0:1789785269.760319:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 48 00000100:00100000:2.0:1789785269.760375:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+19:12366:x1876725530186496:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:2.0:1789785269.760794:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+20:12366:x1876725530186496:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 459us (4014us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1789785269.760808:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 48 00000100:00100000:2.0:1789785269.771738:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785269.771824:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530186624 00000100:00100000:1.0:1789785269.771834:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530186624 00000100:00100000:1.0:1789785269.771912:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 15 00000100:00100000:1.0:1789785269.771923:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+20:12366:x1876725530186624:12345-192.168.203.46@tcp:103:lfs.0 00010000:00010000:1.0:1789785269.771939:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789785269.771964:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54400/0x2f18ee3fd845ce83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88b6 expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.771986:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cede lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88cb expref: 19 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.771998:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845cd80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8870 expref: 18 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.772007:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:1.0:1789785269.772011:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785269.772083:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+17:12366:x1876725530186624:12345-192.168.203.46@tcp:103:lfs.0 Request processed in 162us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785269.772092:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 15 00000100:00100000:1.0:1789785269.778281:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785269.783700:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530186752 00000100:00100000:0.0:1789785269.783715:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530186752 00000100:00100000:0.0:1789785269.783781:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 184 00000100:00100000:0.0:1789785269.783792:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+17:12366:x1876725530186752:12345-192.168.203.46@tcp:58:lfs.0 00010000:00010000:0.0:1789785269.783916:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cf01 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785269.783932:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cf01 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785269.783943:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cf01 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789785269.784094:0:11254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1789785269.784205:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+17:12366:x1876725530186752:12345-192.168.203.46@tcp:58:lfs.0 Request processed in 414us (5933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785269.784213:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 184 00000100:00100000:3.0:1789785269.832742:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785269.833064:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530186880 00000100:00100000:1.0:1789785269.833075:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530186880 00000100:00100000:1.0:1789785269.833141:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 185 00000100:00100000:1.0:1789785269.833152:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+17:12368:x1876725530186880:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789785269.833172:0:7896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785269.833192:0:7896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845cf08 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd88d9 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833255:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cf0f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833269:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cf0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833280:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cf0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833306:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cf16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833314:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cf16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833321:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cf16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833439:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cf1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833462:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cf1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833469:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cf1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789785269.833512:0:7896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789785269.833526:0:7896:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789785269.833544:0:7896:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cf1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833556:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cf1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833564:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cf0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833579:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cf0f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833587:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cf0f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833594:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785269.833599:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cf0f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833607:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cf0f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833620:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:1.0:1789785269.833623:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785269.833633:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cf0f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833640:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cf0f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833666:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cf16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833674:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cf16 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833679:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cf16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833684:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785269.833687:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cf16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833692:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cf16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833700:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dae827c3800) 00010000:00010000:1.0:1789785269.833703:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785269.833706:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cf16 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833711:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cf16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833742:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845cf08 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88d9 expref: 19 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833769:0:7896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cf1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88d9 expref: 18 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785269.833776:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:1.0:1789785269.833779:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789785269.833781:0:7896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a65800, rc 0) 00000100:00100000:1.0:1789785269.833839:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+18:12368:x1876725530186880:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 689us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785269.833846:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 185 00000100:00100000:0.0:1789785270.083420:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf87815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549121536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789785270.083507:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785270.083586:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc18c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549121792:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789785270.083621:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785270.083631:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549121664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789785270.083687:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549121792 00000100:00100000:1.0:1789785270.083695:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549121792 00000100:00100000:1.0:1789785270.083737:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789785270.083746:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549121792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789785270.083777:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789785270.083827:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549121792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785270.083834:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789785270.083846:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc18c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549121792:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789785270.084087:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785270.084135:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549121536 00000100:00100000:0.0:1789785270.084140:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549121536 00000100:00100000:0.0:1789785270.084175:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549121664 00000100:00100000:0.0:1789785270.084179:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549121664 00000100:00100000:0.0:1789785270.084200:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789785270.084207:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3661:x1876725549121536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789785270.084232:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789785270.084267:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3661:x1876725549121536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785270.084274:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789785270.084287:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789785270.084293:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549121664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789785270.084305:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789785270.084333:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549121664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785270.084358:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:0.0:1789785270.084378:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789785270.084399:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549121664:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789785270.084426:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf87815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549121536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789785270.084669:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549121920:0@lo:400:kworker.0 00000100:00100000:3.0:1789785270.084706:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785270.084740:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1876725549122432:0@lo:400:kworker.0 00000100:00100000:3.0:1789785270.084767:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785270.084775:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876725549122304:0@lo:400:kworker.0 00000100:00100000:3.0:1789785270.084785:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1876725549122944:0@lo:400:kworker.0 00000100:00100000:0.0:1789785270.084799:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785270.084818:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549122816:0@lo:400:kworker.0 00000100:00100000:0.0:1789785270.084842:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785270.085108:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549121920 00000100:00100000:1.0:1789785270.085114:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549121920 00000100:00100000:1.0:1789785270.085145:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1789785270.085152:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:3660:x1876725549121920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785270.085188:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:3660:x1876725549121920:12345-0@lo:400:kworker.0 Request processed in 36us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785270.085195:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1789785270.085461:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549122176:0@lo:400:kworker.0 00000100:00100000:1.0:1789785270.085490:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785270.085512:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549122688:0@lo:400:kworker.0 00000100:00100000:1.0:1789785270.085533:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785270.085552:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789785270.085558:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1876725549122048:0@lo:400:kworker.0 00000100:00100000:1.0:1789785270.085589:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785270.089303:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549122176 00000100:00100000:2.0:1789785270.089318:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549122176 00000100:00100000:2.0:1789785270.089410:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789785270.089430:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549122176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785270.089520:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549122176:12345-0@lo:400:kworker.0 Request processed in 93us (4028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785270.089527:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789785270.090312:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549122816 00000100:00100000:2.0:1789785270.090319:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549122816 00000100:00100000:2.0:1789785270.090385:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549122688 00000100:00100000:2.0:1789785270.090390:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549122688 00000100:00100000:2.0:1789785270.090412:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789785270.090420:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549122816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785270.090469:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549122816:12345-0@lo:400:kworker.0 Request processed in 50us (5625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785270.090475:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789785270.090487:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789785270.090493:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549122688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785270.090523:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549122688:12345-0@lo:400:kworker.0 Request processed in 29us (4988us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785270.090529:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:2.0:1789785270.090565:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789785270.090616:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549122816:0@lo:400:kworker.0 00000100:00100000:3.0:1789785270.100088:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549122432 00000100:00100000:3.0:1789785270.100101:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549122432 00000100:00100000:3.0:1789785270.100175:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549122304 00000100:00100000:3.0:1789785270.100178:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549122304 00000100:00100000:3.0:1789785270.100198:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549122048 00000100:00100000:3.0:1789785270.100202:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549122048 00000100:00100000:3.0:1789785270.100220:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1789785270.100230:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1876725549122432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785270.100312:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1876725549122432:12345-0@lo:400:kworker.0 Request processed in 84us (15544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785270.100319:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1789785270.103130:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1789785270.103154:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876725549122304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785270.103255:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876725549122304:12345-0@lo:400:kworker.0 Request processed in 112us (18455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785270.103271:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1789785270.103306:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1789785270.103314:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1876725549122048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785270.103376:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1876725549122048:12345-0@lo:400:kworker.0 Request processed in 63us (17786us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785270.103382:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00080000:3.0:1789785270.103411:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789785270.103449:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876725549122304:0@lo:400:kworker.0 00000100:00100000:3.0:1789785270.107498:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785270.107602:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549121920:0@lo:400:kworker.0 00000100:00100000:3.0:1789785270.107622:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1876725549122432:0@lo:400:kworker.0 00000100:00100000:3.0:1789785270.107657:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549122944 00000100:00100000:3.0:1789785270.107663:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549122944 00000100:00100000:3.0:1789785270.107716:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1789785270.107724:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf42ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1876725549122944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785270.107795:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf42ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1876725549122944:12345-0@lo:400:kworker.0 Request processed in 71us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785270.107803:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00080000:3.0:1789785270.107827:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789785270.107844:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1876725549122944:0@lo:400:kworker.0 00000100:00100000:0.0:1789785270.112427:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1876725549122048:0@lo:400:kworker.0 00000100:00100000:0.0:1789785270.112441:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf987ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1876725549122560:0@lo:400:kworker.0 00000100:00100000:0.0:1789785270.112509:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785270.112549:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1876725549123072:0@lo:400:kworker.0 00000100:00100000:0.0:1789785270.112582:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785270.112607:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549122560 00000100:00100000:0.0:1789785270.112619:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549122560 00000100:00100000:3.0:1789785270.112687:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549123072 00000100:00100000:3.0:1789785270.112691:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549123072 00000100:00100000:0.0:1789785270.112758:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1789785270.112768:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1876725549122560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785270.112816:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1876725549122560:12345-0@lo:400:kworker.0 Request processed in 50us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785270.112823:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00080000:1.0:1789785270.112900:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789785270.112925:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549122176:0@lo:400:kworker.0 00000100:00100000:1.0:1789785270.112938:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549122688:0@lo:400:kworker.0 00010000:00080000:1.0:1789785270.114077:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9daf987ffb80 x1876725549122560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785270.114096:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf987ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1876725549122560:0@lo:400:kworker.0 00000100:00100000:0.0:1789785270.117475:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1789785270.117772:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1876725549123072:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789785270.117994:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae8393df80 x1876725549123072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785270.118023:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1876725549123072:0@lo:400:kworker.0 00000100:00100000:0.0:1789785270.125149:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1876725549123072:12345-0@lo:400:kworker.0 Request processed in 392us (5295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785270.125172:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00010000:00010000:1.0:1789785270.274496:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789785270.722806:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789785270.722814:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789785270.722858:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789785270.722865:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789785270.723032:0:13813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1876725549123200:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789785270.723151:0:13813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf92353b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789785270.742081:0:13813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1876725549123200:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789785270.745162:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785270.745251:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530187008 00000100:00100000:1.0:1789785270.745261:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530187008 00000100:00100000:1.0:1789785270.745368:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 186 00000100:00100000:1.0:1789785270.745380:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+18:12379:x1876725530187008:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789785270.745409:0:6534:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789785270.745520:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+18:12379:x1876725530187008:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 Request processed in 143us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785270.745528:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 186 00000100:00100000:0.0:1789785270.753787:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785270.754272:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530187136 00000100:00100000:3.0:1789785270.754283:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530187136 00000100:00100000:3.0:1789785270.754380:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 187 00000100:00100000:3.0:1789785270.754391:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+18:12379:x1876725530187136:12345-192.168.203.46@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789785270.754458:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845cf24 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754474:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845cf24 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754488:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845cf24 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754503:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cf2b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754509:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cf2b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754515:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cf2b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754541:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cf32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754549:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cf32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754556:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cf32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785270.754625:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789785270.754629:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789785270.754642:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cf32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754653:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845cf24 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754661:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845cf24 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754668:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845cf24 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754674:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814baa00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785270.754678:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845cf24 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754685:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845cf24 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754697:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9daf87d6e700) 00010000:00010000:3.0:1789785270.754701:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785270.754705:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845cf24 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754711:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845cf24 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754724:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cf2b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754740:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cf2b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754745:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cf2b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754749:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bae00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785270.754753:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cf2b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754759:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cf2b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754767:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9dafac970f00) 00010000:00010000:3.0:1789785270.754770:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785270.754774:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cf2b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754779:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845cf2b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754794:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cf32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754801:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cf32 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754806:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cf32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754811:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bb600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785270.754821:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cf32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754828:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cf32 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754836:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:3.0:1789785270.754839:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785270.754842:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cf32 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.754848:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cf32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785270.754921:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+18:12379:x1876725530187136:12345-192.168.203.46@tcp:34:lhsmtool_posix.0 Request processed in 532us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785270.754929:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 187 00000100:00100000:0.0:1789785270.763763:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785270.763831:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530187392 00000100:00100000:3.0:1789785270.763842:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530187392 00000100:00100000:3.0:1789785270.763899:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 188 00000100:00100000:3.0:1789785270.763909:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+18:12379:x1876725530187392:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789785270.763927:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785270.763946:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cf39 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd88e0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.764049:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cf40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.764064:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cf40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.764089:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cf40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785270.764101:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789785270.764187:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cf40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.764195:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cf40 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.764200:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cf40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.764206:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bba00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785270.764210:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cf40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.764217:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cf40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.764228:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:3.0:1789785270.764232:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789785270.764236:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cf40 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.764241:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cf40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.764280:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cf39 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88e0 expref: 20 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.764302:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9daf87d6e700) 00010000:00010000:3.0:1789785270.764305:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789785270.764310:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cf39 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88e0 expref: 20 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.764320:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bb200, rc 0) 00000100:00100000:3.0:1789785270.765157:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+19:12379:x1876725530187392:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 1239us (1392us total) trans 4294967459 rc 301/301 00000100:00100000:3.0:1789785270.765167:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 188 00000100:00100000:1.0:1789785270.778834:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785270.778872:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530187520 00000100:00100000:1.0:1789785270.778881:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530187520 00000100:00100000:1.0:1789785270.778948:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 189 00000100:00100000:1.0:1789785270.778958:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+19:12379:x1876725530187520:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789785270.778988:0:7896:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789785270.779094:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+19:12379:x1876725530187520:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 Request processed in 138us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785270.779102:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 189 00000100:00100000:1.0:1789785270.785795:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785270.785834:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530187776 00000100:00100000:1.0:1789785270.785842:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530187776 00000100:00100000:1.0:1789785270.785898:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 190 00000100:00100000:1.0:1789785270.785907:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+19:12379:x1876725530187776:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789785270.785925:0:11254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785270.785928:0:11254:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789785270.785955:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845cefa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88d2 expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.785971:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:1.0:1789785270.785976:0:11254:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789785270.785987:0:11254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cf4e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd88e7 expref: -99 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789785270.786318:0:11254:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1789785270.787244:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cf55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.787261:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cf55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.787292:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cf55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.787531:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845cf4e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88e7 expref: 21 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.787547:0:11254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cf55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88e7 expref: 20 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.787555:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dae827c3800) 00010000:00010000:1.0:1789785270.787558:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789785270.787561:0:11254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a65400, rc 0) 00000100:00100000:1.0:1789785270.787679:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+20:12379:x1876725530187776:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 1772us (1891us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1789785270.787687:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 190 00000100:00100000:3.0:1789785270.790541:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785270.790722:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530188032 00000100:00100000:1.0:1789785270.790731:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530188032 00000100:00100000:1.0:1789785270.790783:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 191 00000100:00100000:1.0:1789785270.790794:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf987ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+20:12379:x1876725530188032:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789785270.790855:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785270.790877:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845cf55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88e7 expref: 20 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.790893:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dae827c3800) 00010000:00010000:1.0:1789785270.790902:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789785270.790922:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845cf63 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.790940:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845cf63 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.790949:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845cf63 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.794774:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845cf6a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x55095baf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.794796:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845cf6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x55095baf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.794808:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845cf6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x55095baf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.794908:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845cf63 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.794917:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845cf63 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.794925:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845cf63 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.794931:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a64600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785270.794936:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845cf63 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.794944:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845cf63 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.795000:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:1.0:1789785270.795009:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785270.795302:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845cf63 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.795318:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845cf63 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.795330:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845cf6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x55095baf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.795725:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845cf6a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x55095baf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.795739:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845cf6a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x55095baf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.795744:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a64200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785270.795747:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845cf6a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x55095baf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.795759:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845cf6a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x55095baf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.795770:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x55095baf (ffff9dae827c3100) 00010000:00010000:1.0:1789785270.795773:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785270.795776:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845cf6a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x55095baf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.795782:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64200/0x2f18ee3fd845cf6a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x55095baf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785270.795905:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf987ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+19:12379:x1876725530188032:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 5109us (5369us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789785270.795929:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 191 00000100:00100000:2.0:1789785270.801244:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785270.801308:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530188160 00000100:00100000:3.0:1789785270.801317:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530188160 00000100:00100000:3.0:1789785270.801578:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 192 00000100:00100000:3.0:1789785270.801589:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+19:12379:x1876725530188160:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789785270.801610:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785270.801630:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845cf71 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd88ee expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.801662:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cf78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.801676:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cf78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.801686:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cf78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.801790:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845cf71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88ee expref: 21 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.801805:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cf78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88ee expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.801813:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dafac970f00) 00010000:00010000:3.0:1789785270.801816:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789785270.801819:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bb200, rc 0) 00000100:00100000:3.0:1789785270.801880:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+20:12379:x1876725530188160:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 293us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785270.801887:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 192 00000100:00100000:0.0:1789785270.807433:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785270.808758:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530188416 00000100:00100000:2.0:1789785270.808771:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530188416 00000100:00100000:2.0:1789785270.808824:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 193 00000100:00100000:2.0:1789785270.808834:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+20:12379:x1876725530188416:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789785270.808912:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cf7f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785270.808935:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cf7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785270.808947:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cf7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789785270.809102:0:11254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1789785270.809111:0:11254:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 379062771747ns, next at 380062769654ns, rc = 0 00000004:00010000:2.0:1789785270.809152:0:11254:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005fc2018d reply state 00000000e7acd038 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cf7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785270.809164:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cf7f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785270.809172:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dafac970f00) 00010000:00010000:2.0:1789785270.809175:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789785270.809178:0:11254:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789785270.809262:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+22:12379:x1876725530188416:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 429us (1838us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1789785270.809270:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 193 00000100:00100000:3.0:1789785270.813828:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785270.815646:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530188544 00000100:00100000:2.0:1789785270.815659:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530188544 00000100:00100000:2.0:1789785270.815723:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 194 00000100:00100000:2.0:1789785270.815733:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf987fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+22:12379:x1876725530188544:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789785270.815757:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785270.815776:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54a00/0x2f18ee3fd845cf86 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd88f5 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785270.815846:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54a00/0x2f18ee3fd845cf86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88f5 expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785270.815859:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54a00/0x2f18ee3fd845cf86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88f5 expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785270.815877:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dafac970f00) 00010000:00010000:2.0:1789785270.815881:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789785270.815885:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d54a00, rc 0) 00000100:00100000:2.0:1789785270.815944:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf987fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+23:12379:x1876725530188544:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 213us (2666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785270.815954:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 194 00000100:00100000:2.0:1789785270.826056:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785270.826499:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530188672 00000100:00100000:0.0:1789785270.826509:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530188672 00000100:00100000:0.0:1789785270.826580:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 60 00000100:00100000:0.0:1789785270.826591:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+6:2398:x1876725530188672:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789785270.826823:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+7:2398:x1876725530188672:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 Request processed in 234us (774us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789785270.826831:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 60 00000100:00080000:3.0:1789785270.831151:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789785270.837598:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785270.837744:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530188928 00000100:00100000:1.0:1789785270.837754:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530188928 00000100:00100000:1.0:1789785270.837808:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 49 00000100:00100000:1.0:1789785270.837817:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+23:12379:x1876725530188928:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789785270.838034:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+24:12379:x1876725530188928:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 217us (442us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1789785270.838042:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 49 00000100:00100000:3.0:1789785270.840313:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785270.840769:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530189184 00000100:00100000:2.0:1789785270.840777:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530189184 00000100:00100000:2.0:1789785270.840854:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 195 00000100:00100000:2.0:1789785270.840863:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+24:12379:x1876725530189184:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789785270.840970:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+24:12379:x1876725530189184:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 108us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785270.840977:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 195 00000100:00100000:0.0:1789785270.854641:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785270.855549:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530189312 00000100:00100000:3.0:1789785270.855560:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530189312 00000100:00100000:3.0:1789785270.855631:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 196 00000100:00100000:3.0:1789785270.855642:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+24:12379:x1876725530189312:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789785270.855663:0:7896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785270.856080:0:7896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845cf8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd88fc expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.856150:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cf94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.856166:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cf94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.856188:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cf94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785270.856234:0:7896:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789785270.856253:0:7896:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cf94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.857477:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845cf8d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88fc expref: 26 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.857507:0:7896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cf94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88fc expref: 25 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.857518:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dafac970f00) 00010000:00010000:3.0:1789785270.857521:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789785270.857525:0:7896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bba00, rc 0) 00000100:00100000:3.0:1789785270.858325:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+25:12379:x1876725530189312:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 2679us (3689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785270.858334:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 196 00000100:00100000:0.0:1789785270.877620:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785270.877800:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530189440 00000100:00100000:2.0:1789785270.877810:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530189440 00000100:00100000:2.0:1789785270.877867:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 61 00000100:00100000:2.0:1789785270.877877:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+7:2400:x1876725530189440:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789785270.877902:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785270.877921:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845cf9b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8903 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789785270.877956:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aadf4b5, blocks: 0x0 00010000:00010000:2.0:1789785270.877975:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789785270.877980:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785270.877990:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845cf9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8903 expref: 8 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785270.878010:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845cf9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8903 expref: 8 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785270.878024:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d55400, rc 0) 00000100:00100000:2.0:1789785270.878081:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+8:2400:x1876725530189440:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 205us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785270.878088:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 61 00000100:00100000:0.0:1789785270.886556:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785270.886650:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530189696 00000100:00100000:3.0:1789785270.886660:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530189696 00000100:00100000:3.0:1789785270.886709:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 197 00000100:00100000:3.0:1789785270.886718:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+25:12379:x1876725530189696:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789785270.886813:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+25:12379:x1876725530189696:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 95us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785270.886820:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 197 00000100:00100000:0.0:1789785270.890556:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785270.891413:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530189824 00000100:00100000:1.0:1789785270.891425:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530189824 00000100:00100000:1.0:1789785270.891490:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 62 00000100:00100000:1.0:1789785270.891500:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+8:12379:x1876725530189824:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789785270.891516:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785270.891533:0:8451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000752b0cce/0x2f18ee3fd845cfa2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd890a expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.891572:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845cf9b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8903 expref: 9 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.891581:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789785270.891585:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789785270.891591:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000752b0cce/0x2f18ee3fd845cfa2 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd890a expref: 9 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.891624:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845cf9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8903 expref: 9 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.891651:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845cf9b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8903 expref: 9 pid: 8449 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785270.891665:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb620df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8451:1876725549123328:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789785270.891759:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6240 going to sleep for 11 seconds 00000100:00100000:0.0:1789785270.895885:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785270.895978:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530189952 00000100:00100000:3.0:1789785270.895999:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530189952 00010000:00010000:3.0:1789785270.896134:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845cf9b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8903 expref: 10 pid: 8449 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785270.896175:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 87 00000100:00100000:3.0:1789785270.896184:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84527b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+10:2398:x1876725530189952:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789785270.896197:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785270.896217:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845cf9b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8903 expref: 10 pid: 8449 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.896230:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845cf9b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8903 expref: 10 pid: 8449 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.896253:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785270.896267:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785270.896276:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000752b0cce/0x2f18ee3fd845cfa2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd890a expref: 10 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.896364:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000752b0cce/0x2f18ee3fd845cfa2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd890a expref: 10 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.896720:0:6518:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000752b0cce/0x2f18ee3fd845cfa2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd890a expref: 10 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785270.896735:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf453100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6518:1876725549123456:192.168.203.46@tcp:105: 00000100:00100000:3.0:1789785270.896809:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf854403c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789785270.897434:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845cf9b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8903 expref: 10 pid: 8449 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785270.897450:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb620df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8451:1876725549123328:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789785270.897473:0:8451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000752b0cce/0x2f18ee3fd845cfa2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd890a expref: 9 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.897486:0:8451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64200, rc 0) 00000100:00100000:1.0:1789785270.897520:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+9:12379:x1876725530189824:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 6021us (6973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785270.897528:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 62 00000100:00100000:1.0:1789785270.901866:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf453100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6518:1876725549123456:192.168.203.46@tcp:105: 00010000:00010000:1.0:1789785270.901894:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785270.901938:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84527b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+8:2398:x1876725530189952:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 5754us (6060us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785270.901949:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 87 00000100:00100000:0.0:1789785270.907749:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785270.914453:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530190080 00000100:00100000:1.0:1789785270.914466:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530190080 00002000:00100000:1.0:1789785270.914528:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9dae84524a80 x1876725530190080/t0(0) o4->026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp:401/0 lens 504/0 e 0 to 0 dl 1789785281 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789785270.914540:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dae84524a80 with x1876725530190080 ext(0->8) 00002000:00010000:1.0:1789785270.914546:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dae84524a80 00000100:00100000:1.0:1789785270.914628:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:1.0:1789785270.914640:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:026b2112-ee35-499c-8d01-18663664f08e+8:2398:x1876725530190080:12345-192.168.203.46@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789785270.917702:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:026b2112-ee35-499c-8d01-18663664f08e+10:2398:x1876725530190080:12345-192.168.203.46@tcp:4:lhsmtool_posix.0 Request processed in 3053us (9950us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789785270.917718:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 5 00002000:00100000:1.0:1789785270.917731:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9dae84524a80 x1876725530190080/t4294967316(0) o4->026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp:401/0 lens 504/448 e 0 to 0 dl 1789785281 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789785270.917743:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dae84524a80 with x1876725530190080 ext(0->8) 00002000:00010000:1.0:1789785270.917750:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dae84524a80 00000100:00100000:1.0:1789785270.922455:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785270.922795:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530190208 00000100:00100000:3.0:1789785270.922805:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530190208 00000100:00100000:3.0:1789785270.922857:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 198 00000100:00100000:3.0:1789785270.922867:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb620df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+25:12379:x1876725530190208:12345-192.168.203.46@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789785270.926385:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1789785270.926400:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1789785270.926419:0:6512:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1789785270.926512:0:6565:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1789785270.926523:0:6565:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1789785270.926538:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549123584:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789785270.926615:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785270.926672:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549123584 00000100:00100000:2.0:1789785270.926678:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549123584 00000100:00100000:2.0:1789785270.926728:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789785270.926737:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8393ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549123584:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789785270.926850:0:8449:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789785270.926854:0:8449:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789785269 00002000:00010000:2.0:1789785270.926857:0:8449:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789785270.926859:0:8449:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789785269 -> 1789785269 00002000:00010000:2.0:1789785270.926861:0:8449:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789785270.926900:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8393ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3662:x1876725549123584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 164us (285us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789785270.926907:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000004:00080000:2.0:1789785270.926948:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dae8393df80/2, rc 0, transno 4294967317 00000100:00100000:2.0:1789785270.926954:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549123584:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789785270.927041:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb620df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+20:12379:x1876725530190208:12345-192.168.203.46@tcp:44:lhsmtool_posix.0 Request processed in 4175us (4595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785270.927050:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 198 00010000:00010000:1.0:1789785270.927190:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cf7f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.927201:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cf7f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.927209:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cf7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.927215:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785270.927220:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cf7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.927238:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cf7f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.927254:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dafac970f00) 00010000:00010000:1.0:1789785270.927257:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789785270.927261:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cf7f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.927267:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cf7f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789785270.929224:0:14721:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789785270.929233:0:14721:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789785270.929258:0:14721:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789785270.929264:0:14721:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789785270.932861:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785270.932948:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530190336 00000100:00100000:2.0:1789785270.932958:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530190336 00000100:00100000:2.0:1789785270.933012:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 64 00000100:00100000:2.0:1789785270.933033:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+10:2397:x1876725530190336:12345-192.168.203.46@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789785270.934889:0:8445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:1.0:1789785270.934904:0:8445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000100:00100000:2.0:1789785270.935130:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+7:2397:x1876725530190336:12345-192.168.203.46@tcp:16:lhsmtool_posix.0 Request processed in 2104us (2273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785270.935140:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 64 00000100:00100000:2.0:1789785270.938444:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785270.938854:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530190592 00000100:00100000:3.0:1789785270.938866:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530190592 00000100:00100000:3.0:1789785270.939269:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 199 00000100:00100000:3.0:1789785270.939281:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8393ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+19:12379:x1876725530190592:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789785270.939335:0:7896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785270.939384:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cf94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88fc expref: 19 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.939860:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dafac970f00) 00010000:00010000:3.0:1789785270.939865:0:7896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789785270.939895:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845cfa9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.939907:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845cfa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.939917:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845cfa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789785270.940309:0:7896:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d023ae87 reply state 000000008de29fd8 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845cfa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.940333:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845cfa9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.940358:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dafac970f00) 00010000:00010000:3.0:1789785270.940361:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789785270.940365:0:7896:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789785270.940771:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8393ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+20:12379:x1876725530190592:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 1489us (2343us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1789785270.940780:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 199 00000100:00100000:3.0:1789785270.949581:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785270.949686:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530190720 00000100:00100000:2.0:1789785270.949697:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530190720 00000100:00100000:2.0:1789785270.949839:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 65 00000100:00100000:2.0:1789785270.949858:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf453100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+7:2399:x1876725530190720:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789785270.950029:0:8449:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789785270.950033:0:8449:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789785269 -> 1789785268 00002000:00010000:2.0:1789785270.950035:0:8449:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789785266 00002000:00010000:2.0:1789785270.950037:0:8449:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789785269 -> 1789785268 00002000:00010000:2.0:1789785270.950039:0:8449:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789785270.950099:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf453100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+8:2399:x1876725530190720:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 Request processed in 244us (544us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789785270.950107:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 65 00000100:00100000:3.0:1789785270.958728:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785270.961122:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530190976 00000100:00100000:2.0:1789785270.961137:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530190976 00000100:00100000:2.0:1789785270.961210:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 200 00000100:00100000:2.0:1789785270.961220:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+20:12379:x1876725530190976:12345-192.168.203.46@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789785270.961285:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845cfb0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785270.961301:0:11254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cf78 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88ee expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785270.961311:0:11254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845cfb0 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785270.961363:0:11254:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cf78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88ee expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785270.961377:0:11254:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cf78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88ee expref: 20 pid: 6535 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785270.961402:0:11254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11254:1876725549123712:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789785270.961489:0:11254:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae82a44cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785270.977861:0:11254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11254:1876725549123712:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785270.977890:0:11254:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845cfb0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785270.980301:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785270.982072:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530191104 00000100:00100000:1.0:1789785270.982086:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530191104 00010000:00010000:1.0:1789785270.982128:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cf78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88ee expref: 21 pid: 6535 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785270.982168:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 88 00000100:00100000:1.0:1789785270.982177:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+21:2397:x1876725530191104:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789785270.982191:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785270.982198:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cf78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88ee expref: 21 pid: 6535 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.982211:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cf78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88ee expref: 21 pid: 6535 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.982243:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845cf78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88ee expref: 21 pid: 6535 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.982274:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dafac970f00) 00010000:00010000:1.0:1789785270.982278:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845cfb0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.982287:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845cfb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.982294:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845cfb0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.982321:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785270.982393:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+20:2397:x1876725530191104:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 216us (2099us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785270.982401:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 88 00010000:00010000:3.0:1789785270.982556:0:11254:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845cfb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.982575:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845cfb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.982623:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845cfb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.982630:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845cfb0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.982637:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845cfb0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.982653:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785270.982657:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845cfb0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.982675:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845cfb0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.982685:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dafac970f00) 00010000:00010000:3.0:1789785270.982687:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789785270.982691:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845cfb0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785270.982697:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55800/0x2f18ee3fd845cfb0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785270.982738:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+19:12379:x1876725530190976:12345-192.168.203.46@tcp:55:lhsmtool_posix.0 Request processed in 21520us (24020us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789785270.982746:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 200 00000100:00100000:0.0:1789785270.987244:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785270.987983:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530191232 00000100:00100000:1.0:1789785270.987994:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530191232 00000100:00100000:1.0:1789785270.988065:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 66 00000100:00100000:1.0:1789785270.988077:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+8:2398:x1876725530191232:12345-192.168.203.46@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789785270.988120:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fd9861bf/0x2f18ee3fd845cfb7 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.988140:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000752b0cce/0x2f18ee3fd845cfa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd890a expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.988163:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789785270.988168:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789785270.988172:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd9861bf/0x2f18ee3fd845cfb7 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.988206:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000752b0cce/0x2f18ee3fd845cfa2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd890a expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785270.988219:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000752b0cce/0x2f18ee3fd845cfa2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd890a expref: 8 pid: 8451 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785270.988233:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8451:1876725549123840:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789785270.988324:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789785270.994459:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8451:1876725549123840:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785270.994488:0:8451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fd9861bf/0x2f18ee3fd845cfb7 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785271.005688:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785271.006759:0:7484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530191360 00000100:00100000:3.0:1789785271.006771:0:7484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530191360 00010000:00010000:3.0:1789785271.006815:0:7484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000752b0cce/0x2f18ee3fd845cfa2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd890a expref: 9 pid: 8451 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785271.006863:0:7484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 89 00000100:00100000:3.0:1789785271.006887:0:7484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84525180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+9:2397:x1876725530191360:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789785271.006902:0:7484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785271.006925:0:7484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000752b0cce/0x2f18ee3fd845cfa2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd890a expref: 9 pid: 8451 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.006940:0:7484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000752b0cce/0x2f18ee3fd845cfa2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd890a expref: 9 pid: 8451 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.007240:0:7484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000752b0cce/0x2f18ee3fd845cfa2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd890a expref: 9 pid: 8451 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.007260:0:7484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789785271.007264:0:7484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789785271.007270:0:7484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd9861bf/0x2f18ee3fd845cfb7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.007281:0:7484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd9861bf/0x2f18ee3fd845cfb7 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.007311:0:7484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785271.007392:0:7484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84525180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+8:2397:x1876725530191360:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 506us (1712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785271.007400:0:7484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 89 00010000:00010000:2.0:1789785271.007557:0:8451:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fd9861bf/0x2f18ee3fd845cfb7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.007576:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd9861bf/0x2f18ee3fd845cfb7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.007607:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fd9861bf/0x2f18ee3fd845cfb7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.007616:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd9861bf/0x2f18ee3fd845cfb7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.007623:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd9861bf/0x2f18ee3fd845cfb7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.007629:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a64000 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:2.0:1789785271.007634:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd9861bf/0x2f18ee3fd845cfb7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.007642:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd9861bf/0x2f18ee3fd845cfb7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.007675:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd9861bf/0x2f18ee3fd845cfb7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.007682:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd9861bf/0x2f18ee3fd845cfb7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785271.007737:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+7:2398:x1876725530191232:12345-192.168.203.46@tcp:1:lhsmtool_posix.0 Request processed in 19662us (20501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785271.007745:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 66 00000100:00100000:0.0:1789785271.030637:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785271.031841:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530191616 00000100:00100000:2.0:1789785271.031853:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530191616 00000100:00100000:2.0:1789785271.031922:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 201 00000100:00100000:2.0:1789785271.031933:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+19:12379:x1876725530191616:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789785271.032007:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cfbe lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.032035:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845ce05 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8893 expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.032045:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cfbe lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.032078:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845ce05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8893 expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.032091:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845ce05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8893 expref: 19 pid: 6533 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785271.032113:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1876725549123968:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789785271.032190:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae82a44b40 going to sleep for 11 seconds 00000100:00080000:0.0:1789785271.033468:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789785271.037124:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1876725549123968:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789785271.037155:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cfbe lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785271.045484:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785271.046173:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530191744 00000100:00100000:3.0:1789785271.046182:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530191744 00010000:00010000:3.0:1789785271.046219:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845ce05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8893 expref: 20 pid: 6533 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785271.046390:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 90 00000100:00100000:3.0:1789785271.046401:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84524380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:026b2112-ee35-499c-8d01-18663664f08e+20:2397:x1876725530191744:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789785271.046416:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785271.046422:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845ce05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8893 expref: 20 pid: 6533 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.046435:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845ce05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8893 expref: 20 pid: 6533 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.046457:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845ce05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8893 expref: 20 pid: 6533 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.046472:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:3.0:1789785271.046478:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cfbe lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.046488:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cfbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.046494:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cfbe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.046516:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785271.046573:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84524380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:026b2112-ee35-499c-8d01-18663664f08e+19:2397:x1876725530191744:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 164us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785271.046581:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 90 00010000:00010000:3.0:1789785271.046789:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cfbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.046804:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cfbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.047720:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cfc5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.047737:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54a00/0x2f18ee3fd845cf86 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88f5 expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.047746:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cfc5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.047778:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54a00/0x2f18ee3fd845cf86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88f5 expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.047792:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54a00/0x2f18ee3fd845cf86 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88f5 expref: 19 pid: 6533 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785271.047806:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1876725549124096:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789785271.048119:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf85440840 going to sleep for 11 seconds 00000100:00100000:0.0:1789785271.062585:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785271.062630:0:7484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530191872 00000100:00100000:0.0:1789785271.062639:0:7484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530191872 00010000:00010000:0.0:1789785271.062688:0:7484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54a00/0x2f18ee3fd845cf86 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88f5 expref: 20 pid: 6533 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785271.062723:0:7484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 91 00000100:00100000:0.0:1789785271.062734:0:7484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84527480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+20:2397:x1876725530191872:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789785271.062767:0:7484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785271.062775:0:7484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54a00/0x2f18ee3fd845cf86 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88f5 expref: 20 pid: 6533 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785271.062789:0:7484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54a00/0x2f18ee3fd845cf86 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88f5 expref: 20 pid: 6533 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785271.062817:0:7484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dafac970f00) 00010000:00010000:0.0:1789785271.062822:0:7484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cfc5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785271.062830:0:7484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cfc5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785271.062838:0:7484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cfc5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785271.062857:0:7484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785271.062907:0:7484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84527480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+20:2397:x1876725530191872:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 174us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785271.062914:0:7484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 91 00010000:00010000:2.0:1789785271.063279:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54a00/0x2f18ee3fd845cf86 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88f5 expref: 19 pid: 6533 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785271.063297:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1876725549124096:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789785271.063317:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cfc5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.063325:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cfc5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.063331:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cfc5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789785271.063466:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1789785271.063585:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1789785271.063630:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1789785271.063713:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae8393f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6534:1876725549124224:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789785271.063761:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785271.063788:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf98775f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789785271.064701:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549124224 00000100:00100000:0.0:1789785271.064711:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549124224 00000100:00100000:0.0:1789785271.064757:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789785271.064766:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafc18c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6534:x1876725549124224:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789785271.064852:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafc18c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6534:x1876725549124224:12345-0@lo:1000:mdt00_001.0 Request processed in 87us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785271.064859:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789785271.064939:0:6534:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:2.0:1789785271.064949:0:6534:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dae8393df80, transno 4294967317 00000100:00100000:2.0:1789785271.064981:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae8393f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6534:1876725549124224:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1789785271.065115:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1789785271.065163:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafc18c4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6534:1876725549124352:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789785271.065194:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785271.065213:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf98775f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789785271.065226:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549124352 00000100:00100000:2.0:1789785271.065230:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549124352 00000100:00100000:2.0:1789785271.065265:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789785271.065272:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8393f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6534:x1876725549124352:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789785271.065393:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8393f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6534:x1876725549124352:12345-0@lo:1000:mdt00_001.0 Request processed in 121us (197us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789785271.065400:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789785271.065430:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafc18c4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6534:1876725549124352:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789785271.065457:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cfc5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.065467:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cfc5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.065474:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cfc5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.065480:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bba00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785271.065484:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cfc5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.065492:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cfc5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.065517:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dafac970f00) 00010000:00010000:2.0:1789785271.065520:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789785271.065525:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cfc5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.065530:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845cfc5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.065551:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cf01 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.065557:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cf01 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.065572:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cf01 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.065577:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eac400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785271.065580:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cf01 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.065585:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cf01 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.065593:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:2.0:1789785271.065595:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789785271.065598:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cf01 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.065603:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845cf01 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.065633:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cfcc lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.065644:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cf1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88d9 expref: 22 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.065652:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cfcc lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.065689:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cf1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88d9 expref: 22 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785271.065701:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cf1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88d9 expref: 22 pid: 7896 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785271.065712:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84603800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1876725549124480:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789785271.065761:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb41ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1789785271.085806:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785271.085840:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530192000 00000100:00100000:0.0:1789785271.085848:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530192000 00010000:00010000:0.0:1789785271.085888:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cf1d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88d9 expref: 23 pid: 7896 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785271.085922:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 92 00000100:00100000:0.0:1789785271.085941:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84524e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:026b2112-ee35-499c-8d01-18663664f08e+23:2398:x1876725530192000:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789785271.085956:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785271.085963:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cf1d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88d9 expref: 23 pid: 7896 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785271.085977:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cf1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88d9 expref: 23 pid: 7896 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785271.085998:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:0.0:1789785271.086004:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cfcc lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785271.086014:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cfcc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785271.086032:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cfcc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785271.086053:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785271.086099:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84524e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:026b2112-ee35-499c-8d01-18663664f08e+23:2398:x1876725530192000:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 159us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785271.086107:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 92 00010000:00010000:3.0:1789785271.086283:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845cf1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd88d9 expref: 22 pid: 7896 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785271.086300:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84603800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1876725549124480:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785271.086319:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cfcc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.086327:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cfcc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.086368:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cfcc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.086379:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cfcc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.086386:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cfcc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.086392:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cfcc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.086398:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785271.086402:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cfcc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.086410:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cfcc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.086419:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:3.0:1789785271.086422:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785271.086425:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cfcc lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.086430:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54600/0x2f18ee3fd845cfcc lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.086441:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cfbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.086447:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cfbe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.086459:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cfbe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.086464:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785271.086466:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cfbe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.086472:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cfbe lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.086480:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827c3500) 00010000:00010000:3.0:1789785271.086482:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789785271.086485:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cfbe lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785271.086490:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54800/0x2f18ee3fd845cfbe lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785271.086639:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+21:12379:x1876725530191616:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 54709us (56011us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1789785271.086648:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 201 00000020:00080000:3.0:1789785271.086652:0:6534:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789785271.087328:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789785271.087334:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789785271.087850:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1789785271.087860:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789785271.091183:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785271.091370:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530192256 00000100:00100000:1.0:1789785271.091380:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530192256 00000100:00100000:1.0:1789785271.091446:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 50 00000100:00100000:1.0:1789785271.091457:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf88771450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+21:12379:x1876725530192256:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789785271.091732:0:6537:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789785271.091764:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:1.0:1789785271.091795:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cfd3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785271.091811:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cfd3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785271.091822:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cfd3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785271.091834:0:6537:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cfd3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785271.091842:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cfd3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785271.091848:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cfd3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785271.091865:0:6537:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789785271.091957:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf88771450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+23:12379:x1876725530192256:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 501us (780us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1789785271.091966:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 50 00000020:00080000:1.0:1789785271.091984:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789785271.092028:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789785271.092034:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cfd3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785271.092042:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65c00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785271.092046:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cfd3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785271.092054:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cfd3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785271.092066:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dafac970f00) 00010000:00010000:1.0:1789785271.092069:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789785271.092073:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cfd3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785271.092618:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845cfd3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785271.092633:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785271.092635:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785271.092636:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785271.298653:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785271.618805:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789785271.618826:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549124864:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789785271.618906:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785271.619188:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549124736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789785271.619222:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785271.619275:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789785271.619282:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549124608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789785271.619308:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785271.619367:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549124864 00000100:00100000:0.0:1789785271.619375:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549124864 00000100:00100000:0.0:1789785271.619416:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549124736 00000100:00100000:0.0:1789785271.619420:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549124736 00000100:00100000:0.0:1789785271.619435:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789785271.619444:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549124864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789785271.619465:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1789785271.619508:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549124864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785271.619514:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789785271.619530:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789785271.619537:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1876725549124736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789785271.619546:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1789785271.619587:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1876725549124736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785271.619593:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789785271.619610:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549124608 00000100:00100000:0.0:1789785271.619614:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549124608 00000100:00100000:0.0:1789785271.619637:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789785271.619643:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549124608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789785271.619664:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789785271.619691:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549124608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785271.619696:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789785271.619741:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549124608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789785271.619754:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549124736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789785271.619786:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549124864:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789785272.331436:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789785273.227906:0:14772:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789785273.227916:0:14772:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789785273.227950:0:14772:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789785273.227957:0:14772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789785273.300474:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785273.300592:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530192512 00000100:00100000:3.0:1789785273.300602:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530192512 00000100:00080000:1.0:1789785273.300776:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789785273.300818:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 202 00000100:00100000:3.0:1789785273.300831:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+23:12397:x1876725530192512:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789785273.300856:0:7896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785273.300875:0:7896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cfda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8911 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.300994:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cfe1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.301008:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cfe1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.301021:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cfe1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785273.301031:0:7896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789785273.301150:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845cfda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8911 expref: 26 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.301167:0:7896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cfe1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8911 expref: 25 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.301175:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:3.0:1789785273.301178:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789785273.301181:0:7896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bb600, rc 0) 00000100:00100000:3.0:1789785273.301247:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+25:12397:x1876725530192512:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 419us (781us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789785273.301254:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 202 00000100:00100000:1.0:1789785273.313296:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785273.313496:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530192640 00000100:00100000:2.0:1789785273.313508:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530192640 00000100:00100000:2.0:1789785273.313647:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 203 00000100:00100000:2.0:1789785273.313658:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+25:12397:x1876725530192640:12345-192.168.203.46@tcp:34:lfs.0 00010000:00010000:2.0:1789785273.313832:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cfef lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.313861:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cfef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.313872:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cfef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.313890:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cff6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.313897:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cff6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.313904:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cff6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.313985:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845cffd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.313994:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845cffd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.314001:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845cffd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789785273.314051:0:11254:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845cffd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.314064:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cfef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.314069:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cfef lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.314088:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cfef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.314164:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785273.314170:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cfef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.314178:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cfef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.314190:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:2.0:1789785273.314193:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785273.314197:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cfef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.314204:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845cfef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.314213:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cff6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.314219:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cff6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.314225:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cff6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.314230:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785273.314232:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cff6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.314248:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cff6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.314256:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dae827bdb00) 00010000:00010000:2.0:1789785273.314258:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785273.314261:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cff6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.314267:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845cff6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.314281:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845cffd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.314287:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845cffd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.314293:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845cffd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.314297:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785273.314300:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845cffd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.314305:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845cffd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.314311:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dae827bde00) 00010000:00010000:2.0:1789785273.314314:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785273.314317:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845cffd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.314331:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845cffd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785273.314864:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+25:12397:x1876725530192640:12345-192.168.203.46@tcp:34:lfs.0 Request processed in 1011us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785273.314876:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 203 00010000:00010000:1.0:1789785273.348388:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785273.378054:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785273.378091:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530192896 00000100:00100000:3.0:1789785273.378107:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530192896 00000100:00100000:3.0:1789785273.378161:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 204 00000100:00100000:3.0:1789785273.379765:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+25:12400:x1876725530192896:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789785273.379792:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785273.379813:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845d004 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8918 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.379886:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d00b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.379900:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d00b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.379911:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d00b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.379926:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d012 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.379933:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.379939:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.380052:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d019 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.380061:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d019 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.380067:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d019 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785273.380086:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789785273.380164:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d00b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.382155:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d00b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.382166:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d00b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.382769:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bae00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785273.382775:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d00b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.382785:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d00b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.382801:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:3.0:1789785273.382804:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785273.382809:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d00b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.382815:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d00b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.382831:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.382838:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d012 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.382856:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d012 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.382861:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814baa00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785273.382864:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d012 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.382871:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d012 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.382880:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9daf94af3800) 00010000:00010000:3.0:1789785273.382882:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785273.382885:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d012 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.382891:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d012 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.382954:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845d004 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8918 expref: 28 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.382970:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d019 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8918 expref: 27 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.382978:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9daf94af3f00) 00010000:00010000:3.0:1789785273.382980:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789785273.382983:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814ba600, rc 0) 00000100:00100000:3.0:1789785273.383049:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+27:12400:x1876725530192896:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 4879us (5003us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789785273.383067:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 204 00000100:00100000:3.0:1789785273.390453:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785273.390487:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530193024 00000100:00100000:3.0:1789785273.390496:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530193024 00000100:00100000:3.0:1789785273.390556:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 205 00000100:00100000:3.0:1789785273.390568:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+27:12400:x1876725530193024:12345-192.168.203.46@tcp:54:lfs.0 00010000:00010000:3.0:1789785273.390633:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845d027 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.390649:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845d027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.390661:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845d027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.392333:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845d027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.392363:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845d027 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.392371:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845d027 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.392377:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bba00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785273.392382:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845d027 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.392390:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845d027 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.392420:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9daf94af3f00) 00010000:00010000:3.0:1789785273.392423:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789785273.392428:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845d027 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.392435:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845d027 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785273.392517:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+27:12400:x1876725530193024:12345-192.168.203.46@tcp:54:lfs.0 Request processed in 1948us (2071us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785273.392525:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 205 00000100:00100000:1.0:1789785273.409245:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785273.409283:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530193280 00000100:00100000:1.0:1789785273.409292:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530193280 00000100:00100000:1.0:1789785273.409358:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 51 00000100:00100000:1.0:1789785273.409368:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+27:12400:x1876725530193280:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:1.0:1789785273.409595:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+28:12400:x1876725530193280:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 228us (358us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1789785273.409603:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 51 00000100:00100000:3.0:1789785273.492558:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785273.493013:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530193536 00000100:00100000:0.0:1789785273.493023:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530193536 00000100:00100000:0.0:1789785273.493087:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 206 00000100:00100000:0.0:1789785273.493098:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+28:11924:x1876725530193536:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:0.0:1789785273.493121:0:11254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785273.493140:0:11254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845d02e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd891f expref: -99 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.493249:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d035 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.493274:0:11254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d019 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8918 expref: 29 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.493282:0:11254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d035 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.493313:0:11254:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d019 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8918 expref: 29 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.493326:0:11254:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d019 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8918 expref: 29 pid: 6534 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785273.494993:0:11254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84527100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11254:1876725549124992:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789785273.495126:0:11254:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb448e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789785273.497646:0:11254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84527100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11254:1876725549124992:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789785273.498907:0:11254:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d035 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785273.499506:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785273.499617:0:7484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530193664 00000100:00100000:0.0:1789785273.499625:0:7484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530193664 00010000:00010000:0.0:1789785273.499658:0:7484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d019 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8918 expref: 30 pid: 6534 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785273.499794:0:7484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 93 00000100:00100000:0.0:1789785273.499805:0:7484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84785180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+30:2398:x1876725530193664:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789785273.499820:0:7484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785273.499827:0:7484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d019 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8918 expref: 30 pid: 6534 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.499840:0:7484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d019 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8918 expref: 30 pid: 6534 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.499861:0:7484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d019 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8918 expref: 30 pid: 6534 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.499877:0:7484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9daf94af3f00) 00010000:00010000:0.0:1789785273.499882:0:7484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d035 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.499891:0:7484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d035 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.499914:0:7484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d035 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.499949:0:7484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785273.500000:0:7484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84785180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+29:2398:x1876725530193664:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 196us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785273.500008:0:7484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 93 00010000:00010000:3.0:1789785273.500219:0:11254:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d035 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.500228:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d035 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785273.500246:0:11254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789785273.500400:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845d02e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd891f expref: 30 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.500416:0:11254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d035 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd891f expref: 29 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.500424:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9daf94af3f00) 00010000:00010000:3.0:1789785273.500426:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789785273.500435:0:11254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eada00, rc 0) 00000100:00100000:3.0:1789785273.500462:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+29:11924:x1876725530193536:12345-192.168.203.46@tcp:101:bash.0 Request processed in 7367us (7924us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1789785273.500470:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 206 00000100:00100000:3.0:1789785273.506435:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785273.506566:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530193792 00000100:00100000:2.0:1789785273.506576:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530193792 00000100:00100000:2.0:1789785273.506633:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 207 00000100:00100000:2.0:1789785273.506642:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+29:11924:x1876725530193792:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:2.0:1789785273.506664:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785273.506788:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845d043 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8926 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.506823:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845d04a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.506837:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845d04a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.506849:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845d04a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.507083:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845d043 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8926 expref: 31 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.507100:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845d04a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8926 expref: 30 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.507108:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9daf94af3f00) 00010000:00010000:2.0:1789785273.507111:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789785273.507122:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d55200, rc 0) 00000100:00100000:2.0:1789785273.507266:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+30:11924:x1876725530193792:12345-192.168.203.46@tcp:101:bash.0 Request processed in 624us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785273.507274:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 207 00000100:00100000:1.0:1789785273.514047:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785273.514127:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530194048 00000100:00100000:2.0:1789785273.514137:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530194048 00000100:00100000:2.0:1789785273.514199:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 208 00000100:00100000:2.0:1789785273.514210:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+30:11924:x1876725530194048:12345-192.168.203.46@tcp:36:bash.0 00010000:00010000:2.0:1789785273.514478:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845d051 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.514495:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845d051 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.514506:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845d051 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789785273.514556:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:2.0:1789785273.514581:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d47afb17 reply state 00000000f26a269f transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845d051 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.514594:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845d051 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.514602:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9daf94af3f00) 00010000:00010000:2.0:1789785273.514605:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789785273.514607:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789785273.514641:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:2.0:1789785273.515146:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+34:11924:x1876725530194048:12345-192.168.203.46@tcp:36:bash.0 Request processed in 936us (1104us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1789785273.515154:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 208 00000020:00080000:2.0:1789785273.515180:0:6535:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789785273.520813:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785273.520960:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530194176 00000100:00100000:3.0:1789785273.520970:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530194176 00000100:00100000:3.0:1789785273.521037:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 209 00000100:00100000:3.0:1789785273.521048:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+34:11924:x1876725530194176:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:3.0:1789785273.521072:0:11254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785273.521091:0:11254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845d058 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd892d expref: -99 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.521150:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845d058 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd892d expref: 35 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.521165:0:11254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845d058 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd892d expref: 35 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.521185:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9daf94af3f00) 00010000:00010000:3.0:1789785273.521188:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789785273.521192:0:11254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bba00, rc 0) 00000100:00100000:3.0:1789785273.521558:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+35:11924:x1876725530194176:12345-192.168.203.46@tcp:101:bash.0 Request processed in 511us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785273.521566:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 209 00000100:00100000:0.0:1789785273.526518:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785273.526886:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530194304 00000100:00100000:3.0:1789785273.526898:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530194304 00000100:00100000:3.0:1789785273.526981:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 67 00000100:00100000:3.0:1789785273.527008:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+7:11924:x1876725530194304:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:3.0:1789785273.527037:0:8805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785273.527058:0:8805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0dcb455/0x2f18ee3fd845d05f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8934 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789785273.527089:0:8805:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aadf4b4, atime: 0x6aadf4b2, ctime: 0x6aadf4b4, blocks: 0x8 00010000:00010000:3.0:1789785273.527116:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=381s v=(0 0) 00010000:00010000:3.0:1789785273.527121:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785273.527130:0:8805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0dcb455/0x2f18ee3fd845d05f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8934 expref: 8 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.527148:0:8805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b0dcb455/0x2f18ee3fd845d05f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8934 expref: 8 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.527161:0:8805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bbe00, rc 0) 00000100:00100000:3.0:1789785273.527240:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+8:11924:x1876725530194304:12345-192.168.203.46@tcp:101:bash.0 Request processed in 234us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785273.527248:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 67 00000100:00080000:1.0:1789785273.527848:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789785273.537481:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785273.537590:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530194432 00000100:00100000:0.0:1789785273.537599:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530194432 00002000:00010000:0.0:1789785273.537642:0:8455:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1789785273.537647:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dae847d4380 with x1876725530194432 ext(0->18446744073709551615) 00002000:00010000:0.0:1789785273.537660:0:8455:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dae847d4380. 00000100:00100000:0.0:1789785273.537695:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00100000:0.0:1789785273.537705:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:026b2112-ee35-499c-8d01-18663664f08e+8:2398:x1876725530194432:12345-192.168.203.46@tcp:10:bash.0 00002000:00010000:0.0:1789785273.538130:0:8455:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789785273.538133:0:8455:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789785268 -> 1789785272 00002000:00010000:0.0:1789785273.538136:0:8455:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1789785266 -> 1789785266 00002000:00010000:0.0:1789785273.538138:0:8455:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789785268 -> 1789785272 00002000:00010000:0.0:1789785273.538140:0:8455:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1789785273.538206:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:026b2112-ee35-499c-8d01-18663664f08e+9:2398:x1876725530194432:12345-192.168.203.46@tcp:10:bash.0 Request processed in 501us (874us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789785273.538215:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 6 00002000:00010000:0.0:1789785273.538219:0:8455:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1789785273.538221:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dae847d4380 with x1876725530194432 ext(0->18446744073709551615) 00002000:00010000:0.0:1789785273.538226:0:8455:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dae847d4380. 00000100:00100000:0.0:1789785273.653452:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785273.656206:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530194560 00000100:00100000:2.0:1789785273.656222:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530194560 00000100:00100000:3.0:1789785273.656660:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 210 00000100:00100000:3.0:1789785273.656671:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+35:12414:x1876725530194560:12345-192.168.203.46@tcp:34:lfs.0 00010000:00010000:3.0:1789785273.656736:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d066 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.656765:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d066 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.656776:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d066 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.656813:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d06d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.656821:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d06d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.656827:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d06d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.657066:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845d074 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.657077:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845d074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.657084:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845d074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789785273.657129:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845d074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.657141:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d066 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.657148:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d066 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.657155:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d066 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.657161:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814baa00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785273.657165:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d066 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.657179:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d066 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.657191:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:3.0:1789785273.657194:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785273.657198:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d066 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.657204:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d066 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.657216:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d06d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.657222:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d06d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.657239:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d06d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.657245:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bae00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785273.657247:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d06d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.657253:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d06d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.657259:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9daf94af3300) 00010000:00010000:3.0:1789785273.657268:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785273.657272:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d06d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.657287:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d06d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.657303:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845d074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.657309:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845d074 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.657315:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845d074 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.657320:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bb200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785273.657323:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845d074 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.657329:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845d074 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.657381:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9daf94af3f00) 00010000:00010000:3.0:1789785273.657383:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785273.657386:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845d074 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.657392:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb200/0x2f18ee3fd845d074 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785273.657472:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+35:12414:x1876725530194560:12345-192.168.203.46@tcp:34:lfs.0 Request processed in 801us (4027us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785273.657480:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 210 00000001:00080000:3.0:1789785273.669735:0:9529:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1789785273.669756:0:9529:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:3.0:1789785273.712404:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785273.712677:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530194816 00000100:00100000:0.0:1789785273.712687:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530194816 00000100:00100000:0.0:1789785273.712748:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 211 00000100:00100000:0.0:1789785273.712759:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+35:12417:x1876725530194816:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:0.0:1789785273.712779:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785273.712800:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d07b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd893b expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.712875:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d082 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.712891:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d082 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.712903:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d082 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.712919:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d089 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.712925:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d089 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.712932:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d089 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.713036:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845d090 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.713781:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845d090 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.713806:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845d090 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785273.713819:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789785273.713904:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d082 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.713913:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d082 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.713919:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d082 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.713924:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eace00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785273.713929:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d082 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.713936:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d082 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.713949:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:0.0:1789785273.713952:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785273.713957:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d082 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.713963:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d082 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.713975:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d089 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.713981:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d089 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.713994:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d089 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.714000:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eac400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785273.714003:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d089 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.714010:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d089 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.714018:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dae8266f000) 00010000:00010000:0.0:1789785273.714021:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785273.714024:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d089 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.714030:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d089 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.714086:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d07b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd893b expref: 38 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.714101:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845d090 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd893b expref: 37 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.714109:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9daf94af3f00) 00010000:00010000:0.0:1789785273.714111:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789785273.714113:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eacc00, rc 0) 00000100:00100000:0.0:1789785273.715324:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+37:12417:x1876725530194816:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 2560us (2931us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1789785273.715362:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 211 00000100:00100000:1.0:1789785273.731800:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785273.733453:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530194944 00000100:00100000:0.0:1789785273.733467:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530194944 00000100:00100000:0.0:1789785273.733702:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 212 00000100:00100000:0.0:1789785273.733715:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+37:12417:x1876725530194944:12345-192.168.203.46@tcp:54:lfs.0 00010000:00010000:0.0:1789785273.733793:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d09e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.733812:0:7896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d035 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd891f expref: 37 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.733822:0:7896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d09e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.733859:0:7896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d035 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd891f expref: 37 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.733874:0:7896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d035 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd891f expref: 37 pid: 11254 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785273.733889:0:7896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84527b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7896:1876725549125120:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789785273.734003:0:7896:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb448300 going to sleep for 11 seconds 00000100:00100000:1.0:1789785273.737559:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785273.738478:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530195200 00000100:00100000:2.0:1789785273.738488:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530195200 00000100:00100000:2.0:1789785273.738560:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 52 00000100:00100000:2.0:1789785273.738571:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+38:6167:x1876725530195200:12345-192.168.203.46@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789785273.738855:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+39:6167:x1876725530195200:12345-192.168.203.46@tcp:35:ldlm_bl.0 Request processed in 284us (1312us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1789785273.738863:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 52 00000100:00100000:0.0:1789785273.740477:0:7896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84527b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7896:1876725549125120:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789785273.740505:0:7896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d09e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785273.745611:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785273.745841:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530195328 00000100:00100000:0.0:1789785273.745865:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530195328 00010000:00010000:0.0:1789785273.745904:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d035 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd891f expref: 39 pid: 11254 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785273.745953:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 94 00000100:00100000:0.0:1789785273.745964:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:026b2112-ee35-499c-8d01-18663664f08e+39:2398:x1876725530195328:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789785273.745978:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785273.745985:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d035 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd891f expref: 39 pid: 11254 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.745998:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d035 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd891f expref: 39 pid: 11254 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.746020:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d035 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd891f expref: 39 pid: 11254 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.746036:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9daf94af3f00) 00010000:00010000:0.0:1789785273.746041:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d09e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.746051:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d09e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.746058:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d09e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.746090:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785273.746140:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:026b2112-ee35-499c-8d01-18663664f08e+38:2398:x1876725530195328:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 178us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785273.746157:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 94 00010000:00010000:3.0:1789785273.747446:0:7896:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d09e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.747460:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d09e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.747499:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d09e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.747507:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d09e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.747514:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d09e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.747529:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81ead400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785273.747534:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d09e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.747549:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d09e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.747564:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9daf94af3f00) 00010000:00010000:3.0:1789785273.747567:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789785273.747572:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d09e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.747578:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d09e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785273.747669:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+37:12417:x1876725530194944:12345-192.168.203.46@tcp:54:lfs.0 Request processed in 13954us (15874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785273.747679:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 212 00000100:00100000:1.0:1789785273.752610:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785273.752754:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530195584 00000100:00100000:2.0:1789785273.752763:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530195584 00000100:00100000:2.0:1789785273.752816:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 53 00000100:00100000:2.0:1789785273.752826:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+37:12417:x1876725530195584:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:2.0:1789785273.753050:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+38:12417:x1876725530195584:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 225us (449us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1789785273.753058:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 53 00000100:00100000:1.0:1789785273.840630:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785273.840748:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785273.845172:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785273.845208:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785273.845238:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785273.845352:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530195712 00000100:00100000:0.0:1789785273.845361:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530195712 00000100:00100000:0.0:1789785273.845419:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 392 00000100:00100000:0.0:1789785273.845430:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2400:x1876725530195712:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785273.845501:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2400:x1876725530195712:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 72us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785273.845509:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 392 00000100:00100000:0.0:1789785273.845554:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530195968 00000100:00100000:0.0:1789785273.845557:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530195968 00000100:00100000:0.0:1789785273.845596:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 140 00000100:00100000:0.0:1789785273.845604:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530195968:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785273.845631:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530195968:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 28us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785273.845637:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 140 00000100:00080000:0.0:1789785273.845773:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789785273.847680:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530195840 00000100:00100000:2.0:1789785273.847695:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530195840 00000100:00100000:2.0:1789785273.847847:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530196096 00000100:00100000:2.0:1789785273.847851:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530196096 00000100:00080000:0.0:1789785273.847920:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789785273.847924:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789785273.847933:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530196224 00000100:00100000:0.0:1789785273.847937:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530196224 00000100:00080000:1.0:1789785273.847957:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789785273.847973:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 339 00000100:00100000:1.0:1789785273.847980:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 340 00000100:00100000:0.0:1789785273.847986:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530195840:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785273.847987:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2400:x1876725530196224:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785273.848050:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+5:2400:x1876725530195840:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 69us (7432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785273.848059:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 339 00000100:00100000:2.0:1789785273.850016:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 341 00000100:00100000:2.0:1789785273.850030:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2400:x1876725530196096:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785273.851597:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2400:x1876725530196096:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 1562us (10841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785273.851610:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 341 00000100:00100000:1.0:1789785273.851643:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2400:x1876725530196224:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 3655us (6402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785273.851651:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 340 00000100:00100000:3.0:1789785273.852791:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785273.852867:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530196480 00000100:00100000:0.0:1789785273.852877:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530196480 00000100:00100000:0.0:1789785273.853280:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 213 00000100:00100000:0.0:1789785273.853293:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+38:12428:x1876725530196480:12345-192.168.203.46@tcp:101:cat.0 00010000:00010000:0.0:1789785273.853319:0:11254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785273.853361:0:11254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d0a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8942 expref: -99 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.853433:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d0ac lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.853592:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d0ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.853605:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d0ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.853622:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d0b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.853629:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.853636:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.853740:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d0ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.853749:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d0ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.853775:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d0ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785273.853786:0:11254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1789785273.853861:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d0ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.853869:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d0ac lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.853876:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d0ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.853882:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eace00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785273.853886:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d0ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.853894:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d0ac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.853907:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:0.0:1789785273.853910:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785273.853915:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d0ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.853921:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d0ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.853945:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.853952:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d0b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.853964:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d0b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.853970:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eada00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785273.853973:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d0b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.853979:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d0b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.853988:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dae8266f000) 00010000:00010000:0.0:1789785273.853990:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785273.853993:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d0b3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.853998:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d0b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.854105:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d0a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8942 expref: 41 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.854181:0:11254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d0ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8942 expref: 40 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785273.854190:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9daf94af3f00) 00010000:00010000:0.0:1789785273.854192:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789785273.854195:0:11254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81ead400, rc 0) 00000100:00100000:0.0:1789785273.854315:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+40:12428:x1876725530196480:12345-192.168.203.46@tcp:101:cat.0 Request processed in 972us (1474us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1789785273.854331:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 213 00000100:00100000:0.0:1789785273.861459:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785273.862075:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530196736 00000100:00100000:2.0:1789785273.862156:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530196736 00000100:00100000:2.0:1789785273.862258:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 54 00000100:00100000:2.0:1789785273.862270:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+40:12428:x1876725530196736:12345-192.168.203.46@tcp:35:cat.0 00000100:00100000:2.0:1789785273.862602:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+41:12428:x1876725530196736:12345-192.168.203.46@tcp:35:cat.0 Request processed in 333us (1150us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1789785273.862610:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 54 00000100:00100000:1.0:1789785273.884853:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785273.885115:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530196992 00000100:00100000:2.0:1789785273.885124:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530196992 00000100:00100000:2.0:1789785273.885188:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 214 00000100:00100000:2.0:1789785273.885200:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+41:12429:x1876725530196992:12345-192.168.203.46@tcp:36:rm.0 00010000:00010000:2.0:1789785273.885266:0:6535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1789785273.885292:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bba00/0x2f18ee3fd845d058 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd892d expref: 41 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.885314:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d0ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8942 expref: 40 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.885326:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845d090 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd893b expref: 39 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.885357:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845d04a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8926 expref: 38 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.885368:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9daf94af3f00) 00010000:00010000:2.0:1789785273.885372:0:6535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789785273.885393:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55000/0x2f18ee3fd845d0c8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.885422:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55000/0x2f18ee3fd845d0c8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.885432:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55000/0x2f18ee3fd845d0c8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.885462:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845d0cf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.885469:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845d0cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.885474:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845d0cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.885555:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845d0d6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.885563:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845d0d6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.885570:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845d0d6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789785273.885795:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1789785273.885805:0:6535:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 382139466084ns, next at 383139463508ns, rc = 0 00010000:00010000:2.0:1789785273.885848:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845d0dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.885856:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845d0dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.885875:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845d0dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.885883:0:6535:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845d0dd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.885890:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845d0dd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.885897:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845d0dd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.885928:0:6535:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789785273.885947:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845d0d6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.885953:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845d0d6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.885958:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845d0d6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785273.885962:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789785273.885963:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785273.885967:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845d0d6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785273.885969:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845d0dd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.885975:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845d0d6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785273.885975:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54c00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785273.885978:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845d0dd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.885983:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9daf94af3f00) 00010000:00010000:2.0:1789785273.885985:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789785273.885993:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845d0dd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.885994:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845d0d6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.886000:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845d0d6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785273.886010:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9daf94af3f00) 00010000:00010000:1.0:1789785273.886012:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789785273.886014:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55000/0x2f18ee3fd845d0c8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785273.886020:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845d0dd lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.886021:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55000/0x2f18ee3fd845d0c8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.886027:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55000/0x2f18ee3fd845d0c8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785273.886027:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845d0dd lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.886032:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785273.886035:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55000/0x2f18ee3fd845d0c8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.886040:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55000/0x2f18ee3fd845d0c8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785273.886045:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785273.886047:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:1.0:1789785273.886047:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785273.886049:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785273.886050:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785273.886052:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55000/0x2f18ee3fd845d0c8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.886058:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55000/0x2f18ee3fd845d0c8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789785273.886066:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ea786dc reply state 000000006830f5ac transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845d0cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.886087:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845d0cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.886093:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dae827bde00) 00010000:00010000:2.0:1789785273.886095:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789785273.886098:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789785273.886169:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+39:12429:x1876725530196992:12345-192.168.203.46@tcp:36:rm.0 Request processed in 971us (1326us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1789785273.886177:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 214 00000100:00100000:3.0:1789785273.960667:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785273.960824:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530197248 00000100:00100000:1.0:1789785273.960833:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530197248 00000100:00100000:1.0:1789785273.960892:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 215 00000100:00100000:1.0:1789785273.960902:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+39:12435:x1876725530197248:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:1.0:1789785273.960937:0:7896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785273.960959:0:7896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d0e4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8949 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785273.961076:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845d0eb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785273.961092:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845d0eb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785273.961103:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845d0eb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785273.961122:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845d0f2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785273.961130:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845d0f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785273.961155:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845d0f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789785273.961513:0:7896:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1789785273.961648:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d0f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785273.961659:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785273.961667:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785273.961695:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845d0eb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785273.961702:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845d0eb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785273.961709:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845d0eb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785273.961715:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a64600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785273.961719:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845d0eb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785273.961728:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845d0eb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785273.961740:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:1.0:1789785273.961743:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785273.961755:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845d0eb lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785273.961762:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845d0eb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789785273.961777:0:7896:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7fca2e1 reply state 000000008b1b4124 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845d0f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785273.961788:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845d0f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785273.961794:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dae827bde00) 00010000:00010000:1.0:1789785273.961797:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789785273.961799:0:7896:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789785273.961825:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d0e4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8949 expref: 42 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785273.961839:0:7896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d0f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8949 expref: 41 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785273.961847:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827c3100) 00010000:00010000:1.0:1789785273.961849:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789785273.961851:0:7896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a65000, rc 0) 00000100:00100000:1.0:1789785273.961907:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+42:12435:x1876725530197248:12345-192.168.203.46@tcp:101:bash.0 Request processed in 1007us (1251us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1789785273.961915:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 215 00000100:00100000:1.0:1789785273.973438:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785273.973618:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530197376 00000100:00100000:3.0:1789785273.973629:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530197376 00000100:00100000:3.0:1789785273.973688:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 68 00000100:00100000:3.0:1789785273.973697:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530197376:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:3.0:1789785273.973714:0:8805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785273.973732:0:8805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007bf02b96/0x2f18ee3fd845d107 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8950 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789785273.973757:0:8805:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789785273.973776:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=382s v=(0 0) 00010000:00010000:3.0:1789785273.973781:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785273.973790:0:8805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bf02b96/0x2f18ee3fd845d107 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8950 expref: 6 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.973808:0:8805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007bf02b96/0x2f18ee3fd845d107 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8950 expref: 6 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785273.973823:0:8805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bb200, rc 0) 00000100:00100000:3.0:1789785273.973924:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+6:2397:x1876725530197376:12345-192.168.203.46@tcp:101:bash.0 Request processed in 227us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785273.973946:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 68 00000100:00100000:0.0:1789785273.984925:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785273.986113:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530197504 00000100:00100000:2.0:1789785273.986126:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530197504 00000100:00100000:2.0:1789785273.986188:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 69 00000100:00100000:2.0:1789785273.986200:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae8393df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+6:12435:x1876725530197504:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:2.0:1789785273.986218:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785273.986236:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d10e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8957 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.986482:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007bf02b96/0x2f18ee3fd845d107 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8950 expref: 7 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.986492:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785273.986497:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785273.986502:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d10e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8957 expref: 7 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.986538:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007bf02b96/0x2f18ee3fd845d107 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8950 expref: 7 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785273.986575:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007bf02b96/0x2f18ee3fd845d107 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8950 expref: 7 pid: 8805 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785273.986589:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84601880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8450:1876725549125248:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789785273.986688:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf92353180 going to sleep for 11 seconds 00000100:00100000:0.0:1789785273.999796:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785274.000458:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530197632 00000100:00100000:3.0:1789785274.000468:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530197632 00010000:00010000:3.0:1789785274.000510:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007bf02b96/0x2f18ee3fd845d107 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8950 expref: 8 pid: 8805 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785274.000558:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 95 00000100:00100000:3.0:1789785274.000568:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+8:2398:x1876725530197632:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789785274.000601:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785274.000624:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007bf02b96/0x2f18ee3fd845d107 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8950 expref: 8 pid: 8805 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.000638:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007bf02b96/0x2f18ee3fd845d107 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8950 expref: 8 pid: 8805 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.000661:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785274.000665:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785274.000673:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d10e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8957 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.000682:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d10e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8957 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.000713:0:6518:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d10e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8957 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785274.000738:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84785500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6518:1876725549125376:192.168.203.46@tcp:105: 00000100:00100000:3.0:1789785274.000814:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb409e40 going to sleep for 11 seconds 00010000:00010000:2.0:1789785274.003037:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bf02b96/0x2f18ee3fd845d107 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8950 expref: 8 pid: 8805 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785274.003062:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84601880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8450:1876725549125248:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789785274.003400:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d10e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8957 expref: 7 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.003418:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d55000, rc 0) 00000100:00100000:2.0:1789785274.003945:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae8393df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+7:12435:x1876725530197504:12345-192.168.203.46@tcp:101:bash.0 Request processed in 17744us (19027us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785274.003954:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 69 00000100:00100000:3.0:1789785274.008110:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84785500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6518:1876725549125376:192.168.203.46@tcp:105: 00010000:00010000:3.0:1789785274.008136:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785274.008479:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+6:2398:x1876725530197632:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 7910us (8690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785274.008490:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 95 00000100:00100000:0.0:1789785274.008722:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785274.014065:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530197888 00000100:00100000:3.0:1789785274.014081:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530197888 00000100:00100000:3.0:1789785274.014274:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 55 00000100:00100000:3.0:1789785274.014286:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+42:12435:x1876725530197888:12345-192.168.203.46@tcp:35:bash.0 00000100:00100000:3.0:1789785274.014610:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+43:12435:x1876725530197888:12345-192.168.203.46@tcp:35:bash.0 Request processed in 325us (5888us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1789785274.014619:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 55 00000040:00080000:1.0:1789785274.178565:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789785274.178574:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789785274.178609:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789785274.178617:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789785274.179485:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789785274.201902:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785274.204581:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530198016 00000100:00100000:3.0:1789785274.204595:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530198016 00000100:00100000:3.0:1789785274.204672:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 216 00000100:00100000:3.0:1789785274.204684:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+43:12451:x1876725530198016:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789785274.204707:0:11254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785274.204727:0:11254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d115 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd895e expref: -99 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.204789:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d11c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.204821:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d11c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.204833:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d11c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785274.204873:0:11254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789785274.204876:0:11254:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789785274.204894:0:11254:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d11c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.204917:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d115 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd895e expref: 45 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.204937:0:11254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d11c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd895e expref: 44 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.204945:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:3.0:1789785274.204948:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789785274.204951:0:11254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814baa00, rc 0) 00000100:00100000:3.0:1789785274.205020:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+44:12451:x1876725530198016:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 338us (3125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785274.205028:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 216 00000100:00100000:1.0:1789785274.211307:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785274.211399:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530198272 00000100:00100000:2.0:1789785274.211409:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530198272 00000100:00100000:2.0:1789785274.211464:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 217 00000100:00100000:2.0:1789785274.211474:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+44:12451:x1876725530198272:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:2.0:1789785274.211493:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785274.211510:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845d123 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8965 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.211646:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845d12a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.211659:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845d12a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.211670:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845d12a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789785274.211679:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789785274.211776:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55c00/0x2f18ee3fd845d123 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8965 expref: 47 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.211793:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845d12a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8965 expref: 46 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.211802:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827c3100) 00010000:00010000:2.0:1789785274.211804:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789785274.211808:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d55200, rc 0) 00000100:00100000:2.0:1789785274.211867:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+46:12451:x1876725530198272:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 395us (576us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1789785274.211874:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 217 00000100:00100000:1.0:1789785274.216718:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785274.216765:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785274.216852:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530198656 00000100:00100000:0.0:1789785274.216863:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530198656 00000100:00100000:0.0:1789785274.216936:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:0.0:1789785274.216947:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:026b2112-ee35-499c-8d01-18663664f08e+46:2397:x1876725530198656:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789785274.216961:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785274.216983:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55200/0x2f18ee3fd845d12a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8965 expref: 46 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.217002:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827c3100) 00010000:00010000:0.0:1789785274.217007:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785274.217061:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:026b2112-ee35-499c-8d01-18663664f08e+45:2397:x1876725530198656:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 116us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785274.217069:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:3.0:1789785274.217688:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530198528 00000100:00100000:3.0:1789785274.217695:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530198528 00000100:00100000:3.0:1789785274.217732:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 218 00000100:00100000:3.0:1789785274.217741:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+45:12451:x1876725530198528:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789785274.217761:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785274.217795:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d138 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd896c expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.217905:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845d13f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.217918:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845d13f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.217928:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845d13f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785274.217939:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789785274.218038:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d138 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd896c expref: 48 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.218053:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845d13f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd896c expref: 47 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.218061:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827c3100) 00010000:00010000:3.0:1789785274.218063:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789785274.218066:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814ba200, rc 0) 00000100:00100000:3.0:1789785274.218123:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+47:12451:x1876725530198528:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 383us (1415us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1789785274.218130:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 218 00000100:00100000:1.0:1789785274.226683:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785274.226773:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530198784 00000100:00100000:2.0:1789785274.226783:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530198784 00000100:00100000:2.0:1789785274.226840:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 70 00000100:00100000:2.0:1789785274.226851:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+6:2398:x1876725530198784:12345-192.168.203.46@tcp:1:lfs.0 00010000:00010000:2.0:1789785274.226898:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064be49cb/0x2f18ee3fd845d14d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.226962:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d10e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8957 expref: 6 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.226971:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785274.226975:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789785274.226979:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064be49cb/0x2f18ee3fd845d14d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.227016:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d10e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8957 expref: 6 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.227031:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d10e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8957 expref: 6 pid: 8450 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785274.227045:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84601880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8449:1876725549125504:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789785274.227151:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf92353c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789785274.231066:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785274.231201:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530198912 00000100:00100000:3.0:1789785274.231211:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530198912 00002000:00100000:3.0:1789785274.231270:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9dafbf445500 x1876725530198912/t0(0) o4->026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp:405/0 lens 504/0 e 0 to 0 dl 1789785285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789785274.231282:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dafbf445500 with x1876725530198912 ext(0->8) 00010000:00010000:3.0:1789785274.231316:0:8457:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d10e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8957 expref: 7 pid: 8450 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.231332:0:8457:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d10e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8957 expref: 7 pid: 8450 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789785274.231374:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9dafbf445500 00000100:00100000:3.0:1789785274.231400:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 3 00000100:00100000:3.0:1789785274.231410:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf445500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:026b2112-ee35-499c-8d01-18663664f08e+7:2398:x1876725530198912:12345-192.168.203.46@tcp:4:lfs.0 00000100:00100000:2.0:1789785274.232534:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84601880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8449:1876725549125504:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789785274.232570:0:8449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000064be49cb/0x2f18ee3fd845d14d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785274.233071:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf445500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:026b2112-ee35-499c-8d01-18663664f08e+9:2398:x1876725530198912:12345-192.168.203.46@tcp:4:lfs.0 Request processed in 1660us (2012us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789785274.233081:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 3 00002000:00100000:3.0:1789785274.233100:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9dafbf445500 x1876725530198912/t4294967309(0) o4->026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp:405/0 lens 504/448 e 0 to 0 dl 1789785285 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789785274.233172:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dafbf445500 with x1876725530198912 ext(0->8) 00010000:00010000:3.0:1789785274.233182:0:8457:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d10e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8957 expref: 9 pid: 8450 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.233195:0:8457:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d10e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8957 expref: 9 pid: 8450 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789785274.233202:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9dafbf445500 00000100:00100000:1.0:1789785274.236474:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785274.237029:0:7484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530199040 00000100:00100000:0.0:1789785274.237039:0:7484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530199040 00010000:00010000:0.0:1789785274.237078:0:7484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d10e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8957 expref: 9 pid: 8450 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785274.237289:0:7484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 96 00000100:00100000:0.0:1789785274.237308:0:7484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+9:2397:x1876725530199040:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789785274.237362:0:7484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789785274.237381:0:7484:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789785274.237383:0:7484:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789785272 00002000:00010000:0.0:1789785274.237386:0:7484:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789785273 00002000:00010000:0.0:1789785274.237388:0:7484:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789785272 00002000:00010000:0.0:1789785274.237390:0:7484:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789785274.237396:0:7484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d10e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8957 expref: 9 pid: 8450 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.237410:0:7484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d10e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8957 expref: 9 pid: 8450 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.237431:0:7484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d10e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8957 expref: 9 pid: 8450 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.237457:0:7484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789785274.237462:0:7484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789785274.237467:0:7484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000064be49cb/0x2f18ee3fd845d14d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.237477:0:7484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064be49cb/0x2f18ee3fd845d14d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.237512:0:7484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785274.237574:0:7484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+8:2397:x1876725530199040:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 276us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785274.237581:0:7484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 96 00010000:00010000:3.0:1789785274.237649:0:8449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000064be49cb/0x2f18ee3fd845d14d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.237659:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064be49cb/0x2f18ee3fd845d14d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.237685:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064be49cb/0x2f18ee3fd845d14d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.237692:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064be49cb/0x2f18ee3fd845d14d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.237700:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064be49cb/0x2f18ee3fd845d14d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.237706:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55c00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:3.0:1789785274.237710:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064be49cb/0x2f18ee3fd845d14d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.237718:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064be49cb/0x2f18ee3fd845d14d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.237730:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064be49cb/0x2f18ee3fd845d14d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.237736:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064be49cb/0x2f18ee3fd845d14d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785274.237781:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+7:2398:x1876725530198784:12345-192.168.203.46@tcp:1:lfs.0 Request processed in 10931us (11108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785274.237788:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 70 00000100:00100000:1.0:1789785274.241280:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785274.241415:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530199296 00000100:00100000:3.0:1789785274.241425:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530199296 00000100:00100000:3.0:1789785274.241489:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 56 00000100:00100000:3.0:1789785274.241498:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf88772c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+47:12451:x1876725530199296:12345-192.168.203.46@tcp:35:lfs.0 00000004:00010000:3.0:1789785274.241568:0:6537:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845d13f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd896c expref: 47 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789785274.241727:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1789785274.241750:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1789785274.242020:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:3.0:1789785274.242057:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d154 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.242071:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d0f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8949 expref: 51 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.242079:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d154 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.242182:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d0f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8949 expref: 51 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.242196:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d0f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8949 expref: 51 pid: 7896 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785274.242211:0:6537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84785180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6537:1876725549125632:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789785274.242281:0:6537:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb4093c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789785274.245692:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785274.245749:0:6537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84785180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6537:1876725549125632:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785274.245788:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d154 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785274.246678:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530199424 00000100:00100000:2.0:1789785274.246687:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530199424 00010000:00010000:2.0:1789785274.246721:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d0f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8949 expref: 52 pid: 7896 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785274.246774:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 97 00000100:00100000:2.0:1789785274.246783:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+52:2398:x1876725530199424:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789785274.246797:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785274.246803:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d0f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8949 expref: 52 pid: 7896 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.246814:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d0f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8949 expref: 52 pid: 7896 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.246836:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d0f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8949 expref: 52 pid: 7896 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.246850:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827c3100) 00010000:00010000:2.0:1789785274.246855:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d154 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.246864:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d154 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.246871:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d154 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.246890:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785274.246938:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+51:2398:x1876725530199424:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 146us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785274.246945:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 97 00010000:00010000:2.0:1789785274.246966:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d154 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.246978:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d154 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789785274.247079:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1789785274.247204:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1789785274.247296:0:6537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84601880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1876725549125760:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789785274.247369:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785274.247394:0:6537:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf85440900 going to sleep for 11 seconds 00000100:00100000:1.0:1789785274.249041:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549125760 00000100:00100000:1.0:1789785274.249052:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549125760 00000100:00100000:1.0:1789785274.249131:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789785274.249141:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6537:x1876725549125760:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789785274.249246:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6537:x1876725549125760:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 105us (1875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785274.249253:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789785274.249552:0:6537:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:2.0:1789785274.249558:0:6537:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:2.0:1789785274.249580:0:6537:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dae83b59180, transno 4294967308 00000100:00100000:2.0:1789785274.249593:0:6537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84601880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1876725549125760:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789785274.249793:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1789785274.249847:0:6537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84601880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1876725549125888:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789785274.249881:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785274.249908:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549125888 00000100:00100000:2.0:1789785274.249912:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549125888 00000100:00080000:1.0:1789785274.249983:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789785274.250503:0:6537:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf92353b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789785274.250673:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789785274.250684:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6537:x1876725549125888:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789785274.250809:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6537:x1876725549125888:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 128us (926us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789785274.250816:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789785274.250875:0:6537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84601880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1876725549125888:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789785274.250921:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:0.0:1789785274.250966:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d154 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.250975:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d154 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.250982:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d154 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.250988:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bae00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785274.250992:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d154 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.250998:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d154 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.251013:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827c3100) 00010000:00010000:0.0:1789785274.251016:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789785274.251020:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d154 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.251026:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d154 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789785274.251130:0:6537:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789785274.251183:0:6537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1789785274.251193:0:6537:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382504854575ns, next at 383504852344ns, rc = 0 00000001:00080000:0.0:1789785274.251199:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:0.0:1789785274.251236:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827c3100) 00010000:00010000:0.0:1789785274.251240:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789785274.251246:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845d13f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd896c expref: 55 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785274.251767:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf88772c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+54:12451:x1876725530199296:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 10268us (10493us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1789785274.251776:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 56 00000020:00080000:0.0:1789785274.251781:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789785274.255618:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785274.255708:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530199552 00000100:00100000:2.0:1789785274.255717:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530199552 00000100:00100000:2.0:1789785274.255770:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 219 00000100:00100000:2.0:1789785274.255780:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+54:12451:x1876725530199552:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:2.0:1789785274.255811:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785274.255831:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54400/0x2f18ee3fd845d15b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8973 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.255882:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54400/0x2f18ee3fd845d15b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8973 expref: 55 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.255907:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54400/0x2f18ee3fd845d15b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8973 expref: 55 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.255926:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:2.0:1789785274.255935:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789785274.255940:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d54400, rc 0) 00000100:00100000:2.0:1789785274.256178:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+55:12451:x1876725530199552:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 398us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785274.256186:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 219 00000100:00100000:0.0:1789785274.260715:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785274.260810:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530199808 00000100:00100000:1.0:1789785274.260820:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530199808 00000100:00100000:1.0:1789785274.260903:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 57 00000100:00100000:1.0:1789785274.260914:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+55:12451:x1876725530199808:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:1.0:1789785274.261183:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+56:12451:x1876725530199808:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 269us (477us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1789785274.261190:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 57 00010000:00010000:3.0:1789785274.370713:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785274.382904:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785274.383125:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530199936 00000100:00100000:1.0:1789785274.383135:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530199936 00000100:00100000:1.0:1789785274.383197:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 220 00000100:00100000:1.0:1789785274.383207:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+56:12461:x1876725530199936:12345-192.168.203.46@tcp:34:lfs.0 00010000:00010000:1.0:1789785274.383475:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d162 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383491:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d162 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383503:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d162 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383515:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d169 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383522:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383528:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383609:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845d170 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383618:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845d170 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383624:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845d170 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789785274.383668:0:7896:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845d170 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383695:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d162 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383701:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d162 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383708:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d162 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383715:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785274.383718:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d162 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383725:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d162 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383799:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:1.0:1789785274.383803:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785274.383807:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d162 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383813:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d162 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383826:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383832:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d169 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383837:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d169 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383854:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785274.383857:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d169 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383863:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d169 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383870:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dae827bde00) 00010000:00010000:1.0:1789785274.383873:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785274.383876:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d169 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383882:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d169 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383890:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845d170 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383895:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845d170 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383901:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845d170 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383906:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a64600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785274.383908:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845d170 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.383915:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845d170 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.384046:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:1.0:1789785274.384049:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785274.384052:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845d170 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.384058:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64600/0x2f18ee3fd845d170 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785274.384255:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+56:12461:x1876725530199936:12345-192.168.203.46@tcp:34:lfs.0 Request processed in 1048us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785274.384273:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 220 00000100:00100000:2.0:1789785274.489843:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785274.491394:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530200192 00000100:00100000:0.0:1789785274.491406:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530200192 00000100:00100000:0.0:1789785274.491475:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 221 00000100:00100000:0.0:1789785274.491486:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+56:12464:x1876725530200192:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:0.0:1789785274.491505:0:11254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785274.491525:0:11254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845d177 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd897a expref: -99 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.491627:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d17e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.491640:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d17e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.491652:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d17e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.491662:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845d185 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.491685:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845d185 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.491692:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845d185 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.491795:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d18c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.491804:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d18c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.491811:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d18c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785274.491821:0:11254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789785274.491892:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d17e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.491899:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d17e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.491905:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d17e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.491910:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81ead400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785274.491914:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d17e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.491921:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d17e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.491942:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:0.0:1789785274.491944:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785274.491948:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d17e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.491954:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d17e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.491965:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845d185 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.491970:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845d185 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.491975:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845d185 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.491979:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eac800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785274.491982:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845d185 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.491987:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845d185 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.491994:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dae827bde00) 00010000:00010000:0.0:1789785274.491996:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785274.491999:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845d185 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.492004:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845d185 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.492057:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845d177 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd897a expref: 59 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.492070:0:11254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d18c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd897a expref: 58 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.492078:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:0.0:1789785274.492080:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789785274.492082:0:11254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eac400, rc 0) 00000100:00100000:0.0:1789785274.492454:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+58:12464:x1876725530200192:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 967us (3729us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1789785274.492462:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 221 00000100:00100000:1.0:1789785274.511029:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785274.511288:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530200320 00000100:00100000:2.0:1789785274.511307:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530200320 00000100:00100000:2.0:1789785274.511399:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 222 00000100:00100000:2.0:1789785274.511411:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+58:12464:x1876725530200320:12345-192.168.203.46@tcp:54:lfs.0 00010000:00010000:2.0:1789785274.511475:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845d19a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.511491:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845d19a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.511520:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845d19a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.511566:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845d19a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.511574:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845d19a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.511580:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845d19a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.511586:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785274.511590:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845d19a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.511598:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845d19a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.511610:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:2.0:1789785274.511613:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789785274.511617:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845d19a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.511624:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54c00/0x2f18ee3fd845d19a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785274.511699:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+58:12464:x1876725530200320:12345-192.168.203.46@tcp:54:lfs.0 Request processed in 291us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785274.511708:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 222 00000100:00100000:2.0:1789785274.516858:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785274.517060:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530200576 00000100:00100000:0.0:1789785274.517070:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530200576 00000100:00100000:0.0:1789785274.517130:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 58 00000100:00100000:0.0:1789785274.517142:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+58:12464:x1876725530200576:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:0.0:1789785274.517386:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+59:12464:x1876725530200576:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 245us (537us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1789785274.517393:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 58 00000100:00100000:1.0:1789785274.646678:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785274.646762:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530200832 00000100:00100000:3.0:1789785274.646772:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530200832 00000100:00100000:3.0:1789785274.646830:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 223 00000100:00100000:3.0:1789785274.646840:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf858bf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+59:12474:x1876725530200832:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:3.0:1789785274.646862:0:7896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785274.646864:0:7896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789785274.646888:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d11c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd895e expref: 59 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.646906:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:3.0:1789785274.646911:0:7896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789785274.646923:0:7896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845d1a1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8981 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.647022:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845d1a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.647035:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845d1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.647044:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845d1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785274.647055:0:7896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789785274.647152:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845d1a1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8981 expref: 61 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.647184:0:7896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845d1a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8981 expref: 60 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.647191:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:3.0:1789785274.647194:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789785274.647197:0:7896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814ba400, rc 0) 00000100:00100000:3.0:1789785274.647267:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf858bf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+60:12474:x1876725530200832:12345-192.168.203.46@tcp:101:bash.0 Request processed in 428us (598us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1789785274.647274:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 223 00000100:00100000:2.0:1789785274.653293:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785274.653963:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530200960 00000100:00100000:0.0:1789785274.653973:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530200960 00000100:00100000:0.0:1789785274.654081:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 224 00000100:00100000:0.0:1789785274.654092:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+60:12474:x1876725530200960:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:0.0:1789785274.654128:0:11254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785274.654410:0:11254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845d1b6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8988 expref: -99 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.654461:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845d1bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.654476:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845d1bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.654487:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845d1bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.654603:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845d1b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8988 expref: 62 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.654620:0:11254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845d1bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8988 expref: 61 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.654629:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:0.0:1789785274.654632:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789785274.654636:0:11254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eac800, rc 0) 00000100:00100000:0.0:1789785274.654698:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+61:12474:x1876725530200960:12345-192.168.203.46@tcp:101:bash.0 Request processed in 608us (1414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785274.654706:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 224 00000100:00100000:3.0:1789785274.655254:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785274.655394:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530201088 00000100:00100000:3.0:1789785274.655399:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530201088 00000100:00100000:3.0:1789785274.655557:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:3.0:1789785274.655568:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84784a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+61:2398:x1876725530201088:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789785274.655580:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785274.655597:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845d1a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8981 expref: 61 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.655610:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:3.0:1789785274.655614:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785274.655649:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84784a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+60:2398:x1876725530201088:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 84us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785274.655657:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:3.0:1789785274.660208:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785274.660741:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530201344 00000100:00100000:0.0:1789785274.660751:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530201344 00000100:00100000:0.0:1789785274.660810:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 225 00000100:00100000:0.0:1789785274.660822:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+60:12474:x1876725530201344:12345-192.168.203.46@tcp:36:bash.0 00010000:00010000:0.0:1789785274.660872:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785274.660898:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d18c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd897a expref: 60 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.660930:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:0.0:1789785274.660935:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789785274.661095:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d1c4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.661109:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d1c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.661119:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d1c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789785274.661159:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1789785274.661189:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000821cd3d0 reply state 000000006c285d24 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d1c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.661201:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d1c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.661207:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:0.0:1789785274.661211:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789785274.661213:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789785274.661877:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+62:12474:x1876725530201344:12345-192.168.203.46@tcp:36:bash.0 Request processed in 1054us (1674us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1789785274.661884:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 225 00000020:00080000:0.0:1789785274.661889:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789785274.664575:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785274.664686:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530201472 00000100:00100000:0.0:1789785274.664695:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530201472 00000100:00100000:0.0:1789785274.664760:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 226 00000100:00100000:0.0:1789785274.664771:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+62:12474:x1876725530201472:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:0.0:1789785274.664807:0:7896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785274.664826:0:7896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d1cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd898f expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.664911:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d1d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.664925:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d1d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.664935:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d1d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785274.664963:0:7896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789785274.664967:0:7896:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789785274.664986:0:7896:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d1d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.665013:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d1cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd898f expref: 64 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.665029:0:7896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d1d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd898f expref: 63 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.665037:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:0.0:1789785274.665040:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789785274.665043:0:7896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eace00, rc 0) 00000100:00100000:0.0:1789785274.665100:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+63:12474:x1876725530201472:12345-192.168.203.46@tcp:101:bash.0 Request processed in 331us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785274.665108:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 226 00000100:00100000:3.0:1789785274.669446:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785274.669559:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530201728 00000100:00100000:1.0:1789785274.669569:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530201728 00000100:00100000:1.0:1789785274.669625:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 59 00000100:00100000:1.0:1789785274.669637:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+63:12474:x1876725530201728:12345-192.168.203.46@tcp:35:bash.0 00000100:00100000:1.0:1789785274.669857:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+64:12474:x1876725530201728:12345-192.168.203.46@tcp:35:bash.0 Request processed in 222us (418us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1789785274.669866:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 59 00000100:00100000:3.0:1789785274.760635:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785274.761153:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530201856 00000100:00100000:0.0:1789785274.761164:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530201856 00000100:00100000:0.0:1789785274.761226:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 227 00000100:00100000:0.0:1789785274.761237:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+64:12480:x1876725530201856:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:0.0:1789785274.761260:0:11254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785274.761280:0:11254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d1d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8996 expref: -99 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.761369:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d1e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.761384:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.761397:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785274.761860:0:11254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789785274.761865:0:11254:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789785274.761889:0:11254:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.761972:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d1d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8996 expref: 66 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.761991:0:11254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d1e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8996 expref: 65 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.762000:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:0.0:1789785274.762003:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789785274.763225:0:11254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eac400, rc 0) 00000100:00100000:0.0:1789785274.763306:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+65:12480:x1876725530201856:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 2069us (2677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785274.763314:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 227 00000100:00100000:2.0:1789785274.770768:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785274.770909:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530201984 00000100:00100000:0.0:1789785274.770919:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530201984 00000100:00100000:0.0:1789785274.770977:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 228 00000100:00100000:0.0:1789785274.770988:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+65:12480:x1876725530201984:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:0.0:1789785274.771008:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785274.771028:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d1e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd899d expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771090:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845d1ee lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771117:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845d1ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771128:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845d1ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771327:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d1f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771364:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771372:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771441:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d1fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771463:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d1fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771471:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d1fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785274.771729:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789785274.771734:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789785274.771753:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d1fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771765:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d1fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771773:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845d1ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771780:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845d1ee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771787:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845d1ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771793:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eacc00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785274.771797:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845d1ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771805:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845d1ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771817:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:0.0:1789785274.771820:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785274.771832:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845d1ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771839:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eacc00/0x2f18ee3fd845d1ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771851:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771857:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d1f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771863:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d1f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771867:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf80030c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785274.771870:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d1f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771876:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d1f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771884:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dae827bde00) 00010000:00010000:0.0:1789785274.771886:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785274.771890:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d1f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771895:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d1f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771921:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d1e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd899d expref: 67 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771946:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d1fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd899d expref: 66 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.771954:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:0.0:1789785274.771956:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789785274.771959:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf80030600, rc 0) 00000100:00100000:0.0:1789785274.772062:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+66:12480:x1876725530201984:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 1075us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785274.772070:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 228 00000100:00100000:2.0:1789785274.790874:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785274.790969:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530202240 00000100:00100000:0.0:1789785274.790979:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530202240 00000100:00100000:0.0:1789785274.791039:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 229 00000100:00100000:0.0:1789785274.791050:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+66:12480:x1876725530202240:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:0.0:1789785274.791070:0:7896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785274.791089:0:7896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d203 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd89a4 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.791204:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d20a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.791219:0:7896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d1d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd898f expref: 67 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.791238:0:7896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d1fc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd899d expref: 67 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.791402:0:7896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d20a lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.791438:0:7896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d1fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd899d expref: 67 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.791452:0:7896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d1fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd899d expref: 67 pid: 6533 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785274.791465:0:7896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84604a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7896:1876725549126016:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789785274.791627:0:7896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d1d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd898f expref: 67 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.791637:0:7896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d1d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd898f expref: 67 pid: 7896 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785274.791645:0:7896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84605f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7896:1876725549126144:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789785274.791748:0:7896:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb448e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789785274.792767:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785274.793412:0:7484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530202368 00000100:00100000:0.0:1789785274.793421:0:7484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530202368 00010000:00010000:0.0:1789785274.793458:0:7484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d1fc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd899d expref: 68 pid: 6533 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785274.793605:0:7484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 98 00000100:00100000:0.0:1789785274.793617:0:7484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84787480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+68:2398:x1876725530202368:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789785274.793644:0:7484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785274.793659:0:7484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d1fc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd899d expref: 68 pid: 6533 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.793672:0:7484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d1fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd899d expref: 68 pid: 6533 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.793691:0:7484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:0.0:1789785274.793696:0:7484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d20a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.793704:0:7484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d20a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.793711:0:7484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785274.793761:0:7484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84787480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+68:2398:x1876725530202368:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 146us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785274.793768:0:7484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 98 00000100:00100000:2.0:1789785274.801079:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785274.801176:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530202496 00000100:00100000:1.0:1789785274.801185:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530202496 00010000:00010000:1.0:1789785274.801364:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d1d2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd898f expref: 68 pid: 7896 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785274.801407:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 99 00000100:00100000:1.0:1789785274.801431:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84601180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+68:2397:x1876725530202496:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789785274.801445:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785274.801452:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d1d2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd898f expref: 68 pid: 7896 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.801466:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d1d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd898f expref: 68 pid: 7896 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.801558:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:1.0:1789785274.801565:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d20a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.801575:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d20a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.801582:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d20a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785274.801601:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785274.801725:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84601180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+68:2397:x1876725530202496:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 294us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785274.801732:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 99 00010000:00010000:3.0:1789785274.802380:0:7896:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.46@tcp) returned -22 from blocking AST (req@000000004829acf6 x1876725549126016) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d1fc lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd899d expref: 67 pid: 6533 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.802396:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d1fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd899d expref: 67 pid: 6533 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785274.802410:0:7896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84604a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7896:1876725549126016:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785274.802426:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eace00/0x2f18ee3fd845d1d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd898f expref: 66 pid: 7896 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785274.802435:0:7896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84605f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7896:1876725549126144:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785274.802458:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:3.0:1789785274.802464:0:7896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d20a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.802472:0:7896:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d20a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.802477:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d20a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785274.802620:0:7896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789785274.803411:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d203 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89a4 expref: 67 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.803431:0:7896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d20a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89a4 expref: 66 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785274.803439:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:2.0:1789785274.803442:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789785274.803445:0:7896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf80030800, rc 0) 00000100:00100000:2.0:1789785274.803757:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+66:12480:x1876725530202240:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 12707us (12890us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789785274.803767:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 229 00000100:00100000:2.0:1789785274.821794:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785274.821985:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530202752 00000100:00100000:3.0:1789785274.821996:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530202752 00000100:00100000:3.0:1789785274.822065:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 18 00000100:00100000:3.0:1789785274.822077:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:026b2112-ee35-499c-8d01-18663664f08e+66:12480:x1876725530202752:12345-192.168.203.46@tcp:103:lfs.0 00010000:00010000:3.0:1789785274.822122:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785274.822161:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54400/0x2f18ee3fd845d15b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8973 expref: 66 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785274.822184:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:3.0:1789785274.822189:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785274.822250:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:026b2112-ee35-499c-8d01-18663664f08e+65:12480:x1876725530202752:12345-192.168.203.46@tcp:103:lfs.0 Request processed in 175us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785274.822258:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 18 00000100:00100000:3.0:1789785274.830027:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785274.830207:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530202880 00000100:00100000:0.0:1789785274.830217:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530202880 00000100:00100000:0.0:1789785274.830293:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 230 00000100:00100000:0.0:1789785274.830304:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+65:12480:x1876725530202880:12345-192.168.203.46@tcp:58:lfs.0 00010000:00010000:0.0:1789785274.830736:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845d218 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.830754:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845d218 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.830766:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845d218 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789785274.831024:0:11254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1789785274.831118:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+65:12480:x1876725530202880:12345-192.168.203.46@tcp:58:lfs.0 Request processed in 814us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785274.831127:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 230 00000100:00100000:2.0:1789785274.835029:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785274.835577:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530203008 00000100:00100000:0.0:1789785274.835588:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530203008 00000100:00100000:0.0:1789785274.835658:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 231 00000100:00100000:0.0:1789785274.835669:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+65:12480:x1876725530203008:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:0.0:1789785274.835688:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785274.835708:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845d21f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd89ab expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.835874:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845d218 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.835885:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845d21f lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89ab expref: 66 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.836019:0:6533:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845d218 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.836034:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845d21f lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89ab expref: 66 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.836047:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:0.0:1789785274.836050:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789785274.836054:0:6533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845d21f lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89ab expref: 66 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785274.836061:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf80030e00, rc 0) 00000100:00100000:0.0:1789785274.836167:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+66:12480:x1876725530203008:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 499us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785274.836187:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 231 00000100:00100000:2.0:1789785275.203015:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549126400:0@lo:400:kworker.0 00000100:00100000:2.0:1789785275.203093:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785275.203147:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549126912:0@lo:400:kworker.0 00000100:00100000:2.0:1789785275.203170:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785275.203191:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549127424:0@lo:400:kworker.0 00000100:00100000:2.0:1789785275.203213:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785275.203234:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789785275.203239:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549126528:0@lo:400:kworker.0 00000100:00100000:3.0:1789785275.203378:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549126272:0@lo:400:kworker.0 00000100:00100000:3.0:1789785275.203414:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785275.203437:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549126784:0@lo:400:kworker.0 00000100:00100000:3.0:1789785275.203462:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785275.203480:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549127296:0@lo:400:kworker.0 00000100:00100000:3.0:1789785275.203503:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785275.203519:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549127808:0@lo:400:kworker.0 00000100:00100000:3.0:1789785275.203556:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785275.203576:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789785275.203582:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725549126656:0@lo:400:kworker.0 00000100:00100000:3.0:1789785275.203601:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785275.203614:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549127168:0@lo:400:kworker.0 00000100:00100000:3.0:1789785275.203632:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785275.203659:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549127680:0@lo:400:kworker.0 00000100:00100000:3.0:1789785275.203693:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785275.203726:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549126784 00000100:00100000:3.0:1789785275.203733:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549126784 00000100:00100000:3.0:1789785275.203775:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789785275.203784:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549126784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785275.203834:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549126784:12345-0@lo:400:kworker.0 Request processed in 51us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785275.203841:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789785275.203877:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549126784:0@lo:400:kworker.0 00000100:00100000:3.0:1789785275.203901:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549127296 00000100:00100000:3.0:1789785275.203904:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549127296 00000100:00100000:3.0:1789785275.203932:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549127808 00000100:00100000:3.0:1789785275.203935:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549127808 00000100:00100000:3.0:1789785275.203945:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549127168 00000100:00100000:3.0:1789785275.203948:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549127168 00000100:00100000:3.0:1789785275.203959:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549127680 00000100:00100000:3.0:1789785275.203961:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549127680 00000100:00100000:3.0:1789785275.203976:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789785275.203982:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84784e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3662:x1876725549127296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785275.204017:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84784e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3662:x1876725549127296:12345-0@lo:400:kworker.0 Request processed in 35us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785275.204024:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789785275.204035:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789785275.204053:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3662:x1876725549127808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785275.204077:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3662:x1876725549127808:12345-0@lo:400:kworker.0 Request processed in 26us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785275.204083:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789785275.204101:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789785275.204106:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84786680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549127168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785275.204132:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84786680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549127168:12345-0@lo:400:kworker.0 Request processed in 26us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785275.204137:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789785275.204148:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789785275.204154:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84787100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549127680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785275.204177:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84787100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549127680:12345-0@lo:400:kworker.0 Request processed in 24us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785275.204183:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:3.0:1789785275.204198:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789785275.204203:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789785275.204219:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549127168:0@lo:400:kworker.0 00000100:00100000:3.0:1789785275.204228:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549127680:0@lo:400:kworker.0 00000100:00100000:3.0:1789785275.204236:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549127296:0@lo:400:kworker.0 00000100:00100000:3.0:1789785275.204244:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549127808:0@lo:400:kworker.0 00000100:00100000:1.0:1789785275.204469:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549126400 00000100:00100000:1.0:1789785275.204473:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549126400 00000100:00100000:1.0:1789785275.204505:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549126912 00000100:00100000:1.0:1789785275.204515:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549126912 00000100:00080000:1.0:1789785275.204530:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789785275.204563:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549127424 00000100:00100000:1.0:1789785275.204566:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549127424 00000100:00080000:1.0:1789785275.204579:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789785275.204591:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549126656 00000100:00100000:1.0:1789785275.204594:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549126656 00000100:00100000:1.0:1789785275.204607:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789785275.204613:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549126400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785275.204670:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549126400:12345-0@lo:400:kworker.0 Request processed in 57us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785275.204676:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789785275.204689:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1789785275.204694:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549126912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785275.204718:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549126912:12345-0@lo:400:kworker.0 Request processed in 24us (1547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785275.204723:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1789785275.204738:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1789785275.204744:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549127424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785275.204771:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549127424:12345-0@lo:400:kworker.0 Request processed in 25us (1555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785275.204775:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1789785275.204786:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1789785275.204791:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725549126656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785275.204813:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725549126656:12345-0@lo:400:kworker.0 Request processed in 22us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785275.204818:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1789785275.204869:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549126272 00000100:00100000:1.0:1789785275.204873:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549126272 00000100:00100000:1.0:1789785275.204894:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1789785275.204900:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac8a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:3662:x1876725549126272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785275.204930:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac8a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:3662:x1876725549126272:12345-0@lo:400:kworker.0 Request processed in 29us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785275.204936:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1789785275.205168:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785275.205198:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549127040:0@lo:400:kworker.0 00000100:00100000:2.0:1789785275.205220:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785275.205237:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1876725549127552:0@lo:400:kworker.0 00000100:00100000:3.0:1789785275.205459:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725549126656:0@lo:400:kworker.0 00000100:00100000:3.0:1789785275.205470:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549126272:0@lo:400:kworker.0 00000100:00100000:3.0:1789785275.205497:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549127040 00000100:00100000:3.0:1789785275.205501:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549127040 00000100:00080000:3.0:1789785275.205519:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789785275.205552:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1789785275.205559:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549127040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785275.205591:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549127040:12345-0@lo:400:kworker.0 Request processed in 34us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785275.205604:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1789785275.205685:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785275.205720:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549126400:0@lo:400:kworker.0 00000100:00100000:2.0:1789785275.205731:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549126912:0@lo:400:kworker.0 00000100:00100000:2.0:1789785275.205741:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549127424:0@lo:400:kworker.0 00000100:00100000:2.0:1789785275.205757:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549127936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789785275.205781:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789785275.205803:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae84601180 x1876725549127040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785275.205813:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549127040:0@lo:400:kworker.0 00000100:00100000:0.0:1789785275.206019:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549128064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789785275.206058:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785275.206089:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549128064 00000100:00100000:0.0:1789785275.206092:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549128064 00000100:00100000:0.0:1789785275.206118:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789785275.206125:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549128064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789785275.206140:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785275.206175:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549128064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785275.206181:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789785275.206217:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549128064:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1789785275.206319:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789785275.206323:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789785275.206365:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1789785275.206371:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789785275.206465:0:13813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84605180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1876725549128192:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789785275.206520:0:13813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb448e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789785275.206544:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549127552 00000100:00100000:0.0:1789785275.206547:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549127552 00000100:00080000:0.0:1789785275.206564:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789785275.206586:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789785275.206593:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876725549127552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785275.206626:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876725549127552:12345-0@lo:400:kworker.0 Request processed in 34us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785275.206643:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789785275.208412:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549126528 00000100:00100000:1.0:1789785275.208423:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549126528 00000100:00100000:1.0:1789785275.208476:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549127936 00000100:00100000:1.0:1789785275.208480:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549127936 00000100:00100000:1.0:1789785275.208498:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789785275.208506:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549126528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785275.208591:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549126528:12345-0@lo:400:kworker.0 Request processed in 85us (3422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785275.208598:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789785275.208614:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789785275.208619:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549127936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789785275.208640:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789785275.208682:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549127936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (2901us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785275.208688:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789785275.209457:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549127936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789785275.209472:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549126528:0@lo:400:kworker.0 00010000:00080000:2.0:1789785275.209488:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83b5b480 x1876725549127552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785275.209498:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1876725549127552:0@lo:400:kworker.0 00000100:00100000:1.0:1789785275.211882:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789785275.211905:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549128320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789785275.211974:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785275.214186:0:13813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84605180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1876725549128192:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789785275.214363:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549128320 00000100:00100000:2.0:1789785275.214371:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549128320 00000100:00100000:2.0:1789785275.214432:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789785275.214441:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1876725549128320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789785275.214476:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785275.214558:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1876725549128320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (2584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785275.214566:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789785275.215258:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549128320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789785275.231466:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785275.234684:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530203136 00000100:00100000:3.0:1789785275.234699:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530203136 00000100:00100000:3.0:1789785275.234821:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 232 00000100:00100000:3.0:1789785275.234833:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+66:12481:x1876725530203136:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789785275.234863:0:6535:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789785275.234986:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+66:12481:x1876725530203136:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 Request processed in 155us (3530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785275.234995:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 232 00000100:00080000:0.0:1789785275.238697:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789785275.243706:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785275.243903:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530203264 00000100:00100000:0.0:1789785275.243913:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530203264 00000100:00100000:0.0:1789785275.243979:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 233 00000100:00100000:0.0:1789785275.243991:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+66:12481:x1876725530203264:12345-192.168.203.46@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789785275.244067:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d226 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244084:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d226 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244095:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d226 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244138:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d22d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244146:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d22d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244152:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d22d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244177:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d234 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244185:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d234 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244192:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d234 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785275.244256:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789785275.244261:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789785275.244274:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d234 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244285:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d226 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244291:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d226 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244298:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d226 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244305:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf80030a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785275.244309:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d226 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244316:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d226 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244329:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9daf87d6e700) 00010000:00010000:0.0:1789785275.244332:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785275.244381:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d226 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244388:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d226 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244401:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d22d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244418:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d22d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244423:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d22d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244428:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf80030c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785275.244431:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d22d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244438:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d22d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244446:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9dae8266f000) 00010000:00010000:0.0:1789785275.244449:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785275.244452:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d22d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244458:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d22d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244472:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d234 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244489:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d234 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244495:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d234 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244500:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf80030600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785275.244510:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d234 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244516:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d234 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244525:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:0.0:1789785275.244528:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785275.244541:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d234 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.244548:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d234 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785275.244616:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+66:12481:x1876725530203264:12345-192.168.203.46@tcp:34:lhsmtool_posix.0 Request processed in 626us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785275.244624:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 233 00000100:00100000:2.0:1789785275.248488:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785275.248635:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530203520 00000100:00100000:3.0:1789785275.248654:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530203520 00000100:00100000:3.0:1789785275.248747:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 234 00000100:00100000:3.0:1789785275.248761:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+66:12481:x1876725530203520:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789785275.248791:0:7896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785275.248819:0:7896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845d23b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd89b2 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.248976:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845d242 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.248996:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845d242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.249010:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845d242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785275.249023:0:7896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789785275.249140:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845d242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.249149:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845d242 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.249157:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845d242 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.249163:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bb000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785275.249168:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845d242 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.249176:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845d242 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.249191:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:3.0:1789785275.249195:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789785275.249201:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845d242 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.249208:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845d242 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.249280:0:7896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845d23b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89b2 expref: 68 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.249292:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9daf87d6e700) 00010000:00010000:3.0:1789785275.249294:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789785275.249298:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845d23b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89b2 expref: 68 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.249320:0:7896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814ba400, rc 0) 00000100:00100000:3.0:1789785275.249460:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+67:12481:x1876725530203520:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 702us (990us total) trans 4294967505 rc 301/301 00000100:00100000:3.0:1789785275.249471:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 234 00000100:00100000:2.0:1789785275.254465:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785275.254747:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530203648 00000100:00100000:1.0:1789785275.254761:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530203648 00000100:00100000:1.0:1789785275.254834:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 235 00000100:00100000:1.0:1789785275.254844:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+67:12481:x1876725530203648:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789785275.254888:0:11254:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789785275.256471:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+67:12481:x1876725530203648:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 Request processed in 1619us (2023us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785275.256492:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 235 00000100:00100000:1.0:1789785275.272647:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785275.278911:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530203904 00000100:00100000:0.0:1789785275.278927:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530203904 00000100:00100000:0.0:1789785275.278990:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 236 00000100:00100000:0.0:1789785275.279012:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+67:12481:x1876725530203904:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789785275.279032:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785275.279035:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789785275.279064:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d1e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8996 expref: 67 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.279083:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:0.0:1789785275.279088:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789785275.279100:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d250 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd89b9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789785275.280224:0:6534:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:0.0:1789785275.280706:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d257 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.280722:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d257 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.280732:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d257 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.280789:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d250 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89b9 expref: 69 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.280806:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d257 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89b9 expref: 68 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.280814:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dae8266f000) 00010000:00010000:0.0:1789785275.280816:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789785275.280819:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf80030c00, rc 0) 00000100:00100000:0.0:1789785275.281732:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+68:12481:x1876725530203904:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 2726us (9089us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1789785275.281743:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 236 00000100:00100000:3.0:1789785275.288427:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785275.288737:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530204160 00000100:00100000:2.0:1789785275.288752:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530204160 00000100:00100000:2.0:1789785275.288841:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 237 00000100:00100000:2.0:1789785275.288854:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+68:12481:x1876725530204160:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789785275.288945:0:7896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785275.288987:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d257 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89b9 expref: 68 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.289014:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dae8266f000) 00010000:00010000:2.0:1789785275.289028:0:7896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789785275.289056:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845d265 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.289073:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845d265 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.289085:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845d265 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.289102:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845d26c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x87874b6d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.289127:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845d26c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x87874b6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.289134:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845d26c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x87874b6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.289194:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845d265 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.289203:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845d265 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.289209:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845d265 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.289228:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785275.289233:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845d265 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.289242:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845d265 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.289251:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:2.0:1789785275.289254:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785275.289259:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845d265 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.289265:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55e00/0x2f18ee3fd845d265 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.289274:0:7896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845d26c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x87874b6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.289286:0:7896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845d26c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x87874b6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.289293:0:7896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845d26c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x87874b6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.289298:0:7896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785275.289302:0:7896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845d26c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x87874b6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.289308:0:7896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845d26c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x87874b6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.289316:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x87874b6d (ffff9dae827bd300) 00010000:00010000:2.0:1789785275.289318:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785275.289321:0:7896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845d26c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x87874b6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.289327:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845d26c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x87874b6d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785275.289482:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+67:12481:x1876725530204160:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 629us (1070us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789785275.289491:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 237 00000100:00100000:2.0:1789785275.293019:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785275.293184:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530204288 00000100:00100000:1.0:1789785275.293198:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530204288 00000100:00100000:1.0:1789785275.293291:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 238 00000100:00100000:1.0:1789785275.293304:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+67:12481:x1876725530204288:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789785275.293333:0:11254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785275.293739:0:11254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845d273 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd89c0 expref: -99 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.293792:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845d27a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.293808:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845d27a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.293823:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845d27a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.293989:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845d273 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89c0 expref: 69 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.294029:0:11254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845d27a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89c0 expref: 68 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.294039:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dae827c3800) 00010000:00010000:1.0:1789785275.294042:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789785275.294046:0:11254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64000, rc 0) 00000100:00100000:1.0:1789785275.294134:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+68:12481:x1876725530204288:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 832us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785275.294143:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 238 00000100:00100000:3.0:1789785275.297570:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785275.297754:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530204544 00000100:00100000:0.0:1789785275.297766:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530204544 00000100:00100000:0.0:1789785275.297836:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 239 00000100:00100000:0.0:1789785275.297848:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+68:12481:x1876725530204544:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789785275.297967:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d281 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.298005:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d281 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.298020:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d281 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789785275.298237:0:6534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1789785275.298246:0:6534:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 383551906971ns, next at 384551904246ns, rc = 0 00000004:00010000:0.0:1789785275.298305:0:6534:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043cd16b2 reply state 00000000b8567fdb transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d281 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.298321:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d281 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.298329:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dae827c3800) 00010000:00010000:0.0:1789785275.298332:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789785275.298365:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789785275.298486:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+70:12481:x1876725530204544:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 639us (930us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789785275.298495:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 239 00000100:00100000:3.0:1789785275.304800:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785275.304927:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530204672 00000100:00100000:2.0:1789785275.304941:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530204672 00000100:00100000:2.0:1789785275.305018:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 240 00000100:00100000:2.0:1789785275.305031:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+70:12481:x1876725530204672:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789785275.305084:0:7896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785275.305112:0:7896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845d288 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd89c7 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.305189:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845d288 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89c7 expref: 71 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.305206:0:7896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845d288 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89c7 expref: 71 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.305230:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dae827c3800) 00010000:00010000:2.0:1789785275.305233:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789785275.305239:0:7896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d55400, rc 0) 00000100:00100000:2.0:1789785275.305320:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+71:12481:x1876725530204672:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 291us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785275.305328:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 240 00000100:00100000:3.0:1789785275.312825:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785275.313084:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530204800 00000100:00100000:0.0:1789785275.313098:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530204800 00000100:00100000:0.0:1789785275.313192:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 71 00000100:00100000:0.0:1789785275.313205:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+9:2397:x1876725530204800:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789785275.313586:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+10:2397:x1876725530204800:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 Request processed in 382us (774us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1789785275.313595:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 71 00000100:00080000:3.0:1789785275.313849:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789785275.318239:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785275.318402:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530205056 00000100:00100000:3.0:1789785275.318416:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530205056 00000100:00100000:3.0:1789785275.318490:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 60 00000100:00100000:3.0:1789785275.318512:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+71:12481:x1876725530205056:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789785275.318826:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+72:12481:x1876725530205056:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 324us (612us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1789785275.318834:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 60 00000100:00100000:2.0:1789785275.321492:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785275.321668:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530205312 00000100:00100000:1.0:1789785275.321681:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530205312 00000100:00100000:1.0:1789785275.321755:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 241 00000100:00100000:1.0:1789785275.321767:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+72:12481:x1876725530205312:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789785275.321931:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+72:12481:x1876725530205312:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 156us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785275.321940:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 241 00000100:00100000:2.0:1789785275.326007:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785275.326293:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530205440 00000100:00100000:0.0:1789785275.326326:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530205440 00000100:00100000:0.0:1789785275.326451:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 242 00000100:00100000:0.0:1789785275.326463:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+72:12481:x1876725530205440:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789785275.326508:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785275.326544:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d28f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd89ce expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.326648:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d296 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.326665:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d296 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.326679:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d296 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785275.326739:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789785275.326765:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d296 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.326798:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d28f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89ce expref: 74 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.326823:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d296 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89ce expref: 73 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.326834:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dae827c3800) 00010000:00010000:0.0:1789785275.326837:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789785275.326843:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf80030c00, rc 0) 00000100:00100000:0.0:1789785275.326941:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+73:12481:x1876725530205440:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 479us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785275.326958:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 242 00000100:00100000:3.0:1789785275.330969:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785275.331093:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530205568 00000100:00100000:2.0:1789785275.331106:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530205568 00000100:00100000:2.0:1789785275.331179:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 72 00000100:00100000:2.0:1789785275.331192:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+10:2398:x1876725530205568:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789785275.331216:0:8805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785275.331242:0:8805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d29d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd89d5 expref: -99 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789785275.331287:0:8805:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aadf4ba, blocks: 0x0 00010000:00010000:2.0:1789785275.331376:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=383s v=(0 0) 00010000:00010000:2.0:1789785275.331382:0:8805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785275.331395:0:8805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d29d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89d5 expref: 11 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.331420:0:8805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d29d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89d5 expref: 11 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.331437:0:8805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d55200, rc 0) 00000100:00100000:2.0:1789785275.331634:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+11:2398:x1876725530205568:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 315us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785275.331643:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 72 00000100:00100000:3.0:1789785275.335691:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785275.339766:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530205824 00000100:00100000:1.0:1789785275.339789:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530205824 00000100:00100000:0.0:1789785275.340049:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 243 00000100:00100000:0.0:1789785275.340063:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+73:12481:x1876725530205824:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789785275.340254:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+73:12481:x1876725530205824:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 185us (4570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785275.340264:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 243 00000100:00100000:3.0:1789785275.345268:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785275.345382:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530205952 00000100:00100000:0.0:1789785275.345394:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530205952 00000100:00100000:0.0:1789785275.345460:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 73 00000100:00100000:0.0:1789785275.345472:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84786300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+11:12481:x1876725530205952:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789785275.345650:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785275.345673:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047d5e0ca/0x2f18ee3fd845d2a4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd89dc expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.345819:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d29d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89d5 expref: 12 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.345831:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789785275.345836:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789785275.345842:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047d5e0ca/0x2f18ee3fd845d2a4 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89dc expref: 12 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.345882:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d29d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89d5 expref: 12 pid: 8805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.345920:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d29d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89d5 expref: 12 pid: 8805 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785275.345937:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84604380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8449:1876725549128448:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789785275.346089:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf85440e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789785275.352387:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785275.352676:0:7484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530206080 00000100:00100000:1.0:1789785275.352688:0:7484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530206080 00010000:00010000:1.0:1789785275.352742:0:7484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d29d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89d5 expref: 13 pid: 8805 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785275.352796:0:7484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 100 00000100:00100000:1.0:1789785275.352827:0:7484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84787b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+13:2397:x1876725530206080:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789785275.352849:0:7484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785275.352879:0:7484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d29d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89d5 expref: 13 pid: 8805 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.352896:0:7484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d29d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89d5 expref: 13 pid: 8805 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.352934:0:7484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789785275.352940:0:7484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789785275.352952:0:7484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000047d5e0ca/0x2f18ee3fd845d2a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89dc expref: 13 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.352964:0:7484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047d5e0ca/0x2f18ee3fd845d2a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89dc expref: 13 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.353012:0:7484:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000047d5e0ca/0x2f18ee3fd845d2a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89dc expref: 13 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785275.353030:0:7484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7484:1876725549128576:192.168.203.46@tcp:105: 00000100:00100000:1.0:1789785275.353137:0:7484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789785275.360052:0:7484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7484:1876725549128576:192.168.203.46@tcp:105: 00010000:00010000:1.0:1789785275.360088:0:7484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785275.360161:0:7484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84787b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:026b2112-ee35-499c-8d01-18663664f08e+13:2397:x1876725530206080:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 7336us (7834us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785275.360198:0:7484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 100 00010000:00010000:0.0:1789785275.363496:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d29d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89d5 expref: 12 pid: 8805 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785275.363543:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84604380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8449:1876725549128448:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789785275.363590:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000047d5e0ca/0x2f18ee3fd845d2a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89dc expref: 11 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.363609:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf80030600, rc 0) 00000100:00100000:0.0:1789785275.363703:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84786300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+11:12481:x1876725530205952:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 18233us (18460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785275.363713:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 73 00000100:00100000:0.0:1789785275.383763:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785275.384381:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530206208 00000100:00100000:3.0:1789785275.384395:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530206208 00002000:00100000:3.0:1789785275.384477:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9dae84604380 x1876725530206208/t0(0) o4->026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp:406/0 lens 504/0 e 0 to 0 dl 1789785286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789785275.384491:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dae84604380 with x1876725530206208 ext(0->12) 00002000:00010000:3.0:1789785275.384635:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dae84604380 00000100:00100000:3.0:1789785275.384677:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:3.0:1789785275.384688:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:026b2112-ee35-499c-8d01-18663664f08e+11:2398:x1876725530206208:12345-192.168.203.46@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789785275.387769:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:026b2112-ee35-499c-8d01-18663664f08e+13:2398:x1876725530206208:12345-192.168.203.46@tcp:4:lhsmtool_posix.0 Request processed in 3066us (4003us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1789785275.387788:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 7 00002000:00100000:3.0:1789785275.387803:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9dae84604380 x1876725530206208/t4294967322(0) o4->026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp:406/0 lens 504/448 e 0 to 0 dl 1789785286 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789785275.387815:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dae84604380 with x1876725530206208 ext(0->12) 00002000:00010000:3.0:1789785275.387823:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dae84604380 00010000:00010000:1.0:1789785275.394826:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785275.398197:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785275.398397:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530206336 00000100:00100000:0.0:1789785275.398414:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530206336 00000100:00100000:1.0:1789785275.398794:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 244 00000100:00100000:1.0:1789785275.398811:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+73:12481:x1876725530206336:12345-192.168.203.46@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789785275.402104:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:2.0:1789785275.402122:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:2.0:1789785275.402160:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1789785275.402180:0:6512:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9daf85440840 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1789785275.402184:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dae83a4e000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9daf85440900 00000020:00080000:2.0:1789785275.402187:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dae83a4ee00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dae828d4800 00000004:00080000:2.0:1789785275.402224:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1789785275.402265:0:6512:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9daf9017b900 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1789785275.402269:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9daf891a4e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9daf9017b480 00000020:00080000:2.0:1789785275.402272:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9daf891a4200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dae844ff600 00000020:00080000:2.0:1789785275.402301:0:6565:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:1.0:1789785275.402416:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:00080000:2.0:1789785275.402421:0:6565:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789785275.402457:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549128704:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789785275.402665:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549128960:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789785275.402729:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785275.402759:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785275.402799:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789785275.402811:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549128832:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789785275.402844:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789785275.402914:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845cfa9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.402926:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845cfa9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.402948:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845cfa9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.402954:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bbc00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785275.402959:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845cfa9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.402967:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845cfa9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.402983:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dafac970f00) 00010000:00010000:0.0:1789785275.402986:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785275.402991:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845cfa9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.402997:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbc00/0x2f18ee3fd845cfa9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403037:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845d051 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403044:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845d051 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403050:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845d051 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403055:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785275.403058:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845d051 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403074:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845d051 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403083:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9daf94af3f00) 00010000:00010000:0.0:1789785275.403085:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785275.403089:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845d051 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403094:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54200/0x2f18ee3fd845d051 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403112:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845d0cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403118:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845d0cf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403124:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845d0cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403129:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785275.403132:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845d0cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403138:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845d0cf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403145:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dae827bde00) 00010000:00010000:0.0:1789785275.403147:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785275.403150:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845d0cf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403161:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d54000/0x2f18ee3fd845d0cf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403174:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845d0f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403179:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845d0f2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403186:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845d0f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403191:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785275.403193:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845d0f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403199:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845d0f2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403206:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dae827bde00) 00010000:00010000:0.0:1789785275.403208:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785275.403210:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845d0f2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403215:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65200/0x2f18ee3fd845d0f2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403229:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d1c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403234:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d1c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403244:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d1c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403472:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81ead400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785275.403475:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d1c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403482:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d1c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403491:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:0.0:1789785275.403493:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785275.403496:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d1c4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403502:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d1c4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403514:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d281 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403520:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d281 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403526:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d281 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403540:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf80030a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785275.403543:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d281 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403566:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d281 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403575:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dae827c3800) 00010000:00010000:0.0:1789785275.403577:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789785275.403580:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d281 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.403586:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d281 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785275.403640:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549128960 00000100:00100000:1.0:1789785275.403651:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549128960 00000100:00100000:1.0:1789785275.403742:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549128704 00000100:00100000:1.0:1789785275.403746:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549128704 00000100:00100000:1.0:1789785275.403761:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549128832 00000100:00100000:1.0:1789785275.403763:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549128832 00000100:00100000:1.0:1789785275.403779:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789785275.403790:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84786680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3660:x1876725549128960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789785275.404054:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789785275.404065:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3661:x1876725549128704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789785275.404084:0:8449:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:2.0:1789785275.404120:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aadf4b8, atime: 0x6aadf4b9, ctime: 0x6aadf4b8, blocks: 0x8 00010000:00010000:2.0:1789785275.404128:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d2ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.404147:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=383s v=(0 0) 00010000:00010000:2.0:1789785275.404151:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785275.404159:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d2ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.404177:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d2ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.404187:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d2ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.404196:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d2ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.404228:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789785275.404420:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3661:x1876725549128704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 357us (1663us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789785275.404428:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789785275.404469:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789785275.404477:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84787100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3660:x1876725549128832:12345-0@lo:6:osp-syn-0-0.0 00002000:00010000:1.0:1789785275.404989:0:8805:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789785275.404995:0:8805:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789785274 00002000:00010000:1.0:1789785275.404997:0:8805:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789785275.405000:0:8805:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789785274 -> 1789785274 00002000:00010000:1.0:1789785275.405002:0:8805:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1789785275.405052:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84786680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3660:x1876725549128960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1263us (2322us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1789785275.405060:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:1.0:1789785275.405084:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789785275.405092:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d2ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.405113:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55000 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785275.405119:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d2ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.405129:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d2ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.405149:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d2ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.405156:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d2ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.405177:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785275.405179:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785275.405181:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789785275.405372:0:3661:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dae844c3800/2, rc 0, transno 4294967311 00000100:00100000:1.0:1789785275.405380:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549128704:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789785275.405864:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+21:12481:x1876725530206336:12345-192.168.203.46@tcp:44:lhsmtool_posix.0 Request processed in 7053us (7672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785275.405874:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 244 00002000:00080000:2.0:1789785275.405996:0:8449:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:2.0:1789785275.406019:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064be49cb/0x2f18ee3fd845d2b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.406040:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0dcb455/0x2f18ee3fd845d05f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8934 expref: 12 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.406050:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789785275.406055:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789785275.406060:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064be49cb/0x2f18ee3fd845d2b2 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.406102:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b0dcb455/0x2f18ee3fd845d05f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8934 expref: 12 pid: 8805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.406122:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b0dcb455/0x2f18ee3fd845d05f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8934 expref: 12 pid: 8805 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785275.406141:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8449:1876725549129088:192.168.203.46@tcp:104: 00000004:00080000:3.0:1789785275.406258:0:3660:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dae84785180/2, rc 0, transno 4294967323 00000100:00100000:3.0:1789785275.406273:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549128960:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789785275.406379:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf98775540 going to sleep for 11 seconds 00000100:00100000:2.0:1789785275.410146:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785275.410276:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8449:1876725549129088:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789785275.410312:0:8449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000064be49cb/0x2f18ee3fd845d2b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785275.411517:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530206464 00000100:00100000:3.0:1789785275.411541:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530206464 00010000:00010000:3.0:1789785275.411605:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b0dcb455/0x2f18ee3fd845d05f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8934 expref: 13 pid: 8805 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785275.411651:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 101 00000100:00100000:3.0:1789785275.411661:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:026b2112-ee35-499c-8d01-18663664f08e+13:2398:x1876725530206464:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789785275.411693:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785275.411700:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b0dcb455/0x2f18ee3fd845d05f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8934 expref: 13 pid: 8805 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.411716:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b0dcb455/0x2f18ee3fd845d05f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8934 expref: 13 pid: 8805 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.411740:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0dcb455/0x2f18ee3fd845d05f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8934 expref: 13 pid: 8805 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.411760:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789785275.411765:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789785275.411772:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000064be49cb/0x2f18ee3fd845d2b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.411783:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064be49cb/0x2f18ee3fd845d2b2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.411815:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785275.411884:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:026b2112-ee35-499c-8d01-18663664f08e+12:2398:x1876725530206464:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 223us (1752us total) trans 0 rc 0/0 00010000:00010000:0.0:1789785275.411888:0:8449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000064be49cb/0x2f18ee3fd845d2b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785275.411897:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 101 00010000:00010000:0.0:1789785275.411914:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064be49cb/0x2f18ee3fd845d2b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.411939:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064be49cb/0x2f18ee3fd845d2b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.411949:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064be49cb/0x2f18ee3fd845d2b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.412002:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789785275.412090:0:9538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789785275.412098:0:9538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064be49cb/0x2f18ee3fd845d2b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.412122:0:9538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55c00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:3.0:1789785275.412126:0:9538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064be49cb/0x2f18ee3fd845d2b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.412135:0:9538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064be49cb/0x2f18ee3fd845d2b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.412151:0:9538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064be49cb/0x2f18ee3fd845d2b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.412159:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064be49cb/0x2f18ee3fd845d2b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.412179:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785275.412180:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785275.412183:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785275.412270:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84787100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3660:x1876725549128832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7790us (9425us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1789785275.412280:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789785275.412462:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000004:00080000:3.0:1789785275.412995:0:3660:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dae84784e00/2, rc 0, transno 4294967324 00000100:00100000:3.0:1789785275.413005:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549128832:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789785275.414196:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530206592 00000100:00100000:0.0:1789785275.415068:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530206592 00000100:00100000:0.0:1789785275.415165:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 77 00000100:00100000:0.0:1789785275.415177:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+12:2398:x1876725530206592:12345-192.168.203.46@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789785275.422741:0:8445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1789785275.422757:0:8445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:0.0:1789785275.423026:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+7:2398:x1876725530206592:12345-192.168.203.46@tcp:16:lhsmtool_posix.0 Request processed in 7838us (10553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785275.423042:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 77 00000100:00100000:2.0:1789785275.425762:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785275.425892:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530206848 00000100:00100000:1.0:1789785275.425928:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530206848 00000100:00100000:1.0:1789785275.426002:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 245 00000100:00100000:1.0:1789785275.426015:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+21:12481:x1876725530206848:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789785275.426090:0:7896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785275.426127:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d296 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89ce expref: 21 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.426150:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dae827c3800) 00010000:00010000:1.0:1789785275.426156:0:7896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789785275.426200:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845d2b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.426213:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845d2b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.426224:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845d2b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789785275.426447:0:7896:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000077fa4a17 reply state 0000000014456d6d transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845d2b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.426463:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845d2b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.426470:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dae827c3800) 00010000:00010000:1.0:1789785275.426473:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789785275.426476:0:7896:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789785275.426824:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+22:12481:x1876725530206848:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 809us (1072us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1789785275.426834:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 245 00000100:00100000:2.0:1789785275.429822:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785275.430060:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530206976 00000100:00100000:0.0:1789785275.430073:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530206976 00000100:00100000:0.0:1789785275.430148:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 78 00000100:00100000:0.0:1789785275.430159:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+7:2397:x1876725530206976:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789785275.430429:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789785275.430433:0:8451:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1789785274 -> 1789785273 00002000:00010000:0.0:1789785275.430436:0:8451:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789785273 00002000:00010000:0.0:1789785275.430438:0:8451:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789785274 -> 1789785273 00002000:00010000:0.0:1789785275.430440:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789785275.431002:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+8:2397:x1876725530206976:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 Request processed in 839us (1188us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1789785275.431012:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 78 00000100:00100000:1.0:1789785275.438615:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785275.438761:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530207232 00000100:00100000:3.0:1789785275.438775:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530207232 00000100:00100000:3.0:1789785275.438899:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 246 00000100:00100000:3.0:1789785275.438913:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+22:12481:x1876725530207232:12345-192.168.203.46@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789785275.439022:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845d2c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.439066:0:11254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845d27a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89c0 expref: 22 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.439077:0:11254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845d2c0 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.439124:0:11254:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845d27a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89c0 expref: 22 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.439140:0:11254:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845d27a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89c0 expref: 22 pid: 11254 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785275.439156:0:11254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84786a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11254:1876725549129216:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789785275.439280:0:11254:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb409f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789785275.443661:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785275.443954:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530207360 00000100:00100000:2.0:1789785275.443966:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530207360 00010000:00010000:2.0:1789785275.444020:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845d27a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89c0 expref: 23 pid: 11254 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785275.444094:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 102 00000100:00100000:2.0:1789785275.444106:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+23:2398:x1876725530207360:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789785275.444125:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785275.444133:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845d27a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89c0 expref: 23 pid: 11254 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.444147:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845d27a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89c0 expref: 23 pid: 11254 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.444174:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dae827c3800) 00010000:00010000:2.0:1789785275.444180:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845d2c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.444191:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845d2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.444199:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845d2c0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.444222:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785275.444305:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+23:2398:x1876725530207360:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 198us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785275.444313:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 102 00010000:00010000:3.0:1789785275.444805:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64000/0x2f18ee3fd845d27a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89c0 expref: 22 pid: 11254 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785275.444830:0:11254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84786a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11254:1876725549129216:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785275.444857:0:11254:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845d2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.444868:0:11254:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845d2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.444873:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845d2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.444924:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845d2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.444943:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845d2c0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.444949:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845d2c0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.444955:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bbe00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785275.444960:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845d2c0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.444968:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845d2c0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.444980:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dae827c3800) 00010000:00010000:3.0:1789785275.444982:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789785275.444987:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845d2c0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.444993:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845d2c0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785275.445057:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+21:12481:x1876725530207232:12345-192.168.203.46@tcp:55:lhsmtool_posix.0 Request processed in 6147us (6458us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789785275.445066:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 246 00000100:00100000:1.0:1789785275.448549:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785275.448633:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530207488 00000100:00100000:3.0:1789785275.448645:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530207488 00000100:00100000:3.0:1789785275.448738:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 79 00000100:00100000:3.0:1789785275.448749:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+8:2398:x1876725530207488:12345-192.168.203.46@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789785275.448806:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000625a2439/0x2f18ee3fd845d2c7 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.448845:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000047d5e0ca/0x2f18ee3fd845d2a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89dc expref: 8 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.448854:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785275.448859:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789785275.448864:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000625a2439/0x2f18ee3fd845d2c7 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.448907:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000047d5e0ca/0x2f18ee3fd845d2a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89dc expref: 8 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.448933:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000047d5e0ca/0x2f18ee3fd845d2a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89dc expref: 8 pid: 8449 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785275.448951:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84786a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8450:1876725549129344:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789785275.449045:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb409f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789785275.455995:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785275.456043:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530207616 00000100:00100000:2.0:1789785275.456055:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530207616 00010000:00010000:2.0:1789785275.456109:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000047d5e0ca/0x2f18ee3fd845d2a4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89dc expref: 9 pid: 8449 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785275.456177:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 103 00000100:00100000:2.0:1789785275.456190:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+9:2398:x1876725530207616:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789785275.456211:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785275.456241:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000047d5e0ca/0x2f18ee3fd845d2a4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89dc expref: 9 pid: 8449 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.456266:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000047d5e0ca/0x2f18ee3fd845d2a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89dc expref: 9 pid: 8449 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.456300:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789785275.456306:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789785275.456313:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000625a2439/0x2f18ee3fd845d2c7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.456326:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000625a2439/0x2f18ee3fd845d2c7 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785275.456379:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785275.456442:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+9:2398:x1876725530207616:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 253us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785275.456451:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 103 00010000:00010000:1.0:1789785275.456667:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047d5e0ca/0x2f18ee3fd845d2a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89dc expref: 8 pid: 8449 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785275.456687:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84786a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8450:1876725549129344:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789785275.456714:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000625a2439/0x2f18ee3fd845d2c7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.456726:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000625a2439/0x2f18ee3fd845d2c7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.456735:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000625a2439/0x2f18ee3fd845d2c7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.456760:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000625a2439/0x2f18ee3fd845d2c7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.456769:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000625a2439/0x2f18ee3fd845d2c7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.456778:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000625a2439/0x2f18ee3fd845d2c7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.456787:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814ba400 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785275.456804:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000625a2439/0x2f18ee3fd845d2c7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.456815:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000625a2439/0x2f18ee3fd845d2c7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.456829:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000625a2439/0x2f18ee3fd845d2c7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.456837:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000625a2439/0x2f18ee3fd845d2c7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785275.456908:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+7:2398:x1876725530207488:12345-192.168.203.46@tcp:1:lhsmtool_posix.0 Request processed in 8160us (8378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785275.456917:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 79 00000100:00100000:2.0:1789785275.461114:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785275.461671:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530207872 00000100:00100000:0.0:1789785275.461703:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530207872 00000100:00100000:1.0:1789785275.461867:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 247 00000100:00100000:1.0:1789785275.461880:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+21:12481:x1876725530207872:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789785275.462046:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845d2ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.462067:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845d1bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8988 expref: 21 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.462079:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845d2ce lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.462125:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845d1bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8988 expref: 21 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.462148:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845d1bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8988 expref: 21 pid: 11254 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785275.462165:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1876725549129472:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789785275.462603:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789785275.465839:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785275.465916:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530208000 00000100:00100000:3.0:1789785275.465936:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530208000 00010000:00010000:3.0:1789785275.465987:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845d1bd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8988 expref: 22 pid: 11254 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785275.466035:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 104 00000100:00100000:3.0:1789785275.466046:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+22:2398:x1876725530208000:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789785275.466061:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785275.466070:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845d1bd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8988 expref: 22 pid: 11254 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.466101:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845d1bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8988 expref: 22 pid: 11254 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.466131:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:3.0:1789785275.466138:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845d21f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89ab expref: 22 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.466152:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845d2ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.466161:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845d2ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.466171:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845d2ce lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.466195:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785275.466280:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+22:2398:x1876725530208000:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 235us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785275.466288:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 104 00010000:00010000:1.0:1789785275.467624:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845d1bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8988 expref: 21 pid: 11254 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785275.467648:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1876725549129472:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789785275.467676:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845d2ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.467687:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845d2ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.467693:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845d2ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.467915:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d2d5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.467994:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845d288 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89c7 expref: 21 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.468003:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d2d5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.468042:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845d288 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89c7 expref: 21 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.468073:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845d288 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89c7 expref: 21 pid: 7896 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785275.468090:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1876725549129600:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789785275.468246:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6600 going to sleep for 11 seconds 00000100:00100000:2.0:1789785275.472639:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785275.472780:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530208128 00000100:00100000:3.0:1789785275.472794:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530208128 00010000:00010000:3.0:1789785275.472848:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845d288 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89c7 expref: 22 pid: 7896 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785275.472898:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 105 00000100:00100000:3.0:1789785275.472910:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+22:2397:x1876725530208128:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789785275.472963:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785275.472972:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845d288 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89c7 expref: 22 pid: 7896 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.472988:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845d288 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89c7 expref: 22 pid: 7896 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.473018:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dae827c3800) 00010000:00010000:3.0:1789785275.473025:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d2d5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.473035:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d2d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.473045:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d2d5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.473068:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785275.473145:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+22:2397:x1876725530208128:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 236us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785275.473153:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 105 00010000:00010000:1.0:1789785275.475017:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55400/0x2f18ee3fd845d288 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89c7 expref: 21 pid: 7896 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785275.475045:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1876725549129600:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789785275.475075:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d2d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.475085:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d2d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.475092:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d2d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789785275.475710:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1789785275.475853:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1789785275.475891:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1789785275.476007:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6534:1876725549129728:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789785275.476090:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785275.476142:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789785275.476683:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549129728 00000100:00100000:3.0:1789785275.476692:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549129728 00000100:00100000:3.0:1789785275.476764:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789785275.476776:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6534:x1876725549129728:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789785275.476890:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6534:x1876725549129728:12345-0@lo:1000:mdt00_001.0 Request processed in 115us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785275.476898:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789785275.477118:0:6534:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1789785275.477125:0:6534:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967319 committed transno 4294967324 00000004:00080000:1.0:1789785275.477146:0:6534:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dae84785180, transno 4294967323 00000004:00080000:1.0:1789785275.477168:0:6534:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dae84784e00, transno 4294967324 00000100:00100000:1.0:1789785275.477176:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6534:1876725549129728:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789785275.477504:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1789785275.477597:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6534:1876725549129856:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789785275.477639:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785275.477664:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb41ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1789785275.477801:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549129856 00000100:00100000:0.0:1789785275.477807:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549129856 00000100:00100000:0.0:1789785275.477850:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789785275.477859:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6534:x1876725549129856:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789785275.477997:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6534:x1876725549129856:12345-0@lo:1000:mdt00_001.0 Request processed in 139us (357us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1789785275.478005:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789785275.478433:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6534:1876725549129856:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1789785275.478480:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d2d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.478492:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d2d5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.478500:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d2d5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.478507:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785275.478513:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d2d5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.478521:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d2d5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.478554:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dae827c3800) 00010000:00010000:1.0:1789785275.478558:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789785275.478564:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d2d5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.478570:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65400/0x2f18ee3fd845d2d5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.478618:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845d218 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.478625:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845d218 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.478631:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845d218 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.478636:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf80031a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785275.478639:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845d218 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.478644:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845d218 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.478653:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:1.0:1789785275.478655:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789785275.478663:0:6534:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845d21f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89ab expref: 24 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.478675:0:6534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845d21f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89ab expref: 24 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.478685:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845d21f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89ab expref: 24 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.478718:0:6534:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845d21f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89ab expref: 24 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785275.478743:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1876725549129984:192.168.203.46@tcp:105: 00000100:00100000:1.0:1789785275.478908:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb41ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789785275.484072:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785275.484169:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530208256 00000100:00100000:3.0:1789785275.484181:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530208256 00000100:00100000:3.0:1789785275.484264:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 61 00000100:00100000:3.0:1789785275.484277:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+25:12480:x1876725530208256:12345-192.168.203.46@tcp:49:lfs.0 00000100:00100000:3.0:1789785275.484511:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+25:12480:x1876725530208256:12345-192.168.203.46@tcp:49:lfs.0 Request processed in 236us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785275.484520:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 61 00000100:00100000:1.0:1789785275.484823:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1876725549129984:192.168.203.46@tcp:105: 00010000:00010000:1.0:1789785275.484857:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845d218 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.484870:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845d218 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.484910:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d2dc lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.486863:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d2dc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.486893:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d2dc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.486911:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d2dc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.486918:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d2dc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.486926:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d2dc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.486933:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785275.486938:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d2dc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.486969:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d2dc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.486983:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:1.0:1789785275.486986:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785275.486992:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d2dc lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.486997:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65000/0x2f18ee3fd845d2dc lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.487019:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845d2ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.487025:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845d2ce lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.487031:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845d2ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.487037:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785275.487040:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845d2ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.487046:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845d2ce lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.487053:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:1.0:1789785275.487055:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789785275.487058:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845d2ce lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.487077:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65c00/0x2f18ee3fd845d2ce lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785275.487305:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+24:12481:x1876725530207872:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 25421us (26200us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1789785275.487318:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 247 00000020:00080000:1.0:1789785275.487326:0:6534:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789785275.491583:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789785275.491595:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789785275.492110:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789785275.492123:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789785275.492884:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785275.493049:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530208512 00000100:00100000:0.0:1789785275.493062:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530208512 00000100:00100000:0.0:1789785275.493145:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 248 00000100:00100000:0.0:1789785275.493158:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+24:12480:x1876725530208512:12345-192.168.203.46@tcp:58:lfs.0 00000040:00080000:0.0:1789785275.493421:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1789785275.493516:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+24:12480:x1876725530208512:12345-192.168.203.46@tcp:58:lfs.0 Request processed in 360us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785275.493525:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 248 00000100:00100000:2.0:1789785275.496806:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785275.501537:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530208768 00000100:00100000:1.0:1789785275.501562:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530208768 00000100:00100000:0.0:1789785275.504152:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 62 00000100:00100000:0.0:1789785275.504168:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf88770850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+24:12481:x1876725530208768:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789785275.504588:0:6536:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789785275.504632:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:0.0:1789785275.504670:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d2e3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.504689:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d2e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.504702:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d2e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.504737:0:6536:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d2e3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.504745:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d2e3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.504750:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d2e3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785275.504771:0:6536:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789785275.504911:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf88770850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+26:12481:x1876725530208768:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 746us (8118us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1789785275.504929:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 62 00000020:00080000:0.0:1789785275.504934:0:6536:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789785275.505713:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789785275.505724:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d2e3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.505735:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eada00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785275.505740:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d2e3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.505750:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d2e3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.505770:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dae827c3800) 00010000:00010000:1.0:1789785275.505773:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789785275.505780:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d2e3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.505786:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eada00/0x2f18ee3fd845d2e3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.505803:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785275.505805:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785275.505821:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785275.534027:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785275.534130:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530208896 00000100:00100000:3.0:1789785275.534142:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530208896 00000100:00100000:3.0:1789785275.534227:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 249 00000100:00100000:3.0:1789785275.534239:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+26:12483:x1876725530208896:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789785275.534283:0:11254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785275.534310:0:11254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845d2ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd89e3 expref: -99 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.534455:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845d2f1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.534474:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845d2f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.534488:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845d2f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.534505:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845d2f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.534540:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845d2f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.534548:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845d2f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.534647:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845d2ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.534660:0:11254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d20a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89a4 expref: 27 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.534669:0:11254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845d2ff lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.534710:0:11254:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d20a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89a4 expref: 27 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.534726:0:11254:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d20a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89a4 expref: 27 pid: 7896 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785275.534743:0:11254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84785180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11254:1876725549130112:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789785275.534876:0:11254:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb409780 going to sleep for 11 seconds 00000100:00100000:3.0:1789785275.538506:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785275.538730:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530209152 00000100:00100000:2.0:1789785275.538742:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530209152 00000100:00100000:2.0:1789785275.538804:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 63 00000100:00100000:2.0:1789785275.538814:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+28:6637:x1876725530209152:12345-192.168.203.46@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789785275.539124:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+29:6637:x1876725530209152:12345-192.168.203.46@tcp:35:ldlm_bl.0 Request processed in 310us (633us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789785275.539132:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 63 00000100:00100000:1.0:1789785275.539271:0:11254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84785180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11254:1876725549130112:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789785275.539307:0:11254:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845d2ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785275.542455:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785275.542820:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530209280 00000100:00100000:3.0:1789785275.542834:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530209280 00010000:00010000:3.0:1789785275.542890:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d20a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89a4 expref: 29 pid: 7896 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785275.542970:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 106 00000100:00100000:3.0:1789785275.542983:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+29:2397:x1876725530209280:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789785275.543004:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785275.543014:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d20a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89a4 expref: 29 pid: 7896 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.543029:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d20a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89a4 expref: 29 pid: 7896 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.543057:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d20a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89a4 expref: 29 pid: 7896 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.543079:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:3.0:1789785275.543086:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845d2ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.543097:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845d2ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.543106:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845d2ff lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785275.543133:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785275.543211:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:026b2112-ee35-499c-8d01-18663664f08e+28:2397:x1876725530209280:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 229us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785275.543219:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 106 00010000:00010000:1.0:1789785275.543463:0:11254:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845d2ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.543473:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845d2ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789785275.543547:0:11254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789785275.543552:0:11254:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789785275.543577:0:11254:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845d2ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.543593:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845d2ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.543604:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845d2f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.543612:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845d2f1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.543620:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845d2f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.543628:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bac00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785275.543633:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845d2f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.543641:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845d2f1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.543663:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:1.0:1789785275.543666:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785275.543670:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845d2f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.543677:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845d2f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.543691:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845d2f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.543697:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845d2f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.543703:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845d2f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.543708:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bb000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785275.543711:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845d2f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.543717:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845d2f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.543725:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9daf94af3800) 00010000:00010000:1.0:1789785275.543728:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785275.543731:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845d2f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.543736:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845d2f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.543791:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845d2ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89e3 expref: 28 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.543808:0:11254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845d2ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89e3 expref: 27 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785275.543816:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:1.0:1789785275.543834:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789785275.543838:0:11254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814ba000, rc 0) 00000100:00100000:1.0:1789785275.543869:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+27:12483:x1876725530208896:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 9633us (9858us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785275.543878:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 249 00010000:00010000:1.0:1789785276.418601:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789785276.548580:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789785276.548608:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789785276.548664:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789785276.548673:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789785276.548852:0:13813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84787b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1876725549130240:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789785276.548975:0:13813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb409f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789785276.572278:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785276.572314:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530209408 00000100:00100000:1.0:1789785276.572326:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530209408 00000100:00100000:1.0:1789785276.572412:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 250 00000100:00100000:1.0:1789785276.572425:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+28:12495:x1876725530209408:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789785276.572471:0:6534:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789785276.572623:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+28:12495:x1876725530209408:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 Request processed in 199us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785276.572631:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 250 00000100:00100000:0.0:1789785276.573453:0:13813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84787b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1876725549130240:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789785276.590545:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785276.590657:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530209664 00000100:00100000:0.0:1789785276.590670:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530209664 00000100:00100000:0.0:1789785276.590736:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 251 00000100:00100000:0.0:1789785276.590750:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+27:12495:x1876725530209664:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789785276.590779:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785276.590807:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845d306 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd89ea expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785276.590951:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d30d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785276.590989:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d30d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785276.591155:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d30d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785276.591173:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789785276.595713:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac800/0x2f18ee3fd845d306 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89ea expref: 30 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785276.595779:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d30d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89ea expref: 29 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785276.595790:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:1.0:1789785276.595793:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789785276.595798:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81ead400, rc 0) 00000100:00100000:1.0:1789785276.595951:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+29:12495:x1876725530209664:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 5203us (5433us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1789785276.595962:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 251 00000100:00100000:1.0:1789785276.619795:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785276.621819:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530209920 00000100:00100000:0.0:1789785276.621838:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530209920 00000100:00100000:0.0:1789785276.621936:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 252 00000100:00100000:0.0:1789785276.621949:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+29:12495:x1876725530209920:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789785276.622066:0:11254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d31b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785276.622087:0:11254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d31b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785276.622101:0:11254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d31b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785276.622700:0:11254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d31b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785276.622710:0:11254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d31b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785276.622717:0:11254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d31b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785276.622723:0:11254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eac400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785276.622744:0:11254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d31b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785276.622753:0:11254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d31b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785276.622768:0:11254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:0.0:1789785276.622772:0:11254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789785276.622778:0:11254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d31b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785276.622785:0:11254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d31b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785276.622963:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+30:12495:x1876725530209920:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 1016us (3179us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1789785276.622974:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 252 00000040:00080000:1.0:1789785276.623299:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789785276.623305:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789785276.623837:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789785276.623848:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789785276.636561:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785276.636606:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785276.638446:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530210304 00000100:00100000:3.0:1789785276.638462:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530210304 00000100:00100000:3.0:1789785276.638575:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:3.0:1789785276.638587:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+30:2397:x1876725530210304:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789785276.638607:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785276.638639:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d30d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89ea expref: 30 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785276.638659:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:3.0:1789785276.638665:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785276.638737:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:026b2112-ee35-499c-8d01-18663664f08e+29:2397:x1876725530210304:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 152us (2129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785276.638745:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:2.0:1789785276.643678:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530210176 00000100:00100000:2.0:1789785276.643697:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530210176 00000100:00100000:2.0:1789785276.643772:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 64 00000100:00100000:2.0:1789785276.643782:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+29:12495:x1876725530210176:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789785276.649632:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+30:12495:x1876725530210176:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 5833us (13070us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1789785276.649649:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 64 00000040:00080000:3.0:1789785276.711786:0:14824:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789785276.711799:0:14824:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789785276.711837:0:14824:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789785276.711844:0:14824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789785276.741458:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549130496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789785276.741538:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785276.743900:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549130368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789785276.743995:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785276.744955:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789785276.744975:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549130624:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789785276.745040:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785276.745801:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549130368 00000100:00100000:1.0:1789785276.745813:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549130368 00000100:00100000:1.0:1789785276.745871:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549130624 00000100:00100000:1.0:1789785276.745874:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549130624 00000100:00100000:1.0:1789785276.745894:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789785276.745904:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1876725549130368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789785276.745950:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1789785276.746027:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1876725549130368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (2030us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785276.746049:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789785276.746069:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789785276.746075:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84787b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549130624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789785276.746086:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1789785276.746118:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84787b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549130624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785276.746125:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789785276.746172:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549130624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789785276.746222:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549130368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789785276.746468:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549130496 00000100:00100000:1.0:1789785276.746473:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549130496 00000100:00100000:1.0:1789785276.746512:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789785276.746531:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549130496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789785276.746565:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789785276.759957:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549130496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789785276.760081:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549130496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 13552us (18533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785276.760100:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789785276.958816:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785276.958926:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530210560 00000100:00100000:0.0:1789785276.958938:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530210560 00000100:00100000:0.0:1789785276.959012:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 253 00000100:00100000:0.0:1789785276.959024:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+30:12508:x1876725530210560:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:0.0:1789785276.959057:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785276.959083:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d322 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd89f1 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785276.959223:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d329 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785276.959252:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d329 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785276.959285:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d329 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785276.959299:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789785276.959465:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81eac400/0x2f18ee3fd845d322 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89f1 expref: 33 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785276.959485:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d329 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89f1 expref: 32 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785276.959496:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:0.0:1789785276.959499:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789785276.959504:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81ead400, rc 0) 00000100:00100000:0.0:1789785276.959585:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+32:12508:x1876725530210560:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 562us (782us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1789785276.959593:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 253 00000100:00100000:1.0:1789785276.970746:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785276.970919:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530210688 00000100:00100000:3.0:1789785276.970931:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530210688 00000100:00100000:3.0:1789785276.971015:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 254 00000100:00100000:3.0:1789785276.971028:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+32:12508:x1876725530210688:12345-192.168.203.46@tcp:54:lfs.0 00010000:00010000:3.0:1789785276.971116:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d337 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785276.971137:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785276.971152:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785276.971198:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785276.971205:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d337 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785276.971214:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d337 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785276.971221:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814baa00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785276.971227:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d337 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785276.971243:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d337 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785276.971257:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:3.0:1789785276.971261:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789785276.971266:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d337 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785276.971284:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d337 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785276.971577:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+32:12508:x1876725530210688:12345-192.168.203.46@tcp:54:lfs.0 Request processed in 549us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785276.971585:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 254 00000100:00100000:3.0:1789785277.095123:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785277.096051:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530210816 00000100:00100000:2.0:1789785277.096066:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530210816 00000100:00080000:3.0:1789785277.096141:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789785277.096157:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 80 00000100:00100000:2.0:1789785277.096171:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+7:2397:x1876725530210816:12345-192.168.203.46@tcp:101:cat.0 00010000:00010000:2.0:1789785277.096196:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785277.096242:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a77e3484/0x2f18ee3fd845d33e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd89f8 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789785277.096275:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aadf4b9, atime: 0x6aadf4b9, ctime: 0x6aadf4b9, blocks: 0x8 00010000:00010000:2.0:1789785277.096303:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=385s v=(0 0) 00010000:00010000:2.0:1789785277.096309:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785277.096320:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a77e3484/0x2f18ee3fd845d33e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89f8 expref: 8 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785277.096366:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a77e3484/0x2f18ee3fd845d33e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89f8 expref: 8 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785277.096387:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d54000, rc 0) 00000100:00100000:3.0:1789785277.096526:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+8:2397:x1876725530210816:12345-192.168.203.46@tcp:101:cat.0 Request processed in 348us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785277.096535:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 80 00000100:00100000:1.0:1789785277.108652:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785277.109018:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530210944 00000100:00100000:3.0:1789785277.109032:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530210944 00002000:00100000:3.0:1789785277.109103:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9dafaca25c00 x1876725530210944/t0(0) o3->026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp:408/0 lens 488/0 e 0 to 0 dl 1789785288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789785277.109117:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dafaca25c00 with x1876725530210944 ext(0->4095) 00002000:00010000:3.0:1789785277.109125:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dafaca25c00 00000100:00100000:3.0:1789785277.109164:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 8 00000100:00100000:3.0:1789785277.109175:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:026b2112-ee35-499c-8d01-18663664f08e+8:2399:x1876725530210944:12345-192.168.203.46@tcp:3:cat.0 00000100:00100000:3.0:1789785277.109641:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:026b2112-ee35-499c-8d01-18663664f08e+8:2399:x1876725530210944:12345-192.168.203.46@tcp:3:cat.0 Request processed in 465us (1002us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789785277.109651:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 8 00002000:00100000:3.0:1789785277.109659:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9dafaca25c00 x1876725530210944/t0(0) o3->026b2112-ee35-499c-8d01-18663664f08e@192.168.203.46@tcp:408/0 lens 488/4536 e 0 to 0 dl 1789785288 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789785277.109669:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dafaca25c00 with x1876725530210944 ext(0->4095) 00002000:00010000:3.0:1789785277.109684:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dafaca25c00 00010000:00010000:3.0:1789785277.442801:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785278.467440:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785278.956041:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785278.956664:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785278.956688:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785278.959910:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530211456 00000100:00100000:0.0:1789785278.959933:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530211456 00000100:00100000:0.0:1789785278.960013:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 145 00000100:00100000:0.0:1789785278.960026:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+8:2397:x1876725530211456:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785278.960131:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+8:2397:x1876725530211456:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 107us (3468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785278.960140:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 145 00000100:00100000:1.0:1789785278.964702:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785278.964745:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785278.966976:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530211200 00000100:00100000:2.0:1789785278.966993:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530211200 00000100:00100000:1.0:1789785278.967058:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785278.967078:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530211712 00000100:00100000:2.0:1789785278.967081:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530211712 00000100:00100000:2.0:1789785278.967100:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530211328 00000100:00100000:2.0:1789785278.967103:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530211328 00000100:00100000:1.0:1789785278.967109:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785278.967115:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530211840 00000100:00100000:2.0:1789785278.967118:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530211840 00000100:00100000:1.0:1789785278.967130:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530211072 00000100:00100000:1.0:1789785278.967134:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530211072 00000100:00100000:2.0:1789785278.967135:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 348 00000100:00100000:2.0:1789785278.967146:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+32:2397:x1876725530211200:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785278.967163:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 394 00000100:00100000:1.0:1789785278.967169:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2397:x1876725530211072:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785278.967248:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 349 00000100:00100000:3.0:1789785278.967259:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2397:x1876725530211712:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785278.968173:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+32:2397:x1876725530211200:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 1022us (12140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785278.968185:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 348 00000100:00100000:2.0:1789785278.968214:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 350 00000100:00100000:2.0:1789785278.968222:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530211328:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785278.968280:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530211328:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 59us (3534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785278.968287:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 350 00000100:00100000:2.0:1789785278.968301:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 351 00000100:00100000:2.0:1789785278.968308:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2397:x1876725530211840:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785278.968334:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2397:x1876725530211840:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 27us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785278.968366:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 351 00000100:00080000:2.0:1789785278.968390:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789785278.968397:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789785278.968456:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530211584 00000100:00100000:2.0:1789785278.968463:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530211584 00000100:00100000:2.0:1789785278.968526:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 146 00000100:00100000:2.0:1789785278.968534:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+7:2397:x1876725530211584:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785278.968561:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:026b2112-ee35-499c-8d01-18663664f08e+7:2397:x1876725530211584:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 28us (1508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785278.968568:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 146 00000100:00080000:2.0:1789785278.968585:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789785278.969028:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2397:x1876725530211072:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 1855us (4337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785278.969037:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 394 00000100:00100000:3.0:1789785278.970962:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2397:x1876725530211712:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 3688us (14256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785278.970978:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 349 00010000:00010000:1.0:1789785279.497774:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789785279.820422:0:9529:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1789785279.820446:0:9529:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1789785280.322692:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789785280.322722:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549130752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789785280.322812:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785280.322865:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549130752 00000100:00100000:1.0:1789785280.322881:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549130752 00000100:00100000:1.0:1789785280.322965:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789785280.322975:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549130752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789785280.323006:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785280.323098:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549130752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785280.323105:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:3.0:1789785280.323151:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789785280.323198:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549130752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789785280.323457:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549130880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789785280.323506:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785280.323658:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549130880 00000100:00100000:3.0:1789785280.323677:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549130880 00000100:00100000:3.0:1789785280.323763:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789785280.323774:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549130880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789785280.323799:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785280.323863:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549130880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785280.323875:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789785280.323896:0:3661:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1789785280.323903:0:3661:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:1.0:1789785280.323920:0:3661:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dae844c3800, transno 4294967311 00000100:00100000:1.0:1789785280.323945:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549130880:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789785280.325015:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789785280.326895:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789785280.326926:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549131008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789785280.327054:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785280.327147:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549131008 00000100:00100000:1.0:1789785280.327156:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549131008 00000100:00100000:1.0:1789785280.327221:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789785280.327233:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549131008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789785280.327280:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789785280.327360:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549131008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785280.327368:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789785280.327548:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549131008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789785280.332705:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725549131520:0@lo:400:kworker.0 00000100:00100000:3.0:1789785280.332798:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785280.332853:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549132032:0@lo:400:kworker.0 00000100:00100000:3.0:1789785280.332882:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785280.332911:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789785280.332917:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549131392:0@lo:400:kworker.0 00000100:00100000:3.0:1789785280.332945:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785280.333146:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876725549131264:0@lo:400:kworker.0 00000100:00100000:1.0:1789785280.333182:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785280.333206:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549131776:0@lo:400:kworker.0 00000100:00100000:1.0:1789785280.333228:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785280.333245:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1876725549132288:0@lo:400:kworker.0 00000100:00100000:1.0:1789785280.333267:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785280.333286:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789785280.333292:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549131136:0@lo:400:kworker.0 00000100:00100000:1.0:1789785280.333320:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785280.333367:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1876725549131648:0@lo:400:kworker.0 00000100:00100000:1.0:1789785280.333391:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785280.333407:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1876725549132160:0@lo:400:kworker.0 00000100:00100000:1.0:1789785280.333427:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785280.333454:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549131520 00000100:00100000:1.0:1789785280.333470:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549131520 00000100:00100000:1.0:1789785280.333529:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549131264 00000100:00100000:1.0:1789785280.333533:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549131264 00000100:00100000:1.0:1789785280.333545:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549131776 00000100:00100000:1.0:1789785280.333548:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549131776 00000100:00100000:1.0:1789785280.333574:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549132288 00000100:00100000:1.0:1789785280.333576:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549132288 00000100:00100000:1.0:1789785280.333589:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549131648 00000100:00100000:1.0:1789785280.333591:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549131648 00000100:00100000:1.0:1789785280.333602:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549132160 00000100:00100000:1.0:1789785280.333605:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549132160 00000100:00100000:1.0:1789785280.333621:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1789785280.333629:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725549131520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785280.333700:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725549131520:12345-0@lo:400:kworker.0 Request processed in 71us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785280.333707:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1789785280.333729:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1789785280.333734:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876725549131264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785280.333764:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876725549131264:12345-0@lo:400:kworker.0 Request processed in 31us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785280.333770:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1789785280.333784:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1789785280.333789:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1876725549131776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785280.333815:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1876725549131776:12345-0@lo:400:kworker.0 Request processed in 26us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785280.333820:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1789785280.333832:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789785280.333838:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1876725549132288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785280.333876:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1876725549132288:12345-0@lo:400:kworker.0 Request processed in 38us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785280.333882:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789785280.333894:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789785280.333900:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1876725549131648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785280.333925:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1876725549131648:12345-0@lo:400:kworker.0 Request processed in 26us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785280.333931:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789785280.333943:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789785280.333949:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1876725549132160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785280.333974:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1876725549132160:12345-0@lo:400:kworker.0 Request processed in 25us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785280.334056:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789785280.334085:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549131136 00000100:00100000:1.0:1789785280.334089:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549131136 00000100:00100000:1.0:1789785280.334118:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1789785280.334125:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:3660:x1876725549131136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785280.334156:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e00759f-51ad-47f9-8892-382c83919083+24:3660:x1876725549131136:12345-0@lo:400:kworker.0 Request processed in 32us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785280.334163:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00080000:1.0:1789785280.334196:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789785280.334201:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789785280.334232:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e00759f-51ad-47f9-8892-382c83919083:3660:1876725549131136:0@lo:400:kworker.0 00000100:00100000:1.0:1789785280.334247:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1876725549131648:0@lo:400:kworker.0 00000100:00100000:1.0:1789785280.334256:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1876725549132160:0@lo:400:kworker.0 00000100:00100000:1.0:1789785280.334276:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876725549131264:0@lo:400:kworker.0 00010000:00080000:1.0:1789785280.334289:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae84600e00 x1876725549131776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785280.334299:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549131776:0@lo:400:kworker.0 00010000:00080000:1.0:1789785280.334310:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae84603480 x1876725549132288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785280.334318:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1876725549132288:0@lo:400:kworker.0 00000100:00100000:3.0:1789785280.334525:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549131904:0@lo:400:kworker.0 00000100:00100000:3.0:1789785280.334563:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785280.334602:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725549131520:0@lo:400:kworker.0 00000100:00100000:3.0:1789785280.334632:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549132032 00000100:00100000:3.0:1789785280.334636:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549132032 00000100:00100000:3.0:1789785280.334685:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549131904 00000100:00100000:3.0:1789785280.334688:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549131904 00000100:00100000:3.0:1789785280.334708:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789785280.334714:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84601500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3662:x1876725549132032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785280.334751:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84601500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3662:x1876725549132032:12345-0@lo:400:kworker.0 Request processed in 37us (1869us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785280.334757:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789785280.334771:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789785280.334777:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84602a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549131904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785280.334801:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84602a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549131904:12345-0@lo:400:kworker.0 Request processed in 25us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785280.334806:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789785280.334825:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549131392 00000100:00100000:3.0:1789785280.334830:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549131392 00000100:00100000:3.0:1789785280.334855:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789785280.334862:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549131392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785280.334896:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549131392:12345-0@lo:400:kworker.0 Request processed in 35us (1950us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785280.334902:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:3.0:1789785280.334929:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789785280.334957:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549131392:0@lo:400:kworker.0 00000100:00100000:3.0:1789785280.335167:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549131904:0@lo:400:kworker.0 00000100:00100000:3.0:1789785280.335182:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549132032:0@lo:400:kworker.0 00010000:00010000:3.0:1789785280.514761:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789785280.839854:0:8445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967326 is committed 00000001:00080000:1.0:1789785280.839874:0:8445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:2.0:1789785280.845988:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1789785280.846028:0:6512:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dae827d6f00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1789785280.846033:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9daf989f5400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dae827d6a80 00000020:00080000:2.0:1789785280.846036:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9daf989f5000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dae84655400 00000020:00080000:2.0:1789785280.846063:0:6512:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1789785280.846131:0:6565:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1789785280.846229:0:6565:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1789785280.846498:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845d2b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785280.846512:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845d2b9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785280.846585:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845d2b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785280.846592:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785280.846597:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845d2b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785280.846605:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845d2b9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785280.846624:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dae827c3800) 00010000:00010000:1.0:1789785280.846627:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785280.846646:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845d2b9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785280.846653:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a65800/0x2f18ee3fd845d2b9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785281.538511:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785281.858858:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549132416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789785281.858971:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785281.859047:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549132416 00000100:00100000:2.0:1789785281.859054:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549132416 00000100:00100000:2.0:1789785281.859100:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789785281.859110:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf887c5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549132416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789785281.859143:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789785281.859194:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf887c5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549132416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785281.859213:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789785281.860300:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549132416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789785281.870555:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549132544:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789785281.870634:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785281.870852:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549132544 00000100:00100000:3.0:1789785281.870860:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549132544 00000100:00100000:3.0:1789785281.870923:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789785281.870934:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549132544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789785281.870963:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789785281.871012:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549132544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785281.871020:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789785281.871065:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549132544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789785281.881470:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549132672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789785281.881563:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785281.883172:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549132672 00000100:00100000:0.0:1789785281.883183:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549132672 00000100:00100000:0.0:1789785281.883282:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789785281.883293:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84603800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549132672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789785281.883317:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789785281.883423:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84603800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549132672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (1859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785281.883430:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789785281.883530:0:3659:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000004:00080000:1.0:1789785281.883537:0:3659:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967326 committed transno 4294967326 00000100:00100000:1.0:1789785281.883564:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549132672:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789785282.562538:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785282.762241:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785282.762876:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530211968 00000100:00100000:2.0:1789785282.762886:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530211968 00000100:00100000:2.0:1789785282.763003:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 255 00000100:00100000:2.0:1789785282.763015:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+18:12161:x1876725530211968:12345-192.168.203.46@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789785282.763113:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+18:12161:x1876725530211968:12345-192.168.203.46@tcp:60:lhsmtool_posix.0 Request processed in 101us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785282.763120:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 255 00000100:00080000:3.0:1789785282.763622:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789785282.772019:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785282.774932:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530212096 00000100:00100000:1.0:1789785282.774948:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530212096 00000100:00100000:1.0:1789785282.775106:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 256 00000100:00100000:1.0:1789785282.775120:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:12161:x1876725530212096:12345-192.168.203.46@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789785282.775234:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:12161:x1876725530212096:12345-192.168.203.46@tcp:60:lhsmtool_posix.0 Request processed in 118us (3224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785282.775241:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 256 00000100:00080000:3.0:1789785282.779654:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789785282.786167:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785282.786311:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530212352 00000100:00100000:3.0:1789785282.786320:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530212352 00000100:00100000:3.0:1789785282.786462:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 65 00000100:00100000:3.0:1789785282.786473:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+18:12161:x1876725530212352:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789785282.786712:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+19:12161:x1876725530212352:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 241us (552us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1789785282.786720:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 65 00000100:00100000:0.0:1789785283.060266:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785283.060432:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530212480 00000100:00100000:3.0:1789785283.060445:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530212480 00000100:00100000:3.0:1789785283.060562:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 257 00000100:00100000:3.0:1789785283.060576:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+5:12966:x1876725530212480:12345-192.168.203.46@tcp:101:lsof.0 00010000:00010000:3.0:1789785283.060602:0:7896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785283.060626:0:7896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d345 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd89ff expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785283.060707:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845d34c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785283.060724:0:7896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845d34c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785283.060742:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845d34c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785283.060818:0:7896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789785283.060823:0:7896:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789785283.060852:0:7896:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845d34c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785283.060881:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845d345 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89ff expref: 7 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785283.060903:0:7896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845d34c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89ff expref: 6 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785283.060914:0:7896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dae827c3c00) 00010000:00010000:3.0:1789785283.060918:0:7896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789785283.060941:0:7896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bbe00, rc 0) 00000100:00100000:3.0:1789785283.061039:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+6:12966:x1876725530212480:12345-192.168.203.46@tcp:101:lsof.0 Request processed in 466us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785283.061047:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 257 00000100:00080000:1.0:1789785283.063507:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789785283.587550:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785284.076383:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785284.076432:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785284.076490:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785284.076580:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530212608 00000100:00100000:1.0:1789785284.076599:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530212608 00000100:00100000:1.0:1789785284.076649:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 396 00000100:00100000:1.0:1789785284.076660:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2397:x1876725530212608:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785284.076726:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2397:x1876725530212608:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 68us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785284.076734:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 396 00000100:00100000:0.0:1789785284.078104:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785284.078135:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785284.078155:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785284.078215:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530212864 00000100:00100000:1.0:1789785284.078236:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530212864 00000100:00100000:1.0:1789785284.078291:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530213376 00000100:00100000:1.0:1789785284.078294:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530213376 00000100:00100000:1.0:1789785284.078314:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530212736 00000100:00100000:1.0:1789785284.078317:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530212736 00000100:00100000:1.0:1789785284.078370:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 358 00000100:00100000:1.0:1789785284.078380:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530212864:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785284.078437:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530212864:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 58us (2004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785284.078444:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 358 00000100:00100000:1.0:1789785284.078463:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 359 00000100:00100000:1.0:1789785284.078482:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2397:x1876725530213376:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785284.078507:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2397:x1876725530213376:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 27us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785284.078513:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 359 00000100:00100000:1.0:1789785284.078525:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 360 00000100:00100000:1.0:1789785284.078531:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+19:2397:x1876725530212736:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785284.078561:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:026b2112-ee35-499c-8d01-18663664f08e+19:2397:x1876725530212736:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 29us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785284.078566:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 360 00000100:00080000:1.0:1789785284.078585:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789785284.078601:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789785284.095364:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785284.097373:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530213248 00000100:00100000:1.0:1789785284.097387:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530213248 00000100:00100000:1.0:1789785284.097455:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 361 00000100:00100000:1.0:1789785284.097475:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+6:2397:x1876725530213248:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785284.097598:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12a32a3b-e9e7-466a-b40d-7d74895946de+6:2397:x1876725530213248:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 122us (2260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785284.097606:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 361 00000100:00100000:3.0:1789785284.105174:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530213120 00000100:00100000:3.0:1789785284.105189:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530213120 00000100:00100000:3.0:1789785284.105269:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530212992 00000100:00100000:3.0:1789785284.105272:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530212992 00000100:00100000:3.0:1789785284.105301:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 149 00000100:00100000:3.0:1789785284.105312:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530213120:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785284.105407:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530213120:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 97us (28915us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785284.105415:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 149 00000100:00100000:3.0:1789785284.105433:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 150 00000100:00100000:3.0:1789785284.105440:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+7:2397:x1876725530212992:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785284.105709:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+7:2397:x1876725530212992:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 269us (27552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785284.105716:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 150 00000100:00080000:1.0:1789785284.106105:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789785284.106110:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1789785284.422726:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789785284.610508:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789785284.802784:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789785284.802797:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789785284.802898:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1789785284.802907:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789785285.442625:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789785285.442659:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549132800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789785285.442877:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785285.442994:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549132928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789785285.443040:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785285.443119:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549132928 00000100:00100000:1.0:1789785285.443129:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549132928 00000100:00100000:1.0:1789785285.443207:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789785285.443218:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549132928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789785285.443252:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789785285.443256:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789785285.443323:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549132928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785285.443333:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789785285.443413:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549132928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789785285.445665:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549132800 00000100:00100000:3.0:1789785285.445683:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549132800 00000100:00100000:3.0:1789785285.445770:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789785285.445780:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549132800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789785285.445843:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789785285.445951:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549132800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 172us (3080us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785285.445960:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789785285.446037:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549132800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789785285.447522:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549133440:0@lo:400:kworker.0 00000100:00100000:0.0:1789785285.447599:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785285.447651:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549133952:0@lo:400:kworker.0 00000100:00100000:0.0:1789785285.447696:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785285.447724:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789785285.447730:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549133056:0@lo:400:kworker.0 00000100:00100000:0.0:1789785285.447758:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785285.447776:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1876725549133568:0@lo:400:kworker.0 00000100:00100000:0.0:1789785285.447793:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785285.447804:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1876725549134080:0@lo:400:kworker.0 00000100:00100000:0.0:1789785285.447820:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785285.447845:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549133952 00000100:00100000:0.0:1789785285.447853:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549133952 00000100:00100000:0.0:1789785285.447911:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789785285.447920:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549133952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785285.447975:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549133952:12345-0@lo:400:kworker.0 Request processed in 55us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785285.447982:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:0.0:1789785285.448005:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789785285.448036:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549133952:0@lo:400:kworker.0 00000100:00100000:2.0:1789785285.449788:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549133440 00000100:00100000:2.0:1789785285.449799:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549133440 00000100:00100000:2.0:1789785285.449858:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549133568 00000100:00100000:2.0:1789785285.449862:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549133568 00000100:00100000:2.0:1789785285.449897:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549134080 00000100:00100000:2.0:1789785285.449900:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549134080 00000100:00100000:2.0:1789785285.449922:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1789785285.449948:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549133440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785285.450042:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549133440:12345-0@lo:400:kworker.0 Request processed in 95us (2443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785285.450050:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1789785285.450068:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1789785285.450075:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1876725549133568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785285.450105:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1876725549133568:12345-0@lo:400:kworker.0 Request processed in 30us (2310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785285.450111:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1789785285.450121:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1789785285.450127:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1876725549134080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785285.450154:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1876725549134080:12345-0@lo:400:kworker.0 Request processed in 27us (2333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785285.450160:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00080000:2.0:1789785285.450185:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789785285.450802:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549133056 00000100:00100000:1.0:1789785285.450812:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549133056 00000100:00100000:1.0:1789785285.450868:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1789785285.450877:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:3661:x1876725549133056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785285.450933:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:3661:x1876725549133056:12345-0@lo:400:kworker.0 Request processed in 58us (3173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785285.450940:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1789785285.451636:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789785285.451663:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549134464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789785285.451721:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785285.451775:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549133312:0@lo:400:kworker.0 00000100:00100000:3.0:1789785285.451806:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785285.451825:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549133824:0@lo:400:kworker.0 00000100:00100000:3.0:1789785285.451848:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785285.451865:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549134336:0@lo:400:kworker.0 00000100:00100000:3.0:1789785285.451884:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785285.451902:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789785285.451908:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876725549133184:0@lo:400:kworker.0 00000100:00100000:3.0:1789785285.451934:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785285.451950:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549133696:0@lo:400:kworker.0 00000100:00100000:3.0:1789785285.451971:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785285.451986:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1876725549134208:0@lo:400:kworker.0 00000100:00100000:3.0:1789785285.452006:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785285.452038:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549133824 00000100:00100000:3.0:1789785285.452044:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549133824 00000100:00100000:3.0:1789785285.452093:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549134336 00000100:00100000:3.0:1789785285.452096:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549134336 00000100:00100000:3.0:1789785285.452137:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789785285.452144:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549133824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785285.452191:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549133824:12345-0@lo:400:kworker.0 Request processed in 47us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785285.452198:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789785285.452237:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549133824:0@lo:400:kworker.0 00000100:00100000:3.0:1789785285.452260:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789785285.452266:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84600000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549134336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785285.452293:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84600000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549134336:12345-0@lo:400:kworker.0 Request processed in 28us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785285.452299:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789785285.452315:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549134336:0@lo:400:kworker.0 00000100:00100000:2.0:1789785285.452419:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549133312 00000100:00100000:2.0:1789785285.452423:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549133312 00000100:00100000:2.0:1789785285.452466:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789785285.452473:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549133312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785285.452509:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549133312:12345-0@lo:400:kworker.0 Request processed in 37us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785285.452515:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789785285.452532:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549133184 00000100:00100000:2.0:1789785285.452535:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549133184 00000100:00100000:2.0:1789785285.452556:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549133696 00000100:00100000:2.0:1789785285.452559:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549133696 00000100:00100000:2.0:1789785285.452573:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549134208 00000100:00100000:2.0:1789785285.452582:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549134208 00000100:00100000:2.0:1789785285.452598:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1789785285.452602:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876725549133184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785285.452629:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876725549133184:12345-0@lo:400:kworker.0 Request processed in 26us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785285.452635:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1789785285.452643:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1789785285.452648:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1876725549133696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785285.452667:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1876725549133696:12345-0@lo:400:kworker.0 Request processed in 19us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785285.452672:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1789785285.452680:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1789785285.452685:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1876725549134208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785285.452703:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1876725549134208:12345-0@lo:400:kworker.0 Request processed in 18us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785285.452708:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00080000:2.0:1789785285.452733:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789785285.452737:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789785285.452740:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789785285.452812:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549134464 00000100:00100000:1.0:1789785285.452816:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549134464 00000100:00100000:1.0:1789785285.452852:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789785285.452866:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84601180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549134464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789785285.452884:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785285.452922:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84601180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549134464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785285.452928:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789785285.453090:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549134464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789785285.453128:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876725549133184:0@lo:400:kworker.0 00010000:00080000:3.0:1789785285.453141:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae84607b80 x1876725549133696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785285.453152:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549133696:0@lo:400:kworker.0 00010000:00080000:3.0:1789785285.453161:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae847d7b80 x1876725549134208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785285.453169:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1876725549134208:0@lo:400:kworker.0 00000100:00100000:3.0:1789785285.453179:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549133312:0@lo:400:kworker.0 00000100:00100000:0.0:1789785285.453268:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549133056:0@lo:400:kworker.0 00000100:00100000:0.0:1789785285.453283:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1876725549133568:0@lo:400:kworker.0 00000100:00100000:0.0:1789785285.453293:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1876725549134080:0@lo:400:kworker.0 00000100:00100000:0.0:1789785285.453304:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549133440:0@lo:400:kworker.0 00010000:00010000:1.0:1789785285.635220:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789785286.472019:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1789785286.472041:0:6512:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1789785286.472089:0:6565:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1789785286.472113:0:6565:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1789785286.660406:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785286.979109:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789785286.979136:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549134592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789785286.979213:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785286.984850:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549134848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789785286.984933:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549134720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789785286.984965:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785286.985005:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549134592 00000100:00100000:2.0:1789785286.985024:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549134592 00000100:00100000:1.0:1789785286.985047:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549134720 00000100:00100000:1.0:1789785286.985052:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549134720 00000100:00100000:2.0:1789785286.985080:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789785286.985086:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789785286.985096:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549134720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789785286.985126:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789785286.985174:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84603100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549134592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789785286.985198:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789785286.985585:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785286.985869:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84603100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549134592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 778us (6655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785286.985891:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789785286.985909:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549134848 00000100:00100000:2.0:1789785286.985913:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549134848 00000100:00100000:2.0:1789785286.985945:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789785286.985952:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84602300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549134848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789785286.985965:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789785286.985998:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84602300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549134848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785286.986004:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789785286.986044:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549134848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789785286.986203:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549134592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789785286.986996:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549134720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1899us (2028us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785286.987006:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789785286.987200:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549134720:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1789785287.305685:0:15022:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 22:34:44 (1789785284) 00010000:00010000:1.0:1789785287.683217:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785288.706478:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785289.196058:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785289.196526:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530213504 00000100:00100000:1.0:1789785289.196537:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530213504 00000100:00100000:1.0:1789785289.196635:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 398 00000100:00100000:1.0:1789785289.196646:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2398:x1876725530213504:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785289.196719:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2398:x1876725530213504:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 74us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785289.196727:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 398 00000100:00100000:1.0:1789785289.211483:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785289.211578:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785289.211616:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785289.211664:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530213888 00000100:00100000:0.0:1789785289.211674:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530213888 00000100:00100000:0.0:1789785289.211731:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 154 00000100:00100000:0.0:1789785289.211741:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+7:2397:x1876725530213888:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785289.211812:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:026b2112-ee35-499c-8d01-18663664f08e+7:2397:x1876725530213888:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 72us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785289.211820:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 154 00000100:00080000:0.0:1789785289.213396:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789785289.218250:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785289.221617:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530213632 00000100:00100000:2.0:1789785289.221631:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530213632 00000100:00080000:2.0:1789785289.221736:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789785289.221787:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530214144 00000100:00100000:2.0:1789785289.221791:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530214144 00000100:00100000:2.0:1789785289.221825:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 368 00000100:00100000:2.0:1789785289.221836:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+18:2398:x1876725530213632:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785289.222059:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:026b2112-ee35-499c-8d01-18663664f08e+18:2398:x1876725530213632:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 225us (10585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785289.222065:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 368 00000100:00100000:2.0:1789785289.222078:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 369 00000100:00100000:2.0:1789785289.222083:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+6:2397:x1876725530214144:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785289.222098:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12a32a3b-e9e7-466a-b40d-7d74895946de+6:2397:x1876725530214144:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 16us (10484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785289.222102:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 369 00000100:00080000:2.0:1789785289.222118:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789785289.222709:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530213760 00000100:00100000:0.0:1789785289.222715:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530213760 00000100:00100000:0.0:1789785289.222754:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 370 00000100:00100000:0.0:1789785289.222760:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530213760:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785289.222789:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530213760:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 30us (4547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785289.222793:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 370 00000100:00080000:2.0:1789785289.222805:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789785289.222868:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785289.222904:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785289.222915:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530214016 00000100:00100000:0.0:1789785289.222920:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530214016 00000100:00100000:0.0:1789785289.222955:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 155 00000100:00100000:0.0:1789785289.222962:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530214016:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785289.222992:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+5:2397:x1876725530214016:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 30us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785289.222998:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 155 00000100:00100000:2.0:1789785289.223621:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530214272 00000100:00100000:2.0:1789785289.223626:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530214272 00000100:00100000:2.0:1789785289.223667:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 371 00000100:00100000:2.0:1789785289.223673:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2397:x1876725530214272:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785289.223706:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2397:x1876725530214272:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 32us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785289.223713:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 371 00000100:00080000:2.0:1789785289.223728:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789785289.223732:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789785289.730564:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785290.562731:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549135104:0@lo:400:kworker.0 00000100:00100000:2.0:1789785290.562764:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549135360:0@lo:400:kworker.0 00000100:00100000:1.0:1789785290.562820:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549135232:0@lo:400:kworker.0 00000100:00100000:3.0:1789785290.562876:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549134976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789785290.562884:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785290.562886:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785290.562896:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785290.562965:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549135744:0@lo:400:kworker.0 00000100:00100000:0.0:1789785290.562972:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549135616:0@lo:400:kworker.0 00000100:00100000:2.0:1789785290.562978:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549135872:0@lo:400:kworker.0 00000100:00100000:3.0:1789785290.563001:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785290.563008:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785290.563017:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785290.563025:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549135232 00000100:00100000:2.0:1789785290.563032:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549135232 00000100:00100000:3.0:1789785290.563043:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549135488:0@lo:400:kworker.0 00000100:00100000:1.0:1789785290.563048:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549136256:0@lo:400:kworker.0 00000100:00100000:0.0:1789785290.563059:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549136128:0@lo:400:kworker.0 00000100:00100000:2.0:1789785290.563074:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549135744 00000100:00100000:1.0:1789785290.563074:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785290.563077:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549135744 00000100:00100000:0.0:1789785290.563100:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785290.563105:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549136256 00000100:00100000:2.0:1789785290.563108:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549136256 00000100:00100000:0.0:1789785290.563129:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549136640:0@lo:400:kworker.0 00000100:00100000:1.0:1789785290.563130:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1789785290.563141:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1789785290.563144:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549135232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785290.563150:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549135744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785290.563163:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785290.563207:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785290.563208:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549135360 00000100:00100000:0.0:1789785290.563213:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549135360 00000100:00100000:1.0:1789785290.563215:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549135232:12345-0@lo:400:kworker.0 Request processed in 74us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785290.563216:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549135744:12345-0@lo:400:kworker.0 Request processed in 66us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785290.563225:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1789785290.563229:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549136000:0@lo:400:kworker.0 00000100:00100000:1.0:1789785290.563231:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1789785290.563243:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549135488 00000100:00100000:1.0:1789785290.563247:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549135488 00000100:00100000:0.0:1789785290.563247:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549135616 00000100:00100000:2.0:1789785290.563252:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1789785290.563253:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549135616 00000100:00100000:2.0:1789785290.563261:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549136256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785290.563264:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789785290.563272:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549135488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785290.563278:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789785290.563289:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549135360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785290.563301:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549136256:12345-0@lo:400:kworker.0 Request processed in 40us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785290.563301:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549135488:12345-0@lo:400:kworker.0 Request processed in 29us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785290.563311:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1789785290.563315:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1789785290.563362:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549135360:12345-0@lo:400:kworker.0 Request processed in 52us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785290.563363:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549135104 00000100:00100000:1.0:1789785290.563369:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549135104 00000100:00100000:3.0:1789785290.563373:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785290.563377:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789785290.563409:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789785290.563413:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1789785290.563437:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549135616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785290.563444:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549134976 00000100:00100000:1.0:1789785290.563445:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:3662:x1876725549135104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785290.563448:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549134976 00000100:00100000:3.0:1789785290.563473:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549136512:0@lo:400:kworker.0 00000100:00100000:2.0:1789785290.563485:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789785290.563489:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549135616:12345-0@lo:400:kworker.0 Request processed in 68us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785290.563496:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e00759f-51ad-47f9-8892-382c83919083+24:3662:x1876725549135104:12345-0@lo:400:kworker.0 Request processed in 53us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785290.563497:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84600e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549134976:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789785290.563505:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789785290.563506:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1789785290.563513:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1789785290.563534:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789785290.563536:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549136128 00000100:00100000:0.0:1789785290.563541:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549136128 00000100:00100000:3.0:1789785290.563561:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549135488:0@lo:400:kworker.0 00000100:00100000:1.0:1789785290.563563:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549136640 00000100:00100000:1.0:1789785290.563569:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549136640 00000100:00100000:0.0:1789785290.563572:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549136000 00000100:00100000:0.0:1789785290.563577:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549136000 00000100:00100000:2.0:1789785290.563583:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84600e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1876725549134976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785290.563590:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789785290.563592:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549136512 00000100:00100000:1.0:1789785290.563595:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549136512 00000100:00100000:0.0:1789785290.563609:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789785290.563615:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549134976:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789785290.563618:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789785290.563622:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789785290.563622:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549136128:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789785290.563624:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789785290.563628:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789785290.563635:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549136640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785290.563653:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785290.563677:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549136128:12345-0@lo:400:kworker.0 Request processed in 59us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785290.563681:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1876725549136384:0@lo:400:kworker.0 00000100:00100000:1.0:1789785290.563681:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549136640:12345-0@lo:400:kworker.0 Request processed in 50us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785290.563694:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789785290.563702:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789785290.563713:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785290.563719:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789785290.563727:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549136000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785290.563739:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549136896:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789785290.563739:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789785290.563751:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549136512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785290.563763:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549136000:12345-0@lo:400:kworker.0 Request processed in 36us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785290.563768:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785290.563769:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789785290.563790:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549136896 00000100:00100000:1.0:1789785290.563793:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549136896 00000100:00100000:2.0:1789785290.563796:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549135360:0@lo:400:kworker.0 00000100:00100000:0.0:1789785290.563801:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549136512:12345-0@lo:400:kworker.0 Request processed in 51us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785290.563808:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789785290.563810:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789785290.563817:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789785290.563818:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549136768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789785290.563824:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549136896:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789785290.563842:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1789785290.563843:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789785290.563848:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549136128:0@lo:400:kworker.0 00000100:00100000:0.0:1789785290.563866:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549136640:0@lo:400:kworker.0 00000100:00100000:2.0:1789785290.563870:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549135872 00000100:00100000:2.0:1789785290.563874:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549135872 00000100:00100000:0.0:1789785290.563881:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549135104:0@lo:400:kworker.0 00000100:00100000:1.0:1789785290.563886:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549136896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785290.563895:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789785290.563898:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549135616:0@lo:400:kworker.0 00000100:00100000:2.0:1789785290.563911:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549136384 00000100:00100000:2.0:1789785290.563915:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549136384 00000100:00100000:1.0:1789785290.563934:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549136000:0@lo:400:kworker.0 00000100:00100000:0.0:1789785290.563934:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549136768 00000100:00100000:0.0:1789785290.563939:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549136768 00000100:00100000:2.0:1789785290.563945:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1789785290.563951:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1876725549135872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785290.563956:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549136512:0@lo:400:kworker.0 00000100:00100000:0.0:1789785290.563975:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789785290.563984:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1876725549135872:12345-0@lo:400:kworker.0 Request processed in 32us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785290.563987:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549136896:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789785290.563988:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549136768:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789785290.563994:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00010000:00080000:1.0:1789785290.564001:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae846a2680 x1876725549135872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:0.0:1789785290.564003:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789785290.564009:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1789785290.564015:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549135872:0@lo:400:kworker.0 00000100:00100000:2.0:1789785290.564018:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1876725549136384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785290.564060:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549136768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789785290.564090:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549135232:0@lo:400:kworker.0 00000100:00100000:1.0:1789785290.564099:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549135744:0@lo:400:kworker.0 00000100:00100000:1.0:1789785290.564107:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549136256:0@lo:400:kworker.0 00000100:00080000:1.0:1789785290.564141:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789785290.564181:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549136768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 197us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785290.564188:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1876725549136384:12345-0@lo:400:kworker.0 Request processed in 169us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785290.564193:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789785290.564200:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00010000:00080000:1.0:1789785290.564237:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae846a0a80 x1876725549136384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785290.564247:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1876725549136384:0@lo:400:kworker.0 00010000:00010000:1.0:1789785290.755092:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785291.779954:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785291.925251:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785291.925383:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530214528 00000100:00100000:3.0:1789785291.925393:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530214528 00000100:00100000:3.0:1789785291.925474:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 66 00000100:00100000:3.0:1789785291.925486:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+18:13189:x1876725530214528:12345-192.168.203.46@tcp:35:umount.0 00000100:00100000:3.0:1789785291.925804:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+19:13189:x1876725530214528:12345-192.168.203.46@tcp:35:umount.0 Request processed in 319us (559us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1789785291.925826:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 66 00000100:00080000:1.0:1789785291.926036:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789785291.932585:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785291.932907:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530214784 00000100:00100000:0.0:1789785291.932916:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530214784 00000100:00100000:0.0:1789785291.933015:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 67 00000100:00100000:0.0:1789785291.933026:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+19:13189:x1876725530214784:12345-192.168.203.46@tcp:35:umount.0 00000100:00100000:0.0:1789785291.933308:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+20:13189:x1876725530214784:12345-192.168.203.46@tcp:35:umount.0 Request processed in 283us (730us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1789785291.933329:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 67 00000100:00100000:0.0:1789785291.935949:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785291.936071:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530215040 00000100:00100000:2.0:1789785291.936080:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530215040 00000100:00100000:2.0:1789785291.936139:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 68 00000100:00100000:2.0:1789785291.936150:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf88771850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+20:13189:x1876725530215040:12345-192.168.203.46@tcp:35:umount.0 00000100:00100000:2.0:1789785291.937895:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf88771850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:026b2112-ee35-499c-8d01-18663664f08e+21:13189:x1876725530215040:12345-192.168.203.46@tcp:35:umount.0 Request processed in 1741us (1947us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1789785291.937906:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 68 00000100:00100000:1.0:1789785291.941901:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785291.942002:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530215296 00000100:00100000:0.0:1789785291.942013:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530215296 00000100:00100000:0.0:1789785291.942070:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 69 00000100:00100000:0.0:1789785291.942081:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+21:13189:x1876725530215296:12345-192.168.203.46@tcp:35:umount.0 00000100:00100000:0.0:1789785291.942400:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:026b2112-ee35-499c-8d01-18663664f08e+22:13189:x1876725530215296:12345-192.168.203.46@tcp:35:umount.0 Request processed in 320us (507us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789785291.942417:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 69 00000100:00100000:0.0:1789785291.947476:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785291.947518:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785291.947576:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785291.950867:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530215424 00000100:00100000:3.0:1789785291.950882:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530215424 00000100:00100000:0.0:1789785291.950939:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785291.950945:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530215680 00000100:00100000:3.0:1789785291.950960:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530215680 00000100:00100000:3.0:1789785291.950978:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530215552 00000100:00100000:0.0:1789785291.950986:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530215808 00000100:00100000:3.0:1789785291.950991:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530215552 00000100:00100000:0.0:1789785291.950993:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530215808 00000100:00100000:3.0:1789785291.951017:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 20 00000100:00100000:3.0:1789785291.951030:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dddf7d7-41ac-477b-b9db-b5e699635211+15:2399:x1876725530215424:12345-192.168.203.46@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789785291.951041:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 81 00010000:00010000:3.0:1789785291.951045:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789785291.951055:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+5:2396:x1876725530215808:12345-192.168.203.46@tcp:9:umount.0 00010000:00010000:3.0:1789785291.951067:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1a64e00/0x2f18ee3fd845c323 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8552 expref: 15 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789785291.951082:0:8450:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c641 00010000:00010000:3.0:1789785291.951087:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1789785291.951092:0:8450:0:(import.c:65:import_set_state_nolock()) ffff9dae83bda800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789785291.951138:0:8450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1789785291.951149:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dddf7d7-41ac-477b-b9db-b5e699635211+14:2399:x1876725530215424:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 122us (3682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785291.951158:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 20 00000100:00100000:3.0:1789785291.951197:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 21 00000100:00100000:3.0:1789785291.951205:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dddf7d7-41ac-477b-b9db-b5e699635211+13:2399:x1876725530215680:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789785291.951214:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785291.951237:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1b08800/0x2f18ee3fd845c576 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd862b expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785291.951248:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785291.951269:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dddf7d7-41ac-477b-b9db-b5e699635211+12:2399:x1876725530215680:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 65us (3750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785291.951278:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:026b2112-ee35-499c-8d01-18663664f08e+2:2396:x1876725530215808:12345-192.168.203.46@tcp:9:umount.0 Request processed in 227us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785291.951288:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 81 00000100:00100000:3.0:1789785291.951299:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 21 00000100:00100000:3.0:1789785291.951318:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 22 00000100:00080000:0.0:1789785291.951324:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789785291.951326:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dddf7d7-41ac-477b-b9db-b5e699635211+11:2399:x1876725530215552:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789785291.951373:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785291.951384:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc2051400/0x2f18ee3fd845c266 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8513 expref: 11 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785291.951395:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785291.951433:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2399:x1876725530215552:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 108us (3856us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785291.951441:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 22 00010000:00010000:3.0:1789785291.951465:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785291.963843:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785291.966288:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530216192 00000100:00100000:0.0:1789785291.966316:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530216192 00000100:00100000:0.0:1789785291.966417:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 82 00000100:00100000:0.0:1789785291.966429:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+7:2396:x1876725530216192:12345-192.168.203.46@tcp:9:umount.0 00000020:00000080:0.0:1789785291.966456:0:8449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c8b7 00000020:00010000:0.0:1789785291.966480:0:8449:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9dafbf43e000: total 0 00000100:00080000:0.0:1789785291.966485:0:8449:0:(import.c:65:import_set_state_nolock()) ffff9dafbf43e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789785291.966529:0:8449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:0.0:1789785291.966706:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:026b2112-ee35-499c-8d01-18663664f08e+5:2396:x1876725530216192:12345-192.168.203.46@tcp:9:umount.0 Request processed in 277us (2869us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785291.966714:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 82 00000020:00010000:3.0:1789785291.967608:0:6521:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9dafbf43e000: total 0 00010000:00010000:3.0:1789785291.967660:0:6521:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9dafbf43e000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1789785291.967726:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005dd45b96/0x2f18ee3fd845cc6f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8815 expref: 4 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785291.967777:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a77e3484/0x2f18ee3fd845d33e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89f8 expref: 3 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785291.967791:0:6521:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9dafbf43e000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1789785291.967804:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785291.967806:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785291.967808:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789785291.967861:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789785291.983827:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785291.988476:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530217216 00000100:00100000:2.0:1789785291.988492:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530217216 00000100:00100000:2.0:1789785291.988565:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 258 00000100:00100000:2.0:1789785291.988577:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+22:2396:x1876725530217216:12345-192.168.203.46@tcp:39:umount.0 00000020:00000080:2.0:1789785291.988611:0:11254:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c274 00000020:00010000:2.0:1789785291.988639:0:11254:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9dae8397b000: total 0 00000100:00080000:2.0:1789785291.988644:0:11254:0:(import.c:65:import_set_state_nolock()) ffff9dae8397d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789785291.988684:0:11254:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:2.0:1789785291.989150:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:026b2112-ee35-499c-8d01-18663664f08e+21:2396:x1876725530217216:12345-192.168.203.46@tcp:39:umount.0 Request processed in 574us (5330us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1789785291.989228:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 258 00000020:00010000:3.0:1789785291.989330:0:6522:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9dae8397b000: total 0 00010000:00010000:3.0:1789785291.989425:0:6522:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9dae8397b000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1789785291.989469:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:3.0:1789785291.989472:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789785291.989481:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64a00/0x2f18ee3fd845cb50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd87c8 expref: 20 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785291.989502:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dae827c0300) 00010000:00010000:3.0:1789785291.989504:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789785291.989508:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64c00/0x2f18ee3fd845c5a0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8639 expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785291.989527:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:3.0:1789785291.989530:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789785291.989533:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba800/0x2f18ee3fd845ccf4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8838 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785291.989546:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:3.0:1789785291.989548:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789785291.989551:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba000/0x2f18ee3fd845d2ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89e3 expref: 17 pid: 11254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785291.989563:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:3.0:1789785291.989565:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789785291.989569:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dae81ead400/0x2f18ee3fd845d329 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89f1 expref: 16 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785291.989580:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:3.0:1789785291.989582:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789785291.989586:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845c617 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8655 expref: 15 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785291.989610:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dae82670800) 00010000:00010000:3.0:1789785291.989623:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789785291.989627:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb600/0x2f18ee3fd845cfe1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8911 expref: 14 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785291.989643:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dae827c3c00) 00010000:00010000:3.0:1789785291.989645:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789785291.989649:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1a64400/0x2f18ee3fd845ccd8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8831 expref: 13 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785291.989661:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9daf87d6e700) 00010000:00010000:3.0:1789785291.989663:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785291.989822:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08200/0x2f18ee3fd845c5bc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8640 expref: 12 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785291.993871:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:2.0:1789785291.993880:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789785291.993891:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb400/0x2f18ee3fd845cc30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8800 expref: 11 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785291.993918:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dae827c3000) 00010000:00010000:2.0:1789785291.993920:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789785291.993924:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55a00/0x2f18ee3fd845cc5a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd880e expref: 10 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785291.993942:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dafc21de000) 00010000:00010000:2.0:1789785291.993945:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789785291.993948:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb5d55600/0x2f18ee3fd845c912 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd872e expref: 9 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785291.993963:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dae827bdb00) 00010000:00010000:2.0:1789785291.993965:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789785291.993968:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030e00/0x2f18ee3fd845d21f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89ab expref: 8 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785291.993980:0:6522:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9dae8397b000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1789785291.994016:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785291.994019:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785291.994022:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785292.004778:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785292.005512:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530217344 00000100:00100000:1.0:1789785292.005522:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530217344 00000100:00100000:1.0:1789785292.005598:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 259 00000100:00100000:1.0:1789785292.005621:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+5:2396:x1876725530217344:12345-192.168.203.46@tcp:39:umount.0 00000020:00000080:1.0:1789785292.005654:0:7896:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c27b 00000100:00080000:1.0:1789785292.005684:0:7896:0:(import.c:65:import_set_state_nolock()) ffff9dae839e8000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789785292.005711:0:7896:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789785292.005896:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:026b2112-ee35-499c-8d01-18663664f08e+3:2396:x1876725530217344:12345-192.168.203.46@tcp:39:umount.0 Request processed in 277us (1127us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789785292.005904:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 259 00000100:00080000:0.0:1789785292.006056:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789785292.006812:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785292.098697:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549137024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789785292.098765:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785292.098842:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789785292.098848:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549137152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789785292.098874:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785292.098984:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549137152 00000100:00100000:3.0:1789785292.098992:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549137152 00000100:00100000:0.0:1789785292.098998:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549137024 00000100:00100000:0.0:1789785292.099002:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549137024 00000100:00100000:0.0:1789785292.099043:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789785292.099050:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789785292.099051:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549137024:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789785292.099057:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549137152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789785292.099078:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000004:00000024:0.0:1789785292.099078:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789785292.099279:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549137024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 228us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785292.099286:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:1.0:1789785292.099772:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789785292.099789:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf87816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549137280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789785292.099820:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785292.099897:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549137280 00000100:00100000:2.0:1789785292.099902:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549137280 00000100:00100000:2.0:1789785292.099936:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789785292.099956:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549137280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789785292.099969:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789785292.100006:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549137280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785292.100012:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:0.0:1789785292.102398:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789785292.102471:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf87816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549137280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789785292.126358:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549137152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 27278us (27459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785292.126372:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789785292.127166:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549137152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789785292.127199:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549137024:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789785292.802682:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785293.828759:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789785294.018601:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789785294.018613:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789785294.018731:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1789785294.018740:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789785294.112256:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785294.112297:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785294.112359:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785294.112454:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530217600 00000100:00100000:2.0:1789785294.112465:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530217600 00000100:00100000:2.0:1789785294.112531:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530217728 00000100:00100000:2.0:1789785294.112535:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530217728 00000100:00100000:2.0:1789785294.112551:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530217472 00000100:00100000:2.0:1789785294.112553:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530217472 00000100:00100000:2.0:1789785294.112569:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 23 00000100:00100000:2.0:1789785294.112580:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dddf7d7-41ac-477b-b9db-b5e699635211+12:2397:x1876725530217600:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789785294.112596:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785294.112615:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dae81ead600/0x2f18ee3fd845c37e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8598 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785294.112631:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785294.112682:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dddf7d7-41ac-477b-b9db-b5e699635211+11:2397:x1876725530217600:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 103us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785294.112689:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 23 00000100:00100000:2.0:1789785294.112705:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 24 00000100:00100000:2.0:1789785294.112712:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dddf7d7-41ac-477b-b9db-b5e699635211+10:2397:x1876725530217728:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789785294.112721:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785294.112730:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1b08000/0x2f18ee3fd845c56f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8624 expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785294.112757:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785294.112777:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dddf7d7-41ac-477b-b9db-b5e699635211+9:2397:x1876725530217728:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 65us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785294.112784:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 24 00000100:00100000:2.0:1789785294.112797:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 25 00000100:00100000:2.0:1789785294.112804:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9ea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dddf7d7-41ac-477b-b9db-b5e699635211+8:2397:x1876725530217472:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789785294.112812:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785294.112821:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc2050000/0x2f18ee3fd845c377 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8567 expref: 8 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785294.112831:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785294.112849:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9ea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dddf7d7-41ac-477b-b9db-b5e699635211+7:2397:x1876725530217472:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 46us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785294.112856:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 25 00000100:00100000:1.0:1789785294.129671:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785294.129779:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530217984 00000100:00100000:2.0:1789785294.129789:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530217984 00000100:00100000:2.0:1789785294.129861:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 260 00000100:00100000:2.0:1789785294.129872:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae844c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12a32a3b-e9e7-466a-b40d-7d74895946de+6:2396:x1876725530217984:12345-192.168.203.46@tcp:39:umount.0 00000020:00000080:2.0:1789785294.129910:0:6534:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c38c 00000020:00010000:2.0:1789785294.129918:0:6534:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9dae836fe000: total 0 00000100:00080000:2.0:1789785294.129923:0:6534:0:(import.c:65:import_set_state_nolock()) ffff9dae836f8000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789785294.129959:0:6534:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:3.0:1789785294.130017:0:9538:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9dae836fe000: total 0 00010000:00010000:3.0:1789785294.130029:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785294.130097:0:9538:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9dae836fe000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789785294.130140:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dae827c3c00) 00010000:00010000:3.0:1789785294.130144:0:9538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789785294.130152:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bbe00/0x2f18ee3fd845d34c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd89ff expref: 7 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785294.130177:0:9538:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9dae836fe000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789785294.130190:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785294.130192:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785294.130195:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789785294.130261:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789785294.130386:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae844c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12a32a3b-e9e7-466a-b40d-7d74895946de+3:2396:x1876725530217984:12345-192.168.203.46@tcp:39:umount.0 Request processed in 515us (723us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1789785294.130409:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 260 00000100:00100000:0.0:1789785294.145888:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785294.145986:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530218112 00000100:00100000:2.0:1789785294.145995:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530218112 00000100:00080000:0.0:1789785294.146152:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789785294.146180:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 261 00000100:00100000:2.0:1789785294.146190:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12a32a3b-e9e7-466a-b40d-7d74895946de+5:2396:x1876725530218112:12345-192.168.203.46@tcp:39:umount.0 00000020:00000080:2.0:1789785294.146237:0:11254:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c393 00000100:00080000:2.0:1789785294.146438:0:11254:0:(import.c:65:import_set_state_nolock()) ffff9dae836fc800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789785294.146522:0:11254:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789785294.146694:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12a32a3b-e9e7-466a-b40d-7d74895946de+3:2396:x1876725530218112:12345-192.168.203.46@tcp:39:umount.0 Request processed in 505us (814us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789785294.146702:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 261 00010000:00010000:3.0:1789785294.148790:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785294.192240:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785294.192386:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530218368 00000100:00100000:2.0:1789785294.192405:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530218368 00000100:00100000:2.0:1789785294.192479:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 400 00000100:00100000:2.0:1789785294.192490:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+7:2396:x1876725530218368:12345-192.168.203.46@tcp:251:umount.0 00000020:00000080:2.0:1789785294.192539:0:6526:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c251 00000020:00010000:2.0:1789785294.192546:0:6526:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9dae839eb000: total 0 00000100:00080000:2.0:1789785294.192551:0:6526:0:(import.c:65:import_set_state_nolock()) ffff9dae839ef800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789785294.192628:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dddf7d7-41ac-477b-b9db-b5e699635211+3:2396:x1876725530218368:12345-192.168.203.46@tcp:251:umount.0 Request processed in 140us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785294.192636:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 400 00000020:00010000:3.0:1789785294.192986:0:6522:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9dae839eb000: total 0 00010000:00010000:3.0:1789785294.193037:0:6522:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9dae839eb000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789785294.193116:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1a65a00/0x2f18ee3fd845c32a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8559 expref: 2 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785294.193131:0:6522:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9dae839eb000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789785294.193143:0:6522:0:(genops.c:885:class_export_put()) final put ffff9dae839eb000/0dddf7d7-41ac-477b-b9db-b5e699635211 00010000:00010000:3.0:1789785294.193159:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785294.193161:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785294.193163:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789785294.193199:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae839eb000/0dddf7d7-41ac-477b-b9db-b5e699635211 for MGS 00000020:00000080:2.0:1789785294.194919:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dae839ef800 for MGS 00000040:00080000:3.0:1789785294.660292:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789785294.861796:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785295.682471:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549137536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789785295.682539:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785295.682586:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549137408:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789785295.682611:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785295.682657:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549137536 00000100:00100000:3.0:1789785295.682674:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549137536 00000100:00100000:1.0:1789785295.682717:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549137664:0@lo:400:kworker.0 00000100:00100000:3.0:1789785295.682721:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789785295.682729:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549137536:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789785295.682750:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789785295.682756:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785295.682787:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1876725549138176:0@lo:400:kworker.0 00000100:00100000:3.0:1789785295.682791:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549137536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785295.682798:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789785295.682810:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789785295.682818:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789785295.682827:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1876725549138688:0@lo:400:kworker.0 00000100:00100000:3.0:1789785295.682828:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1876725549138048:0@lo:400:kworker.0 00000100:00100000:1.0:1789785295.682846:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785295.682869:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789785295.682875:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549138176 00000100:00100000:1.0:1789785295.682875:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725549137792:0@lo:400:kworker.0 00000100:00100000:3.0:1789785295.682878:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549138176 00000100:00100000:1.0:1789785295.682896:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785295.682971:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725549138304:0@lo:400:kworker.0 00000100:00100000:1.0:1789785295.682991:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785295.683036:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549137408 00000100:00100000:2.0:1789785295.683040:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549137408 00000100:00100000:2.0:1789785295.683067:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789785295.683074:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549137408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789785295.683096:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789785295.683141:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549137408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785295.683171:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789785295.683290:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549137664 00000100:00100000:0.0:1789785295.683299:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549137664 00000100:00100000:0.0:1789785295.683329:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1789785295.683359:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:3661:x1876725549137664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785295.683423:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e00759f-51ad-47f9-8892-382c83919083+24:3661:x1876725549137664:12345-0@lo:400:kworker.0 Request processed in 85us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785295.683429:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1789785295.683458:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549138688 00000100:00100000:3.0:1789785295.683462:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549138688 00000100:00100000:1.0:1789785295.683477:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549138816:0@lo:400:kworker.0 00000100:00100000:3.0:1789785295.683481:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549137792 00000100:00100000:3.0:1789785295.683483:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549137792 00000100:00100000:3.0:1789785295.683493:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549138304 00000100:00100000:3.0:1789785295.683495:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549138304 00000100:00100000:3.0:1789785295.683510:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1789785295.683516:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1876725549138176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785295.683549:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1876725549138176:12345-0@lo:400:kworker.0 Request processed in 33us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785295.683555:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1789785295.683567:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1789785295.683573:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1876725549138688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785295.683599:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1876725549138688:12345-0@lo:400:kworker.0 Request processed in 26us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785295.683603:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785295.683605:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1789785295.683615:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549138816 00000100:00100000:3.0:1789785295.683622:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549138816 00000100:00100000:1.0:1789785295.683625:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549137664:0@lo:400:kworker.0 00000100:00100000:1.0:1789785295.683637:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1876725549138176:0@lo:400:kworker.0 00000100:00100000:3.0:1789785295.683638:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1789785295.683643:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725549137792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785295.683645:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1876725549138688:0@lo:400:kworker.0 00000100:00100000:3.0:1789785295.683667:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725549137792:12345-0@lo:400:kworker.0 Request processed in 24us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785295.683670:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725549137792:0@lo:400:kworker.0 00000100:00100000:3.0:1789785295.683673:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1789785295.683683:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1789785295.683688:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1789785295.683689:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725549138304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785295.683694:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549138816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785295.683719:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1876725549138304:12345-0@lo:400:kworker.0 Request processed in 30us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785295.683719:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549138816:12345-0@lo:400:kworker.0 Request processed in 24us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785295.683724:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1789785295.683739:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1789785295.683764:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae844c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549137920:0@lo:400:kworker.0 00000100:00100000:0.0:1789785295.683791:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785295.683810:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549138432:0@lo:400:kworker.0 00000100:00100000:0.0:1789785295.683831:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785295.683853:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549138432 00000100:00100000:1.0:1789785295.683860:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549138432 00000100:00100000:0.0:1789785295.683861:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549138944:0@lo:400:kworker.0 00000100:00100000:0.0:1789785295.683880:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785295.683887:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549138944 00000100:00100000:1.0:1789785295.683889:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549138944 00000100:00100000:0.0:1789785295.683898:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789785295.683903:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549139072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789785295.683907:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789785295.683912:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549138432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785295.683922:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785295.683939:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549138432:12345-0@lo:400:kworker.0 Request processed in 27us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785295.683943:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549138432:0@lo:400:kworker.0 00000100:00100000:1.0:1789785295.683946:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789785295.683957:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789785295.683963:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549138944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785295.683966:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549137920 00000100:00100000:0.0:1789785295.683968:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549137920 00000100:00100000:0.0:1789785295.683991:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789785295.683992:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549138944:12345-0@lo:400:kworker.0 Request processed in 30us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785295.683997:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549137920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785295.683998:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789785295.684038:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549137920:12345-0@lo:400:kworker.0 Request processed in 42us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785295.684044:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789785295.684075:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549137920:0@lo:400:kworker.0 00000100:00100000:0.0:1789785295.684084:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549138944:0@lo:400:kworker.0 00000100:00100000:3.0:1789785295.684149:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549139072 00000100:00100000:3.0:1789785295.684153:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549139072 00000100:00100000:3.0:1789785295.684182:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789785295.684188:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549139072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789785295.684200:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789785295.684241:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549139072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785295.684247:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:3.0:1789785295.684263:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789785295.684267:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789785295.684269:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789785295.684271:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789785295.684280:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785295.684300:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549138560:0@lo:400:kworker.0 00000100:00100000:3.0:1789785295.684320:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785295.684368:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549137536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789785295.684400:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae844c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549137408:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789785295.684423:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549138048 00000100:00100000:3.0:1789785295.684426:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549138048 00000100:00100000:3.0:1789785295.684448:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1789785295.684454:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1876725549138048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785295.684487:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1876725549138048:12345-0@lo:400:kworker.0 Request processed in 33us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785295.684492:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1789785295.684509:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549138560 00000100:00100000:3.0:1789785295.684513:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549138560 00000100:00100000:3.0:1789785295.684536:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789785295.684541:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549138560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785295.684566:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549138560:12345-0@lo:400:kworker.0 Request processed in 25us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785295.684572:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:3.0:1789785295.684584:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789785295.684599:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1876725549138048:0@lo:400:kworker.0 00000100:00100000:3.0:1789785295.684608:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549138560:0@lo:400:kworker.0 00010000:00080000:3.0:1789785295.684632:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae84786a00 x1876725549138304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785295.684643:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1876725549138304:0@lo:400:kworker.0 00010000:00080000:3.0:1789785295.684652:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb113df80 x1876725549138816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785295.684660:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549138816:0@lo:400:kworker.0 00000100:00100000:1.0:1789785295.685191:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549139072:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789785295.877074:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789785295.961691:0:15218:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1789785295.996513:0:15218:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789785295.996573:0:15218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf829d3000/0x2f18ee3fd845c2f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c300 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785295.996588:0:15218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf829d3000/0x2f18ee3fd845c2f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c300 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785295.996596:0:15218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf829d3000/0x2f18ee3fd845c2f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c300 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785295.996604:0:15218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff9daf829d3000/0x2f18ee3fd845c2f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c300 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785295.996619:0:15218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789785295.996624:0:15218:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1789785295.996640:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789785295.996648:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9daf829d3000/0x2f18ee3fd845c2f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c300 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789785295.996651:0:15218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789785295.996658:0:15218:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:3.0:1789785295.996660:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf829d3000 already unused, calling callback (ffffffffc12b7c20) 00000100:00080000:2.0:1789785295.996664:0:15218:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 10000000:00010000:3.0:1789785295.996665:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9daf829d3000/0x2f18ee3fd845c2f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c300 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785295.996676:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9daf829d3000/0x2f18ee3fd845c2f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f18ee3fd845c300 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789785295.996684:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9daf829d3000/0x2f18ee3fd845c2f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f18ee3fd845c300 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789785295.996689:0:15218:0:(import.c:65:import_set_state_nolock()) ffff9dafc18fb800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:01000000:3.0:1789785295.996690:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789785295.996696:0:6522:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789785295.996698:0:6522:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789785295.996726:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9daf829d3000/0x2f18ee3fd845c2f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f18ee3fd845c300 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785295.996734:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789785295.996765:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9daf829d3000/0x2f18ee3fd845c2f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f18ee3fd845c300 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785295.996774:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf87814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1876725549139200:0@lo:39:umount.0 00010000:00010000:3.0:1789785295.996776:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9daf829d3000/0x2f18ee3fd845c2f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f18ee3fd845c300 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785295.996793:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785295.996794:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785295.996796:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785295.996816:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789785295.996829:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549139328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789785295.996860:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785295.996873:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785295.997171:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549139200 00000100:00100000:3.0:1789785295.997177:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549139200 00000100:00100000:3.0:1789785295.997248:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789785295.997259:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1876725549139200:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789785295.997285:0:6535:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845be68 00000100:00080000:3.0:1789785295.997295:0:6535:0:(import.c:65:import_set_state_nolock()) ffff9dafb11ec800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789785295.997395:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3658:x1876725549139200:12345-0@lo:39:umount.0 Request processed in 138us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785295.997404:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1789785295.997414:0:6535:0:(genops.c:885:class_export_put()) final put ffff9daf8774a000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1789785295.997443:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549139328 00000100:00100000:3.0:1789785295.997447:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549139328 00000020:00000080:2.0:1789785295.997450:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9daf8774a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1789785295.997485:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789785295.997494:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+24:3662:x1876725549139328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789785295.997505:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:2.0:1789785295.997505:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dafb11ec800 for lustre-MDT0000 00010000:00010000:3.0:1789785295.997524:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dae81eade00/0x2f18ee3fd845c300 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f18ee3fd845c2f9 expref: 24 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785295.997538:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785295.999693:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e00759f-51ad-47f9-8892-382c83919083+23:3662:x1876725549139328:12345-0@lo:103:ldlm_bl.0 Request processed in 2194us (2815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785295.999706:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1789785295.999740:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789785295.999775:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dafc18fb800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789785295.999788:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf87814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1876725549139200:0@lo:39:umount.0 00000100:00100000:2.0:1789785295.999819:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549139328:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789785295.999847:0:15218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789785295.999851:0:15218:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789785295.999855:0:15218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789785296.000971:0:15218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eac200/0x2f18ee3fd845c307 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c30e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785296.000985:0:15218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eac200/0x2f18ee3fd845c307 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c30e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785296.000993:0:15218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eac200/0x2f18ee3fd845c307 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c30e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785296.001001:0:15218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff9dae81eac200/0x2f18ee3fd845c307 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c30e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785296.001021:0:15218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789785296.001027:0:15218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc2051000/0x2f18ee3fd845c20b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c212 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785296.001034:0:15218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc2051000/0x2f18ee3fd845c20b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c212 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785296.001040:0:15218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc2051000/0x2f18ee3fd845c20b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c212 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785296.001043:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789785296.001047:0:15218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff9dafc2051000/0x2f18ee3fd845c20b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c212 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785296.001059:0:15218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789785296.001069:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789785296.001069:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dae81eac200/0x2f18ee3fd845c307 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c30e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785296.001076:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc2051000/0x2f18ee3fd845c20b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c212 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785296.001082:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eac200 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:2.0:1789785296.001088:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dae81eac200/0x2f18ee3fd845c307 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c30e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785296.001109:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc2051000 already unused, calling callback (ffffffffc12b7c20) 00010000:00010000:2.0:1789785296.001109:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dae81eac200/0x2f18ee3fd845c307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f18ee3fd845c30e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789785296.001114:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc2051000/0x2f18ee3fd845c20b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c212 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789785296.001125:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dae81eac200/0x2f18ee3fd845c307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f18ee3fd845c30e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785296.001128:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc2051000/0x2f18ee3fd845c20b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f18ee3fd845c212 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785296.001144:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:3.0:1789785296.001145:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc2051000/0x2f18ee3fd845c20b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f18ee3fd845c212 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785296.001150:0:6521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1789785296.001155:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789785296.001158:0:6522:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789785296.001161:0:6522:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789785296.001186:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc2051000/0x2f18ee3fd845c20b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f18ee3fd845c212 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785296.001186:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dae81eac200/0x2f18ee3fd845c307 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f18ee3fd845c30e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785296.001204:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789785296.001227:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc2051000/0x2f18ee3fd845c20b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f18ee3fd845c212 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785296.001246:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc2051000/0x2f18ee3fd845c20b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f18ee3fd845c212 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785296.001259:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785296.001263:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789785296.001264:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785296.001269:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785296.001282:0:15218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c561 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c568 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785296.001289:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dae81eac200/0x2f18ee3fd845c307 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f18ee3fd845c30e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785296.001291:0:15218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c561 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c568 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785296.001299:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dae81eac200/0x2f18ee3fd845c307 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f18ee3fd845c30e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785296.001310:0:15218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c561 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c568 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785296.001318:0:15218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c561 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c568 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785296.001320:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785296.001325:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785296.001331:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789785296.001357:0:15218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789785296.001360:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c561 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c568 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785296.001368:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785296.001391:0:15218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf829d3e00/0x2f18ee3fd845bdc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845bdce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785296.001399:0:15218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf829d3e00/0x2f18ee3fd845bdc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845bdce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785296.001406:0:15218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf829d3e00/0x2f18ee3fd845bdc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845bdce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785296.001411:0:15218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff9daf829d3e00/0x2f18ee3fd845bdc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845bdce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785296.001422:0:15218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789785296.001426:0:15218:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1789785296.001429:0:15218:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1789785296.001438:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc21ca200 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:2.0:1789785296.001442:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c561 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c568 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785296.001450:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c561 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f18ee3fd845c568 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789785296.001457:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c561 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f18ee3fd845c568 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785296.001463:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789785296.001466:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1789785296.001466:0:6521:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789785296.001468:0:6521:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789785296.001472:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9daf829d3e00/0x2f18ee3fd845bdc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845bdce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785296.001481:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf829d3e00 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:3.0:1789785296.001485:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9daf829d3e00/0x2f18ee3fd845bdc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845bdce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785296.001487:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c561 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f18ee3fd845c568 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785296.001504:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789785296.001509:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9daf829d3e00/0x2f18ee3fd845bdc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f18ee3fd845bdce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785296.001513:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c561 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f18ee3fd845c568 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789785296.001520:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9daf829d3e00/0x2f18ee3fd845bdc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f18ee3fd845bdce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785296.001526:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca200/0x2f18ee3fd845c561 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f18ee3fd845c568 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785296.001530:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789785296.001535:0:6522:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789785296.001538:0:6522:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789785296.001542:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785296.001546:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785296.001547:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785296.001554:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9daf829d3e00/0x2f18ee3fd845bdc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f18ee3fd845bdce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785296.001557:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1789785296.001565:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789785296.001573:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9daf829d3e00/0x2f18ee3fd845bdc7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f18ee3fd845bdce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785296.001579:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9daf829d3e00/0x2f18ee3fd845bdc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f18ee3fd845bdce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785296.001585:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549139584:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789785296.001592:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785296.001595:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785296.001597:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789785296.001610:0:15218:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1789785296.001614:0:15218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1789785296.001618:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789785296.001623:0:15218:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1789785296.001629:0:15218:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9dae81ecf000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789785296.001635:0:15218:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9dae8254a000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789785296.001640:0:15218:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9dafbb1e1800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:2.0:1789785296.001650:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789785296.001655:0:15218:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9dafba56e800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1789785296.001666:0:15218:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9dae836fe000 12a32a3b-e9e7-466a-b40d-7d74895946de 192.168.203.46@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789785296.001672:0:15218:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9dae8397b000 026b2112-ee35-499c-8d01-18663664f08e 192.168.203.46@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:3.0:1789785296.001678:0:15218:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9dafb11dcd28) has exports, disconnecting them 00000020:00080000:3.0:1789785296.001683:0:15218:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dae81ecf000), last request at 1789785295 00000020:00000080:3.0:1789785296.001690:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c186 00000100:00080000:3.0:1789785296.001705:0:15218:0:(import.c:65:import_set_state_nolock()) ffff9dae81ecd800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789785296.001722:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549139840:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789785296.001742:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789785296.001754:0:15218:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dae81ecf000): rc 0 00000020:00000080:3.0:1789785296.001756:0:15218:0:(genops.c:885:class_export_put()) final put ffff9dae81ecf000/lustre-MDT0000-lwp-OST0001_UUID 00000100:00100000:2.0:1789785296.002054:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785296.002087:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf87815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549139456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789785296.002111:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785296.002127:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789785296.002132:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf87814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549139712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789785296.002150:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789785296.002176:0:15218:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dae8254a000), last request at 1789785295 00000100:00100000:2.0:1789785296.002178:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549139584 00000020:00000080:3.0:1789785296.002181:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c052 00000100:00100000:2.0:1789785296.002186:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549139584 00000100:00080000:3.0:1789785296.002189:0:15218:0:(import.c:65:import_set_state_nolock()) ffff9dae8254b800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789785296.002203:0:15218:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dae8254a000): rc 0 00000020:00000080:3.0:1789785296.002205:0:15218:0:(genops.c:885:class_export_put()) final put ffff9dae8254a000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1789785296.002209:0:15218:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dafbb1e1800), last request at 1789785056 00000020:00000080:3.0:1789785296.002212:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845bf4f 00000100:00080000:3.0:1789785296.002215:0:15218:0:(import.c:65:import_set_state_nolock()) ffff9dafbb1e4000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789785296.002225:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789785296.002284:0:15218:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dafbb1e1800): rc 0 00000020:00000080:3.0:1789785296.002287:0:15218:0:(genops.c:885:class_export_put()) final put ffff9dafbb1e1800/lustre-MDT0000-lwp-MDT0001_UUID 00000100:00100000:2.0:1789785296.002287:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549139840 00000100:00100000:2.0:1789785296.002293:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549139840 00000020:00080000:3.0:1789785296.002297:0:15218:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dafba56e800), last request at 1789785056 00000020:00000080:3.0:1789785296.002301:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845bf17 00000100:00080000:3.0:1789785296.002306:0:15218:0:(import.c:65:import_set_state_nolock()) ffff9dafbb1e2000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789785296.002311:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549139456 00000100:00100000:2.0:1789785296.002315:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549139456 00010000:00010000:3.0:1789785296.002316:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1789785296.002324:0:15218:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:2.0:1789785296.002329:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549139712 00000100:00100000:2.0:1789785296.002332:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549139712 00000100:00100000:2.0:1789785296.002373:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000020:00080000:3.0:1789785296.002429:0:15218:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dafba56e800): rc 0 00000100:00100000:2.0:1789785296.002451:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87817b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e00759f-51ad-47f9-8892-382c83919083+26:3661:x1876725549139584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789785296.002463:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785296.002477:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dae81ead800/0x2f18ee3fd845c212 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f18ee3fd845c20b expref: 26 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785296.002492:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00000080:3.0:1789785296.002496:0:15218:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa9f301debae0 00000100:00080000:3.0:1789785296.002517:0:15218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789785296.002520:0:15218:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:2.0:1789785296.002530:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87817b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e00759f-51ad-47f9-8892-382c83919083+25:3661:x1876725549139584:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785296.002538:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789785296.002553:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789785296.002559:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87814e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e00759f-51ad-47f9-8892-382c83919083+24:3661:x1876725549139840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789785296.002565:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785296.002580:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc21cb000/0x2f18ee3fd845bdce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f18ee3fd845bdc7 expref: 24 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785296.002591:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785296.002614:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87814e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e00759f-51ad-47f9-8892-382c83919083+23:3661:x1876725549139840:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785296.002620:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789785296.002632:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789785296.002639:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87816d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e00759f-51ad-47f9-8892-382c83919083+22:3659:x1876725549139456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789785296.002647:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785296.002656:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9daf829d2400/0x2f18ee3fd845c30e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f18ee3fd845c307 expref: 22 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785296.002666:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785296.002690:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87816d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e00759f-51ad-47f9-8892-382c83919083+21:3659:x1876725549139456:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785296.002803:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789785296.002818:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789785296.002824:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87815c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e00759f-51ad-47f9-8892-382c83919083+20:3659:x1876725549139712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789785296.002832:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785296.002840:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc2051e00/0x2f18ee3fd845c568 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f18ee3fd845c561 expref: 20 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785296.002851:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785296.002874:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87815c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e00759f-51ad-47f9-8892-382c83919083+19:3659:x1876725549139712:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785296.002881:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000020:00000080:0.0:1789785296.002894:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae81ecf000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:2.0:1789785296.002928:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf87814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549139712:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789785296.002938:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae8254a000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:2.0:1789785296.003012:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf87815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549139456:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789785296.003022:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafbb1e1800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000100:00100000:2.0:1789785296.003049:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549139840:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789785296.003052:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dae81ecd800 for lustre-MDT0000 00000020:00000080:0.0:1789785296.003059:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dae8254b800 for lustre-MDT0000 00000100:00100000:2.0:1789785296.003060:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549139584:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789785296.003064:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dafbb1e4000 for lustre-MDT0000 00010000:00010000:2.0:1789785296.003084:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789785296.003517:0:15218:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789785296.003534:0:15218:0:(import.c:65:import_set_state_nolock()) ffff9daf98373800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789785296.003745:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549139968:0@lo:39:umount.0 00000100:00100000:2.0:1789785296.003785:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785296.003851:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549139968 00000100:00100000:3.0:1789785296.003857:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549139968 00000100:00100000:3.0:1789785296.003899:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789785296.003908:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1876725549139968:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789785296.003986:0:7899:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845bfaa 00000100:00080000:3.0:1789785296.003993:0:7899:0:(import.c:65:import_set_state_nolock()) ffff9daf98025800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789785296.004015:0:7899:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:2.0:1789785296.004023:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785296.004135:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3658:x1876725549139968:12345-0@lo:39:umount.0 Request processed in 227us (348us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789785296.004142:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:2.0:1789785296.004163:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9daf98373800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789785296.004173:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549139968:0@lo:39:umount.0 00000100:00080000:3.0:1789785296.010236:0:15218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789785296.010244:0:15218:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 3 00000004:00080000:3.0:1789785296.010422:0:15218:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789785296.010492:0:15218:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789785296.010524:0:15218:0:(import.c:65:import_set_state_nolock()) ffff9dae829b3000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789785296.010547:0:15218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789785296.010550:0:15218:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1789785296.010563:0:15218:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789785296.010566:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549140096:0@lo:9:umount.0 00000100:00100000:2.0:1789785296.010639:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789785296.010731:0:15218:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789785296.010743:0:15218:0:(import.c:65:import_set_state_nolock()) ffff9dafb5ec4000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789785296.010787:0:15218:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9dafb11dcd28) has no exports 00000100:00100000:2.0:1789785296.010796:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549140224:0@lo:9:umount.0 00000100:00100000:2.0:1789785296.010824:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785296.010866:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549140096 00000100:00100000:2.0:1789785296.010874:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549140096 00000100:00100000:2.0:1789785296.010917:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549140224 00000100:00100000:2.0:1789785296.010920:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549140224 00000100:00100000:2.0:1789785296.011011:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789785296.011020:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1876725549140096:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789785296.011057:0:8450:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c0fa 00000100:00080000:2.0:1789785296.011064:0:8450:0:(import.c:65:import_set_state_nolock()) ffff9dafba56a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789785296.011104:0:8450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:3.0:1789785296.011112:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789785296.011123:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1876725549140224:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789785296.011151:0:8451:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c23c 00000100:00080000:3.0:1789785296.011157:0:8451:0:(import.c:65:import_set_state_nolock()) ffff9dae839e9000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789785296.011193:0:8451:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1789785296.011241:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3658:x1876725549140096:12345-0@lo:9:umount.0 Request processed in 221us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785296.011259:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789785296.011303:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3658:x1876725549140224:12345-0@lo:9:umount.0 Request processed in 181us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785296.011312:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:2.0:1789785296.011321:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789785296.011370:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dafb5ec4000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789785296.011376:0:3658:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789785296.011392:0:3658:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789785296.011397:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549140224:0@lo:9:umount.0 00000100:00080000:2.0:1789785296.011413:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dae829b3000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789785296.011662:0:3658:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789785296.011667:0:3658:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789785296.011671:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549140096:0@lo:9:umount.0 00010000:00010000:2.0:1789785296.011754:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789785296.022937:0:15218:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9dafb11dcd28) has no exports 00000020:00000080:0.0:1789785296.135498:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845be22 00000020:00000080:0.0:1789785296.135514:0:15218:0:(genops.c:885:class_export_put()) final put ffff9dafc18fc000/lustre-QMT0000_UUID 00000020:01000000:0.0:1789785296.135537:0:15218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789785296.135583:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafc18fc000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789785296.135611:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789785296.135620:0:15218:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789785296.135625:0:15218:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9daf983fb370) has no exports 00000020:00000080:2.0:1789785296.136758:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845be1b 00000020:00000080:2.0:1789785296.136766:0:15218:0:(genops.c:885:class_export_put()) final put ffff9dafb1135800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789785296.136804:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafb1135800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789785296.136830:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789785296.136840:0:15218:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789785296.136843:0:15218:0:(genops.c:885:class_export_put()) final put ffff9dafb1136000/lustre-QMT0000_UUID 00000020:00000080:2.0:1789785296.136845:0:15218:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafb1136000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789785296.136852:0:15218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1789785296.899100:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785297.227281:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549140352:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789785297.227386:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785297.227788:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789785297.227799:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549140480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789785297.227834:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785297.227914:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549140352 00000100:00100000:0.0:1789785297.227922:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549140352 00000100:00100000:0.0:1789785297.227966:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789785297.227974:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3662:x1876725549140352:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1789785297.227982:0:6538:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789785297.228027:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3662:x1876725549140352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (641us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789785297.228034:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:02020000:0.0:1789785297.228071:0:3662:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:3.0:1789785297.228565:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549140480 00000100:00100000:3.0:1789785297.228570:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549140480 00000100:00100000:3.0:1789785297.228629:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789785297.228638:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549140480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789785297.228663:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00080000:1.0:1789785297.231163:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789785297.231325:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549140480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2684us (3486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785297.231350:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789785297.231525:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549140480:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789785297.235670:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789785297.235678:0:3662:0:(import.c:65:import_set_state_nolock()) ffff9dafbb228800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789785297.235683:0:3662:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789785297.244905:0:3662:0:(import.c:65:import_set_state_nolock()) ffff9dafbb228800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789785297.244917:0:3662:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 164 00000100:00080000:0.0:1789785297.244927:0:3662:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dafbb228800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:0.0:1789785297.245008:0:3662:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafaca24380 x1876725549140608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789785297.245124:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549140608:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1789785297.245184:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785297.245576:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549140608 00000100:00100000:3.0:1789785297.245584:0:7899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549140608 00000100:00100000:3.0:1789785297.245619:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789785297.245628:0:7899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3658:x1876725549140608:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1789785297.245645:0:7899:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789785297.250592:0:7899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3658:x1876725549140608:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 4958us (5401us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789785297.250607:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:2.0:1789785297.250931:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dafbb228800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789785297.250949:0:3658:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789785297.250954:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549140608:0@lo:38:ptlrpcd_00_03.0 00000001:00100000:0.0:1789785297.742014:0:6512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789785297.742024:0:6512:0:(genops.c:885:class_export_put()) final put ffff9dafba56e800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789785297.742047:0:6512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 12a32a3b-e9e7-466a-b40d-7d74895946de 00000001:00080000:0.0:1789785297.742057:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1789785297.742061:0:6512:0:(genops.c:885:class_export_put()) final put ffff9dae836fe000/12a32a3b-e9e7-466a-b40d-7d74895946de 00000001:00100000:0.0:1789785297.742070:0:6512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 026b2112-ee35-499c-8d01-18663664f08e 00000001:00080000:0.0:1789785297.742073:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1789785297.742080:0:6512:0:(genops.c:885:class_export_put()) final put ffff9dae8397b000/026b2112-ee35-499c-8d01-18663664f08e 00000001:00100000:1.0:1789785297.742795:0:9529:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789785297.742801:0:9529:0:(genops.c:885:class_export_put()) final put ffff9dae839ed000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789785297.742811:0:9529:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 026b2112-ee35-499c-8d01-18663664f08e 00000020:00000080:1.0:1789785297.742813:0:9529:0:(genops.c:885:class_export_put()) final put ffff9dae83bd9000/026b2112-ee35-499c-8d01-18663664f08e 00000020:00000080:2.0:1789785297.743937:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafba56e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1789785297.744025:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae836fe000/12a32a3b-e9e7-466a-b40d-7d74895946de for lustre-MDT0000 00000020:00000080:2.0:1789785297.744072:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae8397b000/026b2112-ee35-499c-8d01-18663664f08e for lustre-MDT0000 00000020:00000080:2.0:1789785297.744129:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae839ed000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789785297.744179:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae83bd9000/026b2112-ee35-499c-8d01-18663664f08e for lustre-OST0001 00000020:00000080:2.0:1789785297.744206:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dafbb1e2000 for lustre-MDT0000 00000020:00000080:2.0:1789785297.744211:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dae836f8000 for lustre-MDT0000 00000020:00000080:2.0:1789785297.744215:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dae8397d800 for lustre-MDT0000 00000020:00000080:2.0:1789785297.744218:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dae839e9000 for lustre-OST0001 00000020:00000080:2.0:1789785297.744221:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dae83bda800 for lustre-OST0001 00000001:00100000:1.0:1789785297.747618:0:8445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789785297.747628:0:8445:0:(genops.c:885:class_export_put()) final put ffff9dae81e5d000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789785297.747645:0:8445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 026b2112-ee35-499c-8d01-18663664f08e 00000020:00000080:1.0:1789785297.747648:0:8445:0:(genops.c:885:class_export_put()) final put ffff9dafbf43e000/026b2112-ee35-499c-8d01-18663664f08e 00000001:00100000:3.0:1789785297.748023:0:7465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789785297.748034:0:7465:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1789785297.748039:0:7465:0:(genops.c:885:class_export_put()) final put ffff9daf98021000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789785297.748045:0:7465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 12a32a3b-e9e7-466a-b40d-7d74895946de 00000001:00080000:3.0:1789785297.748049:0:7465:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1789785297.748068:0:7465:0:(genops.c:885:class_export_put()) final put ffff9dae836fe800/12a32a3b-e9e7-466a-b40d-7d74895946de 00000001:00100000:3.0:1789785297.748074:0:7465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 026b2112-ee35-499c-8d01-18663664f08e 00000001:00080000:3.0:1789785297.748079:0:7465:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1789785297.748091:0:7465:0:(genops.c:885:class_export_put()) final put ffff9dae839ef000/026b2112-ee35-499c-8d01-18663664f08e 00000020:00000080:0.0:1789785297.750018:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae81e5d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789785297.750134:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafbf43e000/026b2112-ee35-499c-8d01-18663664f08e for lustre-OST0000 00000020:00000080:0.0:1789785297.750164:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9daf98021000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1789785297.750205:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae836fe800/12a32a3b-e9e7-466a-b40d-7d74895946de for lustre-MDT0001 00000020:00000080:0.0:1789785297.750240:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae839ef000/026b2112-ee35-499c-8d01-18663664f08e for lustre-MDT0001 00000020:00000080:0.0:1789785297.750269:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dafba56a800 for lustre-OST0000 00000020:00000080:0.0:1789785297.750275:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dafbf43e800 for lustre-OST0000 00000020:00000080:0.0:1789785297.750278:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9daf98025800 for lustre-MDT0001 00000020:00000080:0.0:1789785297.750281:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dae836fc800 for lustre-MDT0001 00000020:00000080:0.0:1789785297.750284:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dae839e8000 for lustre-MDT0001 00010000:00010000:2.0:1789785297.922584:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789785298.178547:0:15218:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dae8347b360 - data ffff9daf9fa6da20/ffff9dafb5f79000 00000020:01000000:2.0:1789785298.178710:0:15218:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dafb115b3c0 - data ffff9daf9f84dbd0/ffff9dafc1a4bc00 00000001:00000004:2.0:1789785298.195616:0:15218:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:1.0:1789785298.292107:0:15218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789785298.292116:0:15218:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1789785298.292131:0:15218:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9dae846a1f80 x1876725549139968/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789785305 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785298.292158:0:15218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1789785298.296245:0:15218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789785298.296252:0:15218:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 4 00000004:00080000:1.0:1789785298.296269:0:15218:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789785298.296271:0:15218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789785298.296634:0:8816:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789785298.296639:0:8816:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1789785298.296649:0:8816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1789785298.297208:0:15218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789785298.297211:0:15218:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1789785298.297234:0:15218:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789785298.297236:0:15218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789785298.297742:0:9860:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789785298.297745:0:9860:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1789785298.297768:0:9860:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1789785298.303776:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845bdea 00000020:00000080:1.0:1789785298.303788:0:15218:0:(genops.c:885:class_export_put()) final put ffff9dafb11e9800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789785298.304282:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafb11e9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789785298.307568:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845bdff 00000020:00000080:3.0:1789785298.307581:0:15218:0:(genops.c:885:class_export_put()) final put ffff9dafb11ea000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789785298.307594:0:15218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1789785298.307600:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789785298.307607:0:15218:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789785298.307611:0:15218:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9dafb11d99b8) has no exports 00000004:01000000:3.0:1789785298.307782:0:15218:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789785298.307789:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c235 00000020:00000080:3.0:1789785298.307793:0:15218:0:(genops.c:885:class_export_put()) final put ffff9dae839ec000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789785298.307798:0:15218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789785298.307801:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789785298.307810:0:15218:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789785298.307813:0:15218:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9dafba55b370) has no exports 00000020:00000080:3.0:1789785298.307819:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c22e 00000020:00000080:3.0:1789785298.307822:0:15218:0:(genops.c:885:class_export_put()) final put ffff9dafb5ec6000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789785298.308585:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafb11ea000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1789785298.308595:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae839ec000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789785298.308599:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafb5ec6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1789785298.308628:0:15218:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789785298.308632:0:15218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789785298.308636:0:15218:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1789785298.308642:0:15218:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789785298.308644:0:15218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789785298.308684:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789785298.308693:0:15218:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789785298.308708:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c0f3 00000020:00000080:3.0:1789785298.308713:0:15218:0:(genops.c:885:class_export_put()) final put ffff9dae829b0000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789785298.308717:0:15218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789785298.308720:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789785298.308724:0:15218:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789785298.308726:0:15218:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9dafb5c3cd28) has no exports 00000020:00000080:3.0:1789785298.308730:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c0ec 00000020:00000080:3.0:1789785298.308732:0:15218:0:(genops.c:885:class_export_put()) final put ffff9dae829b7800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789785298.309423:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dafb5ec4000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789785298.309431:0:36:0:(genops.c:885:class_export_put()) final put ffff9dafb5ec1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789785298.309433:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafb5ec1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1789785298.309438:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00010000:01000000:3.0:1789785298.309591:0:15218:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789785298.309594:0:15218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789785298.309596:0:15218:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 5 00000004:00080000:3.0:1789785298.309600:0:15218:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789785298.309601:0:15218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789785298.309638:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789785298.309645:0:15218:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1789785298.309653:0:15218:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789785298.309658:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845bfa3 00000020:00000080:3.0:1789785298.309663:0:15218:0:(genops.c:885:class_export_put()) final put ffff9dafb5cdc000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789785298.309666:0:15218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1789785298.309669:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789785298.309672:0:15218:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789785298.309675:0:15218:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9dafac8c99b8) has no exports 00000020:00000080:3.0:1789785298.309678:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845bf9c 00000020:00000080:3.0:1789785298.309680:0:15218:0:(genops.c:885:class_export_put()) final put ffff9dafb5cdf800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789785298.309810:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae829b0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789785298.309815:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae829b7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789785298.309824:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dae829b3000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789785298.309828:0:36:0:(genops.c:885:class_export_put()) final put ffff9dae81ec9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789785298.309830:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae81ec9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789785298.309833:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789785298.309873:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafb5cdc000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789785298.309877:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafb5cdf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789785298.323404:0:15218:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1789785298.323412:0:15218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789785298.323417:0:15218:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1789785298.323425:0:15218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789785298.323515:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9daf98373800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1789785298.323579:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789785298.323593:0:15218:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789785298.323599:0:15218:0:(genops.c:885:class_export_put()) final put ffff9dafb5cde800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789785298.323602:0:15218:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafb5cde800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1789785298.323609:0:15218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789785298.323707:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789785298.323721:0:15218:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789785298.323724:0:15218:0:(genops.c:885:class_export_put()) final put ffff9daf8774b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789785298.323726:0:15218:0:(genops.c:844:class_export_destroy()) destroying export ffff9daf8774b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789785298.323731:0:15218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789785298.323785:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845be06 00000020:00000080:2.0:1789785298.323792:0:15218:0:(genops.c:885:class_export_put()) final put ffff9dafb11ee800/lustre-MDD0000_UUID 00000020:01000000:2.0:1789785298.323806:0:15218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1789785298.323810:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789785298.323815:0:15218:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789785298.323818:0:15218:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9dafb11d8000) has no exports 00000020:00000080:2.0:1789785298.323837:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789785298.323840:0:15218:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1789785298.323844:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845be0d 00000020:00000080:2.0:1789785298.323848:0:15218:0:(genops.c:885:class_export_put()) final put ffff9dafb11ee000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789785298.323855:0:15218:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9daf89061800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1789785298.323858:0:15218:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9daf89061800 3 00000020:01000004:2.0:1789785298.323861:0:15218:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9daf89061800 from lustre-MDT0000 00000020:00000080:2.0:1789785298.323879:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789785298.323882:0:15218:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1789785298.323885:0:15218:0:(genops.c:885:class_export_put()) final put ffff9dafb11eb000/lustre-MDT0000_UUID 00000020:00000080:2.0:1789785298.323887:0:15218:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafb11eb000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1789785298.323892:0:15218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1789785298.323921:0:15218:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1789785298.323925:0:15218:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1789785298.323928:0:15218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1789785298.323930:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789785298.323933:0:15218:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789785298.323939:0:15218:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9dafa64aa800 8e00759f-51ad-47f9-8892-382c83919083 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789785298.323944:0:15218:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9dafac8c8000) has exports, disconnecting them 00000020:00080000:2.0:1789785298.323949:0:15218:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9dafa64aa800), last request at 1789785036 00000020:00000080:2.0:1789785298.323962:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845bdab 00000020:00010000:2.0:1789785298.323966:0:15218:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9dafa64aa800: total 2 00000100:00080000:2.0:1789785298.323975:0:15218:0:(import.c:65:import_set_state_nolock()) ffff9dafa64a8000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789785298.323988:0:15218:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dafa64aa800): rc 0 00000020:00080000:2.0:1789785298.323992:0:15218:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9dafac8c8000) has no exports 00000020:00010000:2.0:1789785298.324002:0:6521:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9dafa64aa800: total 2 00010000:00010000:2.0:1789785298.324023:0:6521:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9dafa64aa800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1789785298.324051:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc2050e00/0x2f18ee3fd845c54c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f18ee3fd845c545 expref: 14 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785298.324070:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1a65600/0x2f18ee3fd845c31c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f18ee3fd845c315 expref: 13 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785298.324080:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dae81eac000/0x2f18ee3fd845c2ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f18ee3fd845c2a5 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785298.324090:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc2051a00/0x2f18ee3fd845c55a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f18ee3fd845c553 expref: 11 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785298.324101:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1b09400/0x2f18ee3fd845c1cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f18ee3fd845c1c5 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785298.324114:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9daf829d2a00/0x2f18ee3fd845c2c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f18ee3fd845c2c1 expref: 9 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785298.324125:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1b08c00/0x2f18ee3fd845c2ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f18ee3fd845c2b3 expref: 8 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785298.324135:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845c2d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f18ee3fd845c2cf expref: 7 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785298.324144:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1b08600/0x2f18ee3fd845c2e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f18ee3fd845c2dd expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785298.324169:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1a64800/0x2f18ee3fd845c2f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f18ee3fd845c2eb expref: 5 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785298.324180:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc21cba00/0x2f18ee3fd845bea7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f18ee3fd845bea0 expref: 4 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785298.324192:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1b08e00/0x2f18ee3fd845beb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f18ee3fd845beae expref: 3 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785298.324214:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc2050200/0x2f18ee3fd845c53e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f18ee3fd845c537 expref: 2 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785298.324224:0:6521:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9dafa64aa800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1789785298.324238:0:6521:0:(genops.c:885:class_export_put()) final put ffff9dafa64aa800/8e00759f-51ad-47f9-8892-382c83919083 00010000:00010000:2.0:1789785298.324244:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785298.324246:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785298.324247:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785298.324314:0:6528:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9dafac8a4000:6528] 2 exiting: rc = 0 00000100:00100000:1.0:1789785298.324488:0:6527:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9dafac9ae200:6527] 1 exiting: rc = 0 00000020:00000080:1.0:1789785298.324539:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafb11ee800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789785298.324544:0:36:0:(genops.c:885:class_export_put()) final put ffff9dafb11e9000/lustre-MDD0000_UUID 00000020:00000080:1.0:1789785298.324546:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafb11e9000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789785298.324549:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1789785298.324590:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafb11ee000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789785298.324594:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafa64aa800/8e00759f-51ad-47f9-8892-382c83919083 for MGS 00000020:00000080:1.0:1789785298.324614:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dafa64a8000 for MGS 00000100:00100000:2.0:1789785298.382488:0:6526:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9dafac9af600:6526] 0 exiting: rc = 1 00000100:00100000:1.0:1789785298.382668:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.382733:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.382741:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.382747:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.382754:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.382760:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.382766:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.382773:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.382779:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.382786:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.382793:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.382799:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.382806:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.382812:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.382818:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383000:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383007:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383013:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383020:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383026:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383032:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383039:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383045:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383051:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383058:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383064:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383070:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383076:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383082:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383088:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383093:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383099:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383105:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383111:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383116:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383121:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383127:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383132:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383137:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383142:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383148:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383153:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383159:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383165:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383171:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383176:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383181:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383188:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383194:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383199:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383211:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383217:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383223:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383229:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383235:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383240:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383245:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383251:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383257:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383262:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383268:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383274:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383279:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785298.383285:0:15218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1789785298.388396:0:15218:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9daf83f2e720 - data ffff9daf9fa69e58/ffff9dafbf41e800 00000020:01000000:1.0:1789785298.391016:0:15218:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9daf87d444e0 - data ffff9daf9f81abd0/ffff9daf9073f000 00000020:00000080:1.0:1789785298.392071:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845bd8f 00000020:00000080:1.0:1789785298.392082:0:15218:0:(genops.c:885:class_export_put()) final put ffff9dafafa02000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789785298.392109:0:15218:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9daf89061800 from MGS, refs=2 00000020:01000004:1.0:1789785298.392112:0:15218:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9daf89061800 2 00000020:01000004:1.0:1789785298.392115:0:15218:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9daf89061800 from MGS 00000020:00000080:1.0:1789785298.392136:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789785298.392143:0:15218:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789785298.392145:0:15218:0:(genops.c:885:class_export_put()) final put ffff9daf9acfa000/MGS 00000020:00000080:1.0:1789785298.392148:0:15218:0:(genops.c:844:class_export_destroy()) destroying export ffff9daf9acfa000/MGS for MGS 00000020:01000000:1.0:1789785298.392155:0:15218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789785298.392217:0:15218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789785298.392221:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789785298.392226:0:15218:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789785298.392232:0:15218:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9dafc18fd800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789785298.392237:0:15218:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9dafac8cb370) has exports, disconnecting them 00000020:00080000:1.0:1789785298.392242:0:15218:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9dafc18fd800), last request at 1789785037 00000020:00000080:1.0:1789785298.392246:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845be5a 00000020:00080000:1.0:1789785298.392267:0:15218:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dafc18fd800): rc 0 00000020:00000080:1.0:1789785298.392273:0:15218:0:(genops.c:885:class_export_put()) final put ffff9dafc18fd800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789785298.392949:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafafa02000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789785298.392959:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafc18fd800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1789785298.415676:0:15218:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1789785298.415683:0:15218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789785298.415688:0:15218:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789785298.415695:0:15218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789785298.415757:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dafc18fb800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789785298.415972:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789785298.415980:0:15218:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789785298.415985:0:15218:0:(genops.c:885:class_export_put()) final put ffff9dafc18fc800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789785298.415988:0:15218:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafc18fc800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789785298.415994:0:15218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789785298.418377:0:15218:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9daf89061800 1 00000020:00000080:1.0:1789785298.418387:0:15218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845bd81 00000020:00000080:1.0:1789785298.418394:0:15218:0:(genops.c:885:class_export_put()) final put ffff9daf923b1800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1789785298.418459:0:15218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789785298.418465:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789785298.418638:0:15218:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789785298.418644:0:15218:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9daf983f99b8) has no exports 00000020:00000080:2.0:1789785298.419670:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9daf923b1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789785298.598332:0:15218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789785298.599529:0:15218:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1789785298.599536:0:15218:0:(genops.c:885:class_export_put()) final put ffff9daf89065800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789785298.599541:0:15218:0:(genops.c:844:class_export_destroy()) destroying export ffff9daf89065800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789785298.599548:0:15218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1789785298.599669:0:15218:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9daf89063800 00000020:02000400:1.0:1789785298.599776:0:15218:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1789785298.950097:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785299.970749:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785300.803464:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789785300.803487:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549140736:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789785300.803532:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789785300.803536:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789785300.803539:0:37:0:(import.c:65:import_set_state_nolock()) ffff9dafbb228800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789785300.803544:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 405 00000100:00080000:1.0:1789785300.803548:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1789785300.803549:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789785300.803563:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dafbb228800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:1.0:1789785300.803584:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafb113ed80 x1876725549140992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789785300.803607:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549140736 00000100:00100000:3.0:1789785300.803614:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549140736 00000100:00100000:1.0:1789785300.803651:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549140864:0@lo:400:kworker.0 00000100:00100000:3.0:1789785300.803665:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789785300.803674:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549140736:12345-0@lo:13:osp-pre-1-1.0 00000400:00000100:1.0:1789785300.803674:0:3661:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876725549140864 offset 0 length 224: 4 00000100:00100000:1.0:1789785300.803693:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549141504:0@lo:400:kworker.0 00002000:00000024:3.0:1789785300.803708:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789785300.803714:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785300.803743:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549140736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785300.803750:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789785300.803777:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549141248:0@lo:400:kworker.0 00000100:00100000:3.0:1789785300.803802:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785300.803806:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789785300.803812:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549141120:0@lo:400:kworker.0 00000100:00100000:3.0:1789785300.803819:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1876725549141760:0@lo:400:kworker.0 00000100:00100000:1.0:1789785300.803835:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785300.803894:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549140992:0@lo:38:kworker.0 00000100:00100000:0.0:1789785300.803975:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549141376:0@lo:400:kworker.0 00000100:00100000:2.0:1789785300.804643:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785300.806395:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549141248 00000100:00100000:3.0:1789785300.806407:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549141248 00000100:00100000:3.0:1789785300.806453:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549141120 00000100:00100000:3.0:1789785300.806456:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549141120 00000100:00100000:3.0:1789785300.806476:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789785300.806484:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3659:x1876725549141248:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789785300.806493:0:7896:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789785300.806557:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3659:x1876725549141248:12345-0@lo:400:kworker.0 Request processed in 72us (2753us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789785300.806563:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789785300.806580:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789785300.806584:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1876725549141120:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789785300.806589:0:7896:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789785300.806611:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1876725549141120:12345-0@lo:400:kworker.0 Request processed in 26us (2776us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789785300.806617:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:1.0:1789785300.808533:0:3661:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789785300.808539:0:3661:0:(import.c:65:import_set_state_nolock()) ffff9dafacaaf800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789785300.808542:0:3661:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1789785300.810420:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785300.811464:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549141504 00000100:00100000:0.0:1789785300.811473:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549141504 00000100:00100000:0.0:1789785300.811528:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789785300.811539:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549141504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785300.811616:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549141504:12345-0@lo:400:kworker.0 Request processed in 79us (7900us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785300.811623:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:0.0:1789785300.811647:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789785300.811650:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789785300.812015:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549141376 00000100:00100000:3.0:1789785300.812021:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549141376 00000100:00100000:3.0:1789785300.812098:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1789785300.812107:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1876725549141376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785300.812159:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1876725549141376:12345-0@lo:400:kworker.0 Request processed in 54us (1743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785300.812166:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00010000:00080000:3.0:1789785300.812214:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9dafb113d880 x1876725549141376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785300.812229:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549141376:0@lo:400:kworker.0 00000100:00100000:3.0:1789785300.817676:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785300.817767:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549140736:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789785300.817803:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:2.0:1789785300.817806:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549140992 00000100:00080000:3.0:1789785300.817808:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9dae8254e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789785300.817811:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1789785300.817813:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549140992 00000100:00080000:3.0:1789785300.817817:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9dae8254e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789785300.817821:0:3659:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 184 00000100:00080000:3.0:1789785300.817826:0:3659:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dae8254e000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:2.0:1789785300.817851:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789785300.817853:0:3659:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dae846a3100 x1876725549141888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789785300.817859:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3658:x1876725549140992:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1789785300.817872:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549141248:0@lo:400:kworker.0 00010000:00020000:2.0:1789785300.817876:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789785300.817893:0:11254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549141760 00000100:00100000:3.0:1789785300.817896:0:11254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549141760 00000100:00080000:0.0:1789785300.817960:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789785300.818534:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3658:x1876725549140992:12345-0@lo:38:kworker.0 Request processed in 672us (13889us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789785300.818543:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789785300.818581:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1876725549141888:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789785300.818618:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789785300.818650:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dafbb228800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789785300.818655:0:3658:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789785300.818658:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549140992:0@lo:38:kworker.0 00000100:00100000:2.0:1789785300.818683:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549141888 00000100:00100000:2.0:1789785300.818687:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549141888 00000100:00100000:2.0:1789785300.818710:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789785300.818716:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1876725549141888:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1789785300.818730:0:6535:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789785300.819014:0:11254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1789785300.819023:0:11254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876725549141760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785300.819072:0:11254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876725549141760:12345-0@lo:400:kworker.0 Request processed in 51us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785300.819094:0:11254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00010000:00080000:3.0:1789785300.819130:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9dafb113d180 x1876725549141760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785300.819141:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1876725549141760:0@lo:400:kworker.0 00000100:00100000:2.0:1789785300.819270:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1876725549141888:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 553us (651us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789785300.819276:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:3.0:1789785300.825767:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dae8254e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789785300.825781:0:3658:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789785300.825786:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1876725549141888:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1789785300.830301:0:3661:0:(import.c:65:import_set_state_nolock()) ffff9dafacaaf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789785300.830315:0:3661:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 164 00000100:00080000:1.0:1789785300.830324:0:3661:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dafacaaf800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:1.0:1789785300.830394:0:3661:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafb113d180 x1876725549142016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789785300.830587:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549141120:0@lo:400:kworker.0 00000100:00100000:0.0:1789785300.830636:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1876725549141632:0@lo:400:kworker.0 00000100:00100000:0.0:1789785300.830700:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785300.830760:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1876725549142016:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1789785300.830764:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549141504:0@lo:400:kworker.0 00000100:00100000:2.0:1789785300.830795:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785300.830828:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549141632 00000100:00100000:3.0:1789785300.830835:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549141632 00000100:00100000:3.0:1789785300.830869:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549142016 00000100:00100000:3.0:1789785300.830873:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549142016 00000100:00100000:3.0:1789785300.830902:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789785300.830909:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1876725549141632:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789785300.830916:0:6533:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789785300.830955:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1876725549141632:12345-0@lo:400:kworker.0 Request processed in 45us (255us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789785300.830962:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789785300.830971:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789785300.830976:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1876725549142016:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1789785300.831023:0:6535:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1789785300.831025:0:3661:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789785300.831028:0:3661:0:(import.c:65:import_set_state_nolock()) ffff9dae829b5000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789785300.831032:0:3661:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789785300.831035:0:3661:0:(import.c:65:import_set_state_nolock()) ffff9dae829b5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789785300.831038:0:3661:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 203 00000100:00080000:0.0:1789785300.831043:0:3661:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dae829b5000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:0.0:1789785300.831057:0:3661:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafbf451c00 x1876725549142144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789785300.831069:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1876725549141632:0@lo:400:kworker.0 00000100:00100000:2.0:1789785300.831070:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1876725549142016:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 92us (273us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789785300.831077:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789785300.831120:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf451c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1876725549142144:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789785300.831146:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789785300.831174:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dafacaaf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789785300.831178:0:3658:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789785300.831182:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1876725549142016:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789785300.831219:0:7896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549142144 00000100:00100000:1.0:1789785300.831224:0:7896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549142144 00000100:00100000:1.0:1789785300.831253:0:7896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789785300.831257:0:7896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1876725549142144:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1789785300.831268:0:7896:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789785300.831313:0:7896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1876725549142144:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 54us (166us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789785300.831320:0:7896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1789785300.831386:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dae829b5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789785300.831391:0:3658:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789785300.831394:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf451c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1876725549142144:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1789785301.000964:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785302.018465:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785302.339647:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789785302.339670:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549142272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789785302.339748:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785302.339849:0:10490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549142272 00000100:00100000:3.0:1789785302.339857:0:10490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549142272 00000100:00100000:3.0:1789785302.339931:0:10490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789785302.339940:0:10490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549142272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789785302.339967:0:10490:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789785302.340009:0:10490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549142272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785302.340016:0:10490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789785302.340073:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549142272:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789785302.340417:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:1.0:1789785302.633950:0:15419:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1789785302.647064:0:15419:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1789785302.647120:0:15419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c2dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c2e4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785302.647136:0:15419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c2dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c2e4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785302.647143:0:15419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c2dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c2e4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785302.647149:0:15419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c2dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c2e4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785302.647165:0:15419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789785302.647170:0:15419:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789785302.647197:0:15419:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789785302.647201:0:15419:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789785302.647207:0:15419:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789785302.647213:0:15419:0:(import.c:65:import_set_state_nolock()) ffff9dafacaaf800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789785302.647217:0:15419:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789785302.647231:0:15419:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789785302.647234:0:15419:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789785302.647444:0:9538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789785302.647452:0:9538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c2dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c2e4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785302.647460:0:9538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eac600 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:3.0:1789785302.647464:0:9538:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c2dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c2e4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785302.647472:0:9538:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c2dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f18ee3fd845c2e4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789785302.647479:0:9538:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c2dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f18ee3fd845c2e4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785302.647485:0:9538:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789785302.647487:0:9538:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789785302.647490:0:9538:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789785302.647525:0:9538:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c2dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f18ee3fd845c2e4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785302.647532:0:9538:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789785302.647566:0:9538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c2dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f18ee3fd845c2e4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785302.647721:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549142400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789785302.647786:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785302.647853:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549142400 00000100:00100000:1.0:1789785302.647860:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549142400 00000100:00100000:1.0:1789785302.647899:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789785302.647906:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3661:x1876725549142400:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789785302.647913:0:6518:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789785302 with bad export cookie 3393724277202468267 00010000:00010000:3.0:1789785302.648230:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845c2dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f18ee3fd845c2e4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785302.648247:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785302.648249:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785302.648251:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785302.664527:0:15419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81ead000/0x2f18ee3fd845c2eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c2f2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785302.664547:0:15419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81ead000/0x2f18ee3fd845c2eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c2f2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785302.664556:0:15419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81ead000/0x2f18ee3fd845c2eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c2f2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785302.664563:0:15419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff9dae81ead000/0x2f18ee3fd845c2eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c2f2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785302.664864:0:15419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789785302.664874:0:15419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb400/0x2f18ee3fd845c1c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c1cc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785302.664882:0:15419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb400/0x2f18ee3fd845c1c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c1cc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785302.664889:0:15419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb400/0x2f18ee3fd845c1c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c1cc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785302.664895:0:15419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb400/0x2f18ee3fd845c1c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c1cc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785302.667362:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789785302.667378:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dae81ead000/0x2f18ee3fd845c2eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c2f2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785302.667390:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81ead000 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:3.0:1789785302.667395:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dae81ead000/0x2f18ee3fd845c2eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c2f2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785302.667405:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dae81ead000/0x2f18ee3fd845c2eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f18ee3fd845c2f2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789785302.667414:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dae81ead000/0x2f18ee3fd845c2eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f18ee3fd845c2f2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785302.667420:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789785302.667423:0:6521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1789785302.667462:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dae81ead000/0x2f18ee3fd845c2eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f18ee3fd845c2f2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785302.667468:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789785302.667500:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dae81ead000/0x2f18ee3fd845c2eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f18ee3fd845c2f2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785302.667508:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dae81ead000/0x2f18ee3fd845c2eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f18ee3fd845c2f2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785302.667522:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549142528:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789785302.667537:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789785302.667542:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb400/0x2f18ee3fd845c1c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c1cc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785302.667548:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc21cb400 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:3.0:1789785302.667550:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb400/0x2f18ee3fd845c1c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c1cc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785302.667599:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789785302.667613:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb400/0x2f18ee3fd845c1c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f18ee3fd845c1cc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789785302.667621:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb400/0x2f18ee3fd845c1c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f18ee3fd845c1cc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785302.667626:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789785302.667628:0:6521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1789785302.667644:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb400/0x2f18ee3fd845c1c5 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f18ee3fd845c1cc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785302.667651:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789785302.667670:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb400/0x2f18ee3fd845c1c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f18ee3fd845c1cc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785302.667678:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785302.667680:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785302.667680:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549142528 00010000:00010000:3.0:1789785302.667684:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785302.667688:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549142528 00000100:00100000:3.0:1789785302.667697:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549142656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789785302.667730:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789785302.667735:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785302.667744:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafac9e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3662:x1876725549142528:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789785302.667752:0:6519:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789785302 with bad export cookie 3393724277202468267 00000100:00100000:3.0:1789785302.667778:0:6520:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1789785302.667794:0:6520:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1789785302.667806:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafac9e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3662:x1876725549142528:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (205us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789785302.667815:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789785302.667832:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549142656 00000100:00100000:0.0:1789785302.667836:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549142656 00000100:00100000:0.0:1789785302.667851:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789785302.667857:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3659:x1876725549142656:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789785302.667861:0:6519:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789785302 with bad export cookie 3393724277202468267 00000100:00100000:0.0:1789785302.667895:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3659:x1876725549142656:12345-0@lo:103:ldlm_bl.0 Request processed in 37us (162us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789785302.667902:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1789785302.667915:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.146@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789785302.667921:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9dafacaaa000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1789785302.667926:0:3659:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.146@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1789785302.667937:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.146@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789785302.667945:0:3659:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.146@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1789785302.667947:0:3659:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789785302.667954:0:3659:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dafb113e300 x1876725549140864/t0(0) o400->MGC192.168.203.146@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789785316 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785302.667965:0:3659:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dae846a0e00 x1876725549142400/t0(0) o103->MGC192.168.203.146@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789785318 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785302.667972:0:3659:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dae846a2300 x1876725549142528/t0(0) o103->MGC192.168.203.146@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789785318 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785302.667979:0:3659:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dae846a2d80 x1876725549142656/t0(0) o103->MGC192.168.203.146@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789785318 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789785302.667988:0:3659:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789785302.667991:0:3659:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789785302.667992:0:3659:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789785302.670732:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9dafacaaa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789785302.670746:0:3659:0:(import.c:510:import_select_connection()) MGC192.168.203.146@tcp: connect to NID 0@lo last attempt 145 00000100:00080000:3.0:1789785302.670755:0:3659:0:(import.c:624:import_select_connection()) MGC192.168.203.146@tcp: import ffff9dafacaaa000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:3.0:1789785302.670797:0:3659:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dae846a1500 x1876725549142784/t0(0) o250->MGC192.168.203.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789785302.670839:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e00759f-51ad-47f9-8892-382c83919083:3659:1876725549142656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789785302.670887:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549142400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789785302.670895:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e00759f-51ad-47f9-8892-382c83919083:3661:1876725549140864:0@lo:400:kworker.0 00000100:00100000:3.0:1789785302.671411:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e00759f-51ad-47f9-8892-382c83919083:3658:1876725549142784:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1789785302.671469:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876725549142784 offset 0 length 520: 4 00010000:00010000:2.0:1789785302.677714:0:15419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789785302.677728:0:15419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb400/0x2f18ee3fd845c1c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f18ee3fd845c1cc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785302.677777:0:15419:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789785302.677793:0:15419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21caa00/0x2f18ee3fd845c553 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c55a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785302.677801:0:15419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21caa00/0x2f18ee3fd845c553 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c55a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785302.677809:0:15419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21caa00/0x2f18ee3fd845c553 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c55a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785302.677815:0:15419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff9dafc21caa00/0x2f18ee3fd845c553 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c55a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785302.677829:0:15419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789785302.677834:0:15419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca000/0x2f18ee3fd845beae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845beb5 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785302.677840:0:15419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca000/0x2f18ee3fd845beae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845beb5 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785302.677846:0:15419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca000/0x2f18ee3fd845beae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845beb5 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785302.677852:0:15419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca000/0x2f18ee3fd845beae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845beb5 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785302.677861:0:15419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789785302.677864:0:15419:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1789785302.677867:0:15419:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1789785302.677909:0:15419:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1789785302.677914:0:15419:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1789785302.677919:0:15419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789785302.677924:0:15419:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000100:00080000:0.0:1789785302.677928:0:3662:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9dafacaaa000 already not connected (conn 2, was 1): CONNECTING 00000020:00080000:2.0:1789785302.677932:0:15419:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9dae81ecb000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789785302.677939:0:15419:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9dae82548000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789785302.677944:0:15419:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9dafba55cd28) has exports, disconnecting them 00000020:00080000:2.0:1789785302.677948:0:15419:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9dae81ecb000), last request at 1789785300 00000020:00000080:2.0:1789785302.677954:0:15419:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c18d 00000100:00100000:0.0:1789785302.677956:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e00759f-51ad-47f9-8892-382c83919083:3662:1876725549142528:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789785302.677976:0:15419:0:(import.c:65:import_set_state_nolock()) ffff9dae81ec8000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789785302.678024:0:15419:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dae81ecb000): rc 0 00000020:00000080:2.0:1789785302.678026:0:15419:0:(genops.c:885:class_export_put()) final put ffff9dae81ecb000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1789785302.678046:0:15419:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9dae82548000), last request at 1789785300 00000020:00000080:2.0:1789785302.678049:0:15419:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c067 00000100:00080000:2.0:1789785302.678054:0:15419:0:(import.c:65:import_set_state_nolock()) ffff9dae8254a800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789785302.678060:0:15419:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dae82548000): rc 0 00000020:00000080:2.0:1789785302.678061:0:15419:0:(genops.c:885:class_export_put()) final put ffff9dae82548000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1789785302.678068:0:15419:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa9f301c7fae0 00000100:00080000:2.0:1789785302.678086:0:15419:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000020:00000080:0.0:1789785302.678092:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae81ecb000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000100:00100000:2.0:1789785302.678094:0:15419:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9dae847d4000 x1876725549140352/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789785313 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785302.678110:0:15419:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000020:00000080:0.0:1789785302.678140:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae82548000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1789785302.678162:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dae81ec8000 for lustre-MDT0001 00000020:00000080:0.0:1789785302.678166:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dae8254a800 for lustre-MDT0001 00000100:00100000:0.0:1789785302.678192:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549140352:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789785302.679014:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789785302.679023:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc21caa00/0x2f18ee3fd845c553 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c55a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785302.679032:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc21caa00 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:3.0:1789785302.679036:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc21caa00/0x2f18ee3fd845c553 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c55a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785302.679045:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc21caa00/0x2f18ee3fd845c553 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f18ee3fd845c55a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789785302.679052:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc21caa00/0x2f18ee3fd845c553 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f18ee3fd845c55a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785302.679059:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789785302.679061:0:6522:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789785302.679064:0:6522:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789785302.679079:0:6522:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dafacaaa000 00010000:00010000:3.0:1789785302.679083:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc21caa00/0x2f18ee3fd845c553 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f18ee3fd845c55a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785302.679090:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc21caa00/0x2f18ee3fd845c553 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f18ee3fd845c55a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785302.679101:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789785302.679105:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca000/0x2f18ee3fd845beae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845beb5 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785302.679110:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc21ca000 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:3.0:1789785302.679125:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca000/0x2f18ee3fd845beae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845beb5 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785302.679131:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca000/0x2f18ee3fd845beae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f18ee3fd845beb5 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789785302.679137:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca000/0x2f18ee3fd845beae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f18ee3fd845beb5 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785302.679142:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789785302.679144:0:6522:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789785302.679146:0:6522:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789785302.679151:0:6522:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dafacaaa000 00010000:00010000:3.0:1789785302.679154:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca000/0x2f18ee3fd845beae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f18ee3fd845beb5 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785302.679160:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca000/0x2f18ee3fd845beae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f18ee3fd845beb5 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785302.679172:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785302.679174:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785302.679176:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785302.679184:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785302.679189:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789785302.679579:0:15419:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789785302.680441:0:15419:0:(import.c:65:import_set_state_nolock()) ffff9dafbb228800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789785302.684760:0:15419:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789785302.684767:0:15419:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 3 00000004:00080000:2.0:1789785302.684786:0:15419:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789785302.684847:0:15419:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789785302.684887:0:15419:0:(import.c:65:import_set_state_nolock()) ffff9dae81eba000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789785302.684914:0:15419:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789785302.684916:0:15419:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1789785302.684925:0:15419:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789785302.684991:0:15419:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789785302.685010:0:15419:0:(import.c:65:import_set_state_nolock()) ffff9dafbf3c0000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789785302.685019:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549142912:0@lo:9:umount.0 00000020:00080000:2.0:1789785302.685040:0:15419:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9dafba55cd28) has no exports 00000100:00100000:0.0:1789785302.685091:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785302.685154:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549143040:0@lo:9:umount.0 00000100:00100000:0.0:1789785302.685178:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785302.685225:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549142912 00000100:00100000:0.0:1789785302.685232:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549142912 00000100:00100000:0.0:1789785302.685269:0:8805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549143040 00000100:00100000:0.0:1789785302.685272:0:8805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549143040 00000100:00100000:0.0:1789785302.685301:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789785302.685310:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf451c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1876725549142912:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789785302.685357:0:8805:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c0b4 00000100:00080000:0.0:1789785302.685366:0:8805:0:(import.c:65:import_set_state_nolock()) ffff9dae81ecf800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789785302.685405:0:8805:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:0.0:1789785302.685557:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf451c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3658:x1876725549142912:12345-0@lo:9:umount.0 Request processed in 247us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785302.685565:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789785302.685579:0:8805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789785302.685586:0:8805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf452a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1876725549143040:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789785302.685599:0:8805:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c1f6 00000100:00080000:0.0:1789785302.685604:0:8805:0:(import.c:65:import_set_state_nolock()) ffff9dae83731800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789785302.685626:0:8805:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1789785302.685706:0:8805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf452a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3658:x1876725549143040:12345-0@lo:9:umount.0 Request processed in 120us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785302.685712:0:8805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1789785302.685736:0:6529:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789785302.685748:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785302.685753:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789785302.685777:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dafbf3c0000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789785302.685782:0:3658:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789785302.685784:0:3658:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789785302.685786:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549143040:0@lo:9:umount.0 00000100:00080000:0.0:1789785302.685805:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dae81eba000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789785302.685809:0:3658:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789785302.685810:0:3658:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789785302.685813:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549142912:0@lo:9:umount.0 00000400:00000100:1.0:1789785302.698481:0:6518:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1876725549142400 offset 224 length 224: 4 00000100:00100000:1.0:1789785302.698510:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3661:x1876725549142400:12345-0@lo:103:ldlm_bl.0 Request processed in 50601us (50721us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789785302.698525:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000020:00080000:1.0:1789785302.704418:0:15419:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9dafba55cd28) has no exports 00000020:01000000:0.0:1789785302.747220:0:15419:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9daf83f2ec60 - data ffff9daf9fa69d80/ffff9dafbf41c400 00000020:01000000:0.0:1789785302.747442:0:15419:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dafb5dd7900 - data ffff9daf9f99b6c0/ffff9dafc1bc8000 00000001:00000004:2.0:1789785302.762556:0:15419:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1789785302.804489:0:15419:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789785302.804498:0:15419:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1789785302.804506:0:15419:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789785302.805486:0:15419:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789785302.805490:0:15419:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 4 00000004:00080000:0.0:1789785302.805508:0:15419:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789785302.805510:0:15419:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789785302.808042:0:8802:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789785302.808057:0:8802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:2.0:1789785302.808072:0:8802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789785302.808838:0:15419:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789785302.808844:0:15419:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1789785302.808853:0:15419:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789785302.808855:0:15419:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789785302.810847:0:9856:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789785302.810853:0:9856:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1789785302.810864:0:9856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789785302.812232:0:15419:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845bed1 00000020:00000080:0.0:1789785302.812242:0:15419:0:(genops.c:885:class_export_put()) final put ffff9daf98023800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789785302.812659:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9daf98023800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789785302.819511:0:15419:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845bee6 00000020:00000080:2.0:1789785302.819524:0:15419:0:(genops.c:885:class_export_put()) final put ffff9dafba568800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789785302.819567:0:15419:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1789785302.819573:0:15419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789785302.819581:0:15419:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789785302.819585:0:15419:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9dafba5599b8) has no exports 00000004:01000000:2.0:1789785302.819738:0:15419:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789785302.819746:0:15419:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c1ef 00000020:00000080:2.0:1789785302.819749:0:15419:0:(genops.c:885:class_export_put()) final put ffff9dae8397f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789785302.820014:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafba568800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1789785302.820122:0:15419:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789785302.820126:0:15419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789785302.820134:0:15419:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789785302.820137:0:15419:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9dae82554d28) has no exports 00000020:00000080:2.0:1789785302.820143:0:15419:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c1e8 00000020:00000080:2.0:1789785302.820147:0:15419:0:(genops.c:885:class_export_put()) final put ffff9dafbf3c1000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789785302.820247:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae8397f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:2.0:1789785302.820649:0:15419:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789785302.820654:0:15419:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789785302.820658:0:15419:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1789785302.820663:0:15419:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789785302.820674:0:15419:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789785302.820751:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafbf3c1000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789785302.820820:0:15419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789785302.820828:0:15419:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789785302.820833:0:15419:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c0ad 00000020:00000080:2.0:1789785302.820837:0:15419:0:(genops.c:885:class_export_put()) final put ffff9dae829a6000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789785302.820856:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dafbf3c0000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789785302.820861:0:37:0:(genops.c:885:class_export_put()) final put ffff9dafbf3c0800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789785302.820863:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafbf3c0800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1789785302.820867:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789785302.825322:0:15419:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789785302.826206:0:15419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789785302.826219:0:15419:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789785302.826224:0:15419:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9dafbb224d28) has no exports 00000020:00000080:2.0:1789785302.826234:0:15419:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c0a6 00000020:00000080:2.0:1789785302.826241:0:15419:0:(genops.c:885:class_export_put()) final put ffff9dae81ebb800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789785302.826285:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae829a6000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:2.0:1789785302.826896:0:15419:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789785302.826901:0:15419:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789785302.826905:0:15419:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 5 00000004:00080000:2.0:1789785302.826910:0:15419:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789785302.826912:0:15419:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789785302.826943:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae81ebb800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789785302.827356:0:15419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789785302.827365:0:15419:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1789785302.827380:0:15419:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789785302.827386:0:15419:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845bf09 00000020:00000080:2.0:1789785302.827391:0:15419:0:(genops.c:885:class_export_put()) final put ffff9daf98374000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789785302.827472:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dae81eba000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789785302.827478:0:37:0:(genops.c:885:class_export_put()) final put ffff9dae81ebe000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789785302.827480:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae81ebe000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1789785302.827485:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789785302.827658:0:15419:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1789785302.827662:0:15419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789785302.827667:0:15419:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789785302.827669:0:15419:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9dafbb2219b8) has no exports 00000020:00000080:2.0:1789785302.827674:0:15419:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845bf02 00000020:00000080:2.0:1789785302.827678:0:15419:0:(genops.c:885:class_export_put()) final put ffff9dafbb22d800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789785302.827697:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9daf98374000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789785302.829037:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafbb22d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1789785302.830386:0:15419:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1789785302.830392:0:15419:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789785302.830396:0:15419:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1789785302.830404:0:15419:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789785302.830452:0:15419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789785302.830463:0:15419:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789785302.830487:0:15419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789785302.830490:0:15419:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789785302.830494:0:15419:0:(genops.c:885:class_export_put()) final put ffff9daf98022800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789785302.830498:0:15419:0:(genops.c:844:class_export_destroy()) destroying export ffff9daf98022800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1789785302.830504:0:15419:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789785302.830653:0:15419:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845beed 00000020:00000080:3.0:1789785302.830658:0:15419:0:(genops.c:885:class_export_put()) final put ffff9dafba56d800/lustre-MDD0001_UUID 00000020:01000000:3.0:1789785302.830663:0:15419:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1789785302.830665:0:15419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789785302.830670:0:15419:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789785302.830673:0:15419:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9dafba558000) has no exports 00000020:00000080:3.0:1789785302.830689:0:15419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789785302.830692:0:15419:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1789785302.830695:0:15419:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845bef4 00000020:00000080:3.0:1789785302.830698:0:15419:0:(genops.c:885:class_export_put()) final put ffff9dafba56b800/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1789785302.830705:0:15419:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dafc189c800 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1789785302.830707:0:15419:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dafc189c800 2 00000020:01000004:3.0:1789785302.830710:0:15419:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dafc189c800 from lustre-MDT0001 00000020:00000080:3.0:1789785302.830723:0:15419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789785302.830726:0:15419:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1789785302.830728:0:15419:0:(genops.c:885:class_export_put()) final put ffff9daf98022000/lustre-MDT0001_UUID 00000020:00000080:3.0:1789785302.830730:0:15419:0:(genops.c:844:class_export_destroy()) destroying export ffff9daf98022000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1789785302.830734:0:15419:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1789785302.830757:0:15419:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1789785302.830760:0:15419:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1789785302.830762:0:15419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789785302.830765:0:15419:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789785302.830770:0:15419:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9dafbb1e3000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789785302.830775:0:15419:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9dafb5c38000) has exports, disconnecting them 00000020:00080000:3.0:1789785302.830784:0:15419:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9dafbb1e3000), last request at 1789785056 00000020:00000080:3.0:1789785302.830787:0:15419:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845bf48 00000020:00080000:3.0:1789785302.830799:0:15419:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dafbb1e3000): rc 0 00000020:00000080:3.0:1789785302.830802:0:15419:0:(genops.c:885:class_export_put()) final put ffff9dafbb1e3000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1789785302.831902:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dafbb228800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789785302.831913:0:37:0:(genops.c:885:class_export_put()) final put ffff9dafb1132000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789785302.831915:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafb1132000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1789785302.831921:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789785302.832032:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafba56d800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1789785302.832048:0:37:0:(genops.c:885:class_export_put()) final put ffff9dafc1a68800/lustre-MDD0001_UUID 00000020:00000080:0.0:1789785302.832050:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafc1a68800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1789785302.832056:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1789785302.832404:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafba56b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789785302.832410:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafbb1e3000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1789785302.833385:0:15419:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1789785302.833391:0:15419:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789785302.833395:0:15419:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789785302.833401:0:15419:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789785302.833423:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dafacaaf800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1789785302.833564:0:15419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789785302.833571:0:15419:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1789785302.833574:0:15419:0:(genops.c:885:class_export_put()) final put ffff9daf98372000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1789785302.833577:0:15419:0:(genops.c:844:class_export_destroy()) destroying export ffff9daf98372000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1789785302.833581:0:15419:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1789785302.833628:0:15419:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dafc189c800 1 00000020:00000080:0.0:1789785302.833640:0:15419:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845be84 00000020:00000080:0.0:1789785302.833646:0:15419:0:(genops.c:885:class_export_put()) final put ffff9daf98377800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1789785302.833653:0:15419:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1789785302.833659:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9daf98377800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789785302.833665:0:15419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789785302.833670:0:15419:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789785302.833673:0:15419:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9dafb11db370) has no exports 00000020:00000080:1.0:1789785302.900705:0:15419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789785302.900718:0:15419:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1789785302.900724:0:15419:0:(genops.c:885:class_export_put()) final put ffff9dafc1898000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789785302.900729:0:15419:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafc1898000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1789785302.900741:0:15419:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1789785302.900861:0:15419:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dafc189f800 00000020:01000000:1.0:1789785302.900882:0:15419:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1789785302.900886:0:15419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789785302.900891:0:15419:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789785302.900895:0:15419:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9daf983f8000) has no exports 00000100:00100000:0.0:1789785302.901207:0:11254:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9dae83a30600:11254] 4 exiting: rc = 0 00000100:00100000:1.0:1789785302.901430:0:7896:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9dafb5d15e00:7896] 3 exiting: rc = 0 00000100:00100000:2.0:1789785302.903153:0:6534:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9dafafa7a600:6534] 1 exiting: rc = 0 00000100:00100000:2.0:1789785302.903279:0:6533:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9daf854f3a00:6533] 0 exiting: rc = 1 00000100:00100000:2.0:1789785302.903616:0:6535:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9dafafa7a400:6535] 2 exiting: rc = 0 00000100:00100000:1.0:1789785302.903713:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903722:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903739:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903745:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903750:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903755:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903760:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903766:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903771:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903776:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903782:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903788:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903794:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903799:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903804:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903810:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903817:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903831:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903837:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903842:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903848:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903864:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903870:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903882:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903888:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903894:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903899:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903907:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903913:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903918:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903925:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903930:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903941:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903947:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903953:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903960:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903966:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903980:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903993:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.903998:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.904004:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.904009:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.904014:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.904019:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.904025:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.904029:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.904034:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.904039:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.904046:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.904052:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.904058:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.904063:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.904134:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.904144:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.904149:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.904154:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.904159:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.904165:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.904170:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.904175:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.904180:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.904186:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.904190:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.904196:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.906924:0:6537:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9dafafa7b200:6537] 1 exiting: rc = 0 00000100:00100000:0.0:1789785302.907154:0:6536:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9dafafa7aa00:6536] 0 exiting: rc = 1 00000100:00100000:1.0:1789785302.907259:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907268:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907274:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907280:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907286:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907292:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907297:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907302:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907322:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907733:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907742:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907748:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907754:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907759:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907765:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907770:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907775:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907780:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907785:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907790:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907795:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907800:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907805:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907810:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907815:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907821:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907826:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907832:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907837:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907843:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907849:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907854:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907859:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907864:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907870:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907876:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907882:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907888:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907894:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907898:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907904:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907909:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907915:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907928:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907933:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907938:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907944:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907949:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907954:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907959:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907964:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907969:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907974:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907979:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907984:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907989:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907994:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.907999:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.908005:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.908010:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.908014:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.908019:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.908024:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.908029:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785302.909616:0:7899:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9dafb5d17600:7899] 2 exiting: rc = 0 00000100:00100000:2.0:1789785302.910050:0:6539:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9dafaba71200:6539] 1 exiting: rc = 0 00000100:00100000:2.0:1789785302.910228:0:6538:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9dafafa7be00:6538] 0 exiting: rc = 1 00000100:00100000:1.0:1789785302.910304:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910324:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910600:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910607:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910613:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910620:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910625:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910631:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910637:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910642:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910658:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910664:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910670:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910676:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910689:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910694:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910701:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910707:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910713:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910718:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910724:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910731:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910752:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910759:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910765:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910771:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910777:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910783:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910789:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910795:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910801:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910807:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910813:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910819:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910838:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910844:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910849:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910855:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910861:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910866:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910872:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910877:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910884:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910890:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910896:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910902:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910924:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910931:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910937:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910951:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910958:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910966:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910972:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910978:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910985:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910992:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.910997:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.911003:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.911025:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.911033:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.911039:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.911046:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.911052:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.911068:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785302.918247:0:6540:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9dafaba71e00:6540] 0 exiting: rc = 1 00000100:00100000:1.0:1789785302.918707:0:6541:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9dafaba71400:6541] 1 exiting: rc = 0 00000100:00100000:2.0:1789785302.918821:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918829:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918835:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918840:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918845:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918850:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918855:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918861:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918866:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918871:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918877:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918882:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918888:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918893:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918898:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918902:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918908:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918913:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918918:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918923:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918928:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918934:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918940:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918945:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918951:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918956:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918962:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918966:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918972:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918977:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918982:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918988:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918993:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.918998:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919017:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919023:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919028:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919034:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919038:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919044:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919049:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919055:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919059:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919065:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919191:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919199:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919205:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919210:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919214:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919220:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919225:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919230:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919235:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919240:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919245:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919250:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919255:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919261:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919266:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919271:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919277:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919282:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919287:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.919292:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785302.920265:0:6543:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9daf98387000:6543] 1 exiting: rc = 0 00000100:00100000:1.0:1789785302.920705:0:6542:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9daf98387a00:6542] 0 exiting: rc = 1 00000100:00100000:2.0:1789785302.920926:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.920932:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.920938:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.920943:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.920948:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.920964:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.920969:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.920974:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.920979:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.920984:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.920990:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.920995:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921001:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921005:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921011:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921016:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921022:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921027:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921033:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921038:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921043:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921048:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921053:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921058:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921063:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921068:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921144:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921150:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921155:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921160:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921164:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921169:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921174:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921179:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921184:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921188:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921192:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921198:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921203:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921209:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921223:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921228:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921234:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921238:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921243:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921248:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921253:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921259:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921264:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921269:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921274:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921279:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921284:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921290:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921295:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921300:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921305:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921310:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921315:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921321:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921335:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921625:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921631:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.921637:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785302.922181:0:6545:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9dafac81e400:6545] 1 exiting: rc = 0 00000100:00100000:0.0:1789785302.922308:0:6544:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9daf98386000:6544] 0 exiting: rc = 1 00000100:00100000:2.0:1789785302.922591:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922598:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922603:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922608:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922614:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922619:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922625:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922631:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922636:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922641:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922645:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922661:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922666:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922672:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922677:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922682:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922687:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922693:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922698:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922703:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922708:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922713:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922718:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922723:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922728:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922733:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922738:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922742:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922747:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922752:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922757:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922763:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922768:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922774:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922779:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922785:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922790:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922795:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922801:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922806:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922810:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922814:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922819:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922824:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922829:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922832:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922846:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922851:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922856:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922861:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922866:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922871:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922876:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922882:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922887:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922892:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922897:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922902:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922907:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922912:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922916:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922921:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922927:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.922932:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.923567:0:6547:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9dafac870a00:6547] 1 exiting: rc = 0 00000100:00100000:0.0:1789785302.923755:0:6546:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9dafac871c00:6546] 0 exiting: rc = 1 00000100:00100000:3.0:1789785302.924028:0:6548:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9dafac9ba200:6548] 2 exiting: rc = 0 00000100:00100000:2.0:1789785302.924260:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924267:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924273:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924278:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924292:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924300:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924308:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924314:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924321:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924363:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924370:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924376:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924382:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924405:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924412:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924417:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924434:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924440:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924446:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924452:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924457:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924462:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924468:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924473:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924479:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924484:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924490:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924496:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924501:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924508:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924513:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924519:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924524:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924530:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924537:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924542:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924548:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924568:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924576:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924582:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924588:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924593:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924601:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924607:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924612:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924619:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924625:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924630:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924636:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924642:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924647:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924661:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924666:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924672:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924678:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924684:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924689:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924695:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924701:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924707:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924714:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924720:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924725:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785302.924730:0:15419:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789785302.929165:0:15419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789785302.929179:0:15419:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789785302.929184:0:15419:0:(genops.c:885:class_export_put()) final put ffff9dafacaad800/MDS_uuid 00000020:00000080:0.0:1789785302.929189:0:15419:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafacaad800/MDS_uuid for MDS 00000020:01000000:0.0:1789785302.929195:0:15419:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789785302.929398:0:15419:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1789785303.042467:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785304.071407:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785305.092572:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789785305.923587:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8e00759f-51ad-47f9-8892-382c83919083->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789785305.923598:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8e00759f-51ad-47f9-8892-382c83919083->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789785305.923601:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789785305.923605:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789785305.923610:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dae8254e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789785305.923618:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 409 00000100:00080000:1.0:1789785305.923624:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789785305.923631:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dae8254e000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:1.0:1789785305.923669:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafb113e680 x1876725549143168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789785305.923712:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789785305.923722:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789785305.923724:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dae829b5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789785305.923727:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 409 00000100:00080000:1.0:1789785305.923730:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789785305.923734:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dae829b5000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:1.0:1789785305.923748:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafb113d500 x1876725549143424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789785305.923827:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789785305.923843:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1876725549143552:0@lo:400:kworker.0 00000400:00000100:1.0:1789785305.923894:0:3662:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876725549143552 offset 0 length 224: 4 00000100:00100000:0.0:1789785305.924140:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1876725549143168:0@lo:38:kworker.0 00000400:00000100:0.0:1789785305.924164:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876725549143168 offset 0 length 520: 4 00000100:00100000:0.0:1789785305.924182:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1876725549143424:0@lo:38:kworker.0 00000400:00000100:0.0:1789785305.924195:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876725549143424 offset 0 length 520: 4 00000100:00100000:3.0:1789785305.924289:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549143296:0@lo:400:kworker.0 00000400:00000100:3.0:1789785305.924333:0:3660:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876725549143296 offset 0 length 224: 4 00010000:00010000:2.0:1789785306.120517:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789785306.760608:0:15622:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1789785306.778597:0:15622:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1789785306.778652:0:15622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09200/0x2f18ee3fd845c2c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c2c8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785306.778667:0:15622:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09200/0x2f18ee3fd845c2c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c2c8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785306.778675:0:15622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09200/0x2f18ee3fd845c2c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c2c8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785306.778682:0:15622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09200/0x2f18ee3fd845c2c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c2c8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785306.778705:0:15622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789785306.778710:0:15622:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789785306.778738:0:15622:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789785306.778750:0:15622:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dafb113e680 x1876725549143168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789785320 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785306.778782:0:15622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789785306.778789:0:15622:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789785306.778795:0:15622:0:(import.c:65:import_set_state_nolock()) ffff9dae8254e000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789785306.778800:0:15622:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789785306.778805:0:15622:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dafb113e680 x1876725549143168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789785320 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785306.778812:0:15622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789785306.778815:0:15622:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00010000:00010000:0.0:1789785306.778935:0:9538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789785306.778942:0:9538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09200/0x2f18ee3fd845c2c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c2c8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785306.778950:0:9538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09200 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:0.0:1789785306.778954:0:9538:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09200/0x2f18ee3fd845c2c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c2c8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785306.778970:0:9538:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09200/0x2f18ee3fd845c2c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f18ee3fd845c2c8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789785306.778978:0:9538:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09200/0x2f18ee3fd845c2c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f18ee3fd845c2c8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785306.778984:0:9538:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789785306.778987:0:9538:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789785306.778989:0:9538:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789785306.779003:0:9538:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dafacaaa000 00010000:00010000:0.0:1789785306.779007:0:9538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09200/0x2f18ee3fd845c2c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f18ee3fd845c2c8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785306.779013:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09200/0x2f18ee3fd845c2c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f18ee3fd845c2c8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785306.779035:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785306.779036:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785306.779038:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785306.779065:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1876725549143168:0@lo:38:kworker.0 00000100:00080000:2.0:1789785306.780002:0:15622:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789785306.780012:0:15622:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dafb113ce00 x1876725549143296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785321 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785306.780033:0:15622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789785306.780037:0:15622:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789785306.780058:0:15622:0:(import.c:65:import_set_state_nolock()) ffff9dafb729d800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789785306.780389:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549143296:0@lo:400:kworker.0 00000100:00100000:0.0:1789785306.780420:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3658:1876725549143680:0@lo:39:umount.0 00000400:00000100:0.0:1789785306.780467:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876725549143680 offset 0 length 224: 4 00000100:00080000:3.0:1789785306.946937:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8e00759f-51ad-47f9-8892-382c83919083->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789785306.946947:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8e00759f-51ad-47f9-8892-382c83919083->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789785306.946950:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789785306.946953:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789785306.947188:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789785306.951420:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549143808:0@lo:400:kworker.0 00000400:00000100:2.0:1789785306.951576:0:3661:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876725549143808 offset 0 length 224: 4 00010000:00010000:0.0:1789785307.138559:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785308.162567:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789785308.484951:0:9529:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789785308.484960:0:9529:0:(genops.c:885:class_export_put()) final put ffff9dae83734000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789785308.485088:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae83734000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789785308.485140:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dae83731800 for lustre-OST0001 00000001:00100000:0.0:1789785308.487710:0:8445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789785308.487731:0:8445:0:(genops.c:885:class_export_put()) final put ffff9dae81ec8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789785308.487941:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae81ec8800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789785308.487994:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dae81ecf800 for lustre-OST0000 00010000:00010000:0.0:1789785309.186529:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785310.210667:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789785310.981947:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8e00759f-51ad-47f9-8892-382c83919083->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789785310.981958:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8e00759f-51ad-47f9-8892-382c83919083->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789785310.981961:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789785310.981964:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789785310.982126:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1876725549143936:0@lo:400:kworker.0 00000400:00000100:3.0:1789785310.982190:0:3659:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876725549143936 offset 0 length 224: 4 00010000:00010000:2.0:1789785311.236393:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785312.263480:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785312.963218:0:3658:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789785302/real 1789785302] req@ffff9dae846a1500 x1876725549142784/t0(0) o250->MGC192.168.203.146@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789785312 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785312.963261:0:3658:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dae846a1500 x1876725549142784/t0(0) o250->MGC192.168.203.146@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789785312 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789785312.963307:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dafacaaa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789785312.963357:0:3658:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1789785312.963363:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e00759f-51ad-47f9-8892-382c83919083:3658:1876725549142784:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:1.0:1789785312.963650:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8e00759f-51ad-47f9-8892-382c83919083->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789785312.963656:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1789785312.963658:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dafacaaa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789785312.963663:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.146@tcp: connect to NID 0@lo last attempt 410 00000100:00080000:1.0:1789785312.963668:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.146@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789785312.963675:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.146@tcp: import ffff9dafacaaa000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:1.0:1789785312.963705:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafb113c000 x1876725549144064/t0(0) o250->MGC192.168.203.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789785312.963732:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789785312.963736:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789785312.963878:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e00759f-51ad-47f9-8892-382c83919083:3658:1876725549144064:0@lo:250:kworker.0 00000400:00000100:2.0:1789785312.963925:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876725549144064 offset 0 length 520: 4 00000100:00100000:0.0:1789785312.964712:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1876725549144192:0@lo:400:kworker.0 00000400:00000100:0.0:1789785312.964746:0:3660:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876725549144192 offset 0 length 224: 4 00010000:00010000:0.0:1789785313.282572:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785314.308529:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785315.332580:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785316.034477:0:3658:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789785306/real 1789785306] req@ffff9daf82c81880 x1876725549143680/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789785316 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785316.034511:0:3658:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9daf82c81880 x1876725549143680/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789785316 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789785316.034529:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dafb729d800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789785316.034543:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3658:1876725549143680:0@lo:39:umount.0 00000100:00080000:2.0:1789785316.034613:0:15622:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789785316.034619:0:15622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789785316.034625:0:15622:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789785316.038094:0:15622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65e00/0x2f18ee3fd845c2cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c2d6 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785316.038114:0:15622:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65e00/0x2f18ee3fd845c2cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c2d6 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785316.038122:0:15622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65e00/0x2f18ee3fd845c2cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c2d6 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785316.038129:0:15622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65e00/0x2f18ee3fd845c2cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c2d6 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785316.038159:0:15622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789785316.038167:0:15622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf80031600/0x2f18ee3fd845c545 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c54c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785316.038173:0:15622:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf80031600/0x2f18ee3fd845c545 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c54c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785316.038197:0:15622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf80031600/0x2f18ee3fd845c545 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c54c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785316.038204:0:15622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff9daf80031600/0x2f18ee3fd845c545 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c54c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785316.038496:0:15622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789785316.038502:0:15622:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789785316.038528:0:15622:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789785316.038532:0:15622:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789785316.038537:0:15622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789785316.038542:0:15622:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789785316.038546:0:15622:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9dafb5c399b8) has no exports 00000020:00080000:2.0:1789785316.038567:0:15622:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9dafb5c399b8) has no exports 00010000:00010000:0.0:1789785316.049672:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789785316.049690:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65e00/0x2f18ee3fd845c2cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c2d6 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785316.049702:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65e00 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:0.0:1789785316.049707:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65e00/0x2f18ee3fd845c2cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c2d6 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785316.049749:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65e00/0x2f18ee3fd845c2cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f18ee3fd845c2d6 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789785316.049756:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65e00/0x2f18ee3fd845c2cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f18ee3fd845c2d6 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785316.049762:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789785316.049765:0:6522:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1789785316.049768:0:6522:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1789785316.049787:0:6522:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dafacaaa000 00010000:00010000:0.0:1789785316.049791:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65e00/0x2f18ee3fd845c2cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f18ee3fd845c2d6 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785316.049798:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65e00/0x2f18ee3fd845c2cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f18ee3fd845c2d6 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785316.049813:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789785316.049817:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9daf80031600/0x2f18ee3fd845c545 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c54c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785316.049823:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf80031600 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:0.0:1789785316.049826:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9daf80031600/0x2f18ee3fd845c545 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c54c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785316.049833:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9daf80031600/0x2f18ee3fd845c545 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f18ee3fd845c54c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789785316.049839:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9daf80031600/0x2f18ee3fd845c545 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f18ee3fd845c54c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785316.050115:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789785316.050118:0:6522:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789785316.050120:0:6522:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789785316.050128:0:6522:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dafacaaa000 00010000:00010000:0.0:1789785316.050131:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9daf80031600/0x2f18ee3fd845c545 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f18ee3fd845c54c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785316.050137:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9daf80031600/0x2f18ee3fd845c545 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f18ee3fd845c54c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785316.050148:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785316.050150:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785316.050152:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789785316.051999:0:15622:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dae8380a540 - data ffff9daf9fab7360/ffff9dafbb4ffc00 00000020:01000000:2.0:1789785316.052153:0:15622:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dae824eb7e0 - data ffff9daf9f98dd80/ffff9dae8251f000 00010000:00010000:3.0:1789785316.052517:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1789785316.071152:0:15622:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789785316.090888:0:15622:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c021 00000020:00000080:1.0:1789785316.090903:0:15622:0:(genops.c:885:class_export_put()) final put ffff9dae81ece000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1789785316.090927:0:15622:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dafb5cd8800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1789785316.090943:0:15622:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dafb5cd8800 2 00000020:01000004:1.0:1789785316.090946:0:15622:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dafb5cd8800 from lustre-OST0000 00000020:00000080:1.0:1789785316.090980:0:15622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789785316.090991:0:15622:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1789785316.090994:0:15622:0:(genops.c:885:class_export_put()) final put ffff9dae81eca800/lustre-OST0000_UUID 00000020:00000080:1.0:1789785316.090997:0:15622:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae81eca800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1789785316.091004:0:15622:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1789785316.091059:0:15622:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1789785316.091063:0:15622:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789785316.091067:0:15622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789785316.091071:0:15622:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789785316.091078:0:15622:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9dae8254e800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789785316.091083:0:15622:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9dae82553370) has exports, disconnecting them 00000020:00080000:1.0:1789785316.091088:0:15622:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9dae8254e800), last request at 1789785075 00000020:00000080:1.0:1789785316.091091:0:15622:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c04b 00000020:00080000:1.0:1789785316.091102:0:15622:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dae8254e800): rc 0 00000020:00000080:1.0:1789785316.091106:0:15622:0:(genops.c:885:class_export_put()) final put ffff9dae8254e800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789785316.092595:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae81ece000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789785316.092612:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae8254e800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789785316.092640:0:15622:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789785316.092644:0:15622:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789785316.092649:0:15622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789785316.092655:0:15622:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789785316.092810:0:15622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789785316.092816:0:15622:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1789785316.092821:0:15622:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789785316.092826:0:15622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789785316.092830:0:15622:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789785316.092836:0:15622:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9dae8254c800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789785316.092842:0:15622:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9dae825519b8) has exports, disconnecting them 00000020:00080000:0.0:1789785316.092846:0:15622:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9dae8254c800), last request at 1789785075 00000020:00000080:0.0:1789785316.092863:0:15622:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c060 00000020:00080000:0.0:1789785316.092884:0:15622:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dae8254c800): rc 0 00000020:00000080:0.0:1789785316.092889:0:15622:0:(genops.c:885:class_export_put()) final put ffff9dae8254c800/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1789785316.093735:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dae8254e000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789785316.093745:0:8:0:(genops.c:885:class_export_put()) final put ffff9dae8254c000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1789785316.093747:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae8254c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1789785316.093752:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1789785316.093810:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae8254c800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1789785316.097463:0:15622:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789785316.097472:0:15622:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789785316.097476:0:15622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789785316.097484:0:15622:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789785316.097517:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dafb729d800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1789785316.097707:0:15622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789785316.097728:0:15622:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1789785316.097734:0:15622:0:(genops.c:885:class_export_put()) final put ffff9dae8254d000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1789785316.097737:0:15622:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae8254d000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1789785316.097743:0:15622:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1789785316.097804:0:15622:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dafb5cd8800 1 00000020:00000080:2.0:1789785316.097811:0:15622:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845bfe9 00000020:00000080:2.0:1789785316.097818:0:15622:0:(genops.c:885:class_export_put()) final put ffff9dafb5e6e000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789785316.097827:0:15622:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789785316.097834:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafb5e6e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789785316.097842:0:15622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789785316.097847:0:15622:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789785316.097864:0:15622:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9dafac8ccd28) has no exports 00000020:00000080:2.0:1789785316.285075:0:15622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789785316.285089:0:15622:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1789785316.285094:0:15622:0:(genops.c:885:class_export_put()) final put ffff9dafb5cdd800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789785316.285099:0:15622:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafb5cdd800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1789785316.285107:0:15622:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1789785316.285238:0:15622:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dafb5cdb800 00000020:02000400:2.0:1789785316.285294:0:15622:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789785316.354738:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785317.381449:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789785318.214282:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8e00759f-51ad-47f9-8892-382c83919083->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789785318.214294:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8e00759f-51ad-47f9-8892-382c83919083->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789785318.214300:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789785318.214306:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789785318.214388:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789785318.214404:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1876725549144320:0@lo:400:kworker.0 00000400:00000100:2.0:1789785318.214631:0:3662:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876725549144320 offset 0 length 224: 4 00010000:00010000:2.0:1789785318.405401:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785319.428664:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789785320.085874:0:15824:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1789785320.106474:0:15824:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789785320.106559:0:15824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf829d3c00/0x2f18ee3fd845c2a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c2ac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785320.106576:0:15824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf829d3c00/0x2f18ee3fd845c2a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c2ac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785320.106584:0:15824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf829d3c00/0x2f18ee3fd845c2a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c2ac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785320.106602:0:15824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff9daf829d3c00/0x2f18ee3fd845c2a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c2ac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785320.106626:0:15824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789785320.106632:0:15824:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789785320.106656:0:15824:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789785320.106670:0:15824:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dafb113d500 x1876725549143424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789785320 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785320.106688:0:15824:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789785320.106695:0:15824:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789785320.106701:0:15824:0:(import.c:65:import_set_state_nolock()) ffff9dae829b5000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789785320.106706:0:15824:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789785320.106710:0:15824:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dafb113d500 x1876725549143424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789785320 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785320.106716:0:15824:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789785320.106720:0:15824:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789785320.106853:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789785320.106861:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9daf829d3c00/0x2f18ee3fd845c2a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c2ac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785320.106869:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf829d3c00 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:3.0:1789785320.106873:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9daf829d3c00/0x2f18ee3fd845c2a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c2ac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785320.106894:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9daf829d3c00/0x2f18ee3fd845c2a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f18ee3fd845c2ac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789785320.106901:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9daf829d3c00/0x2f18ee3fd845c2a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f18ee3fd845c2ac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785320.106907:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789785320.106909:0:6522:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789785320.106924:0:6522:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789785320.107008:0:6522:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dafacaaa000 00010000:00010000:3.0:1789785320.107013:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9daf829d3c00/0x2f18ee3fd845c2a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f18ee3fd845c2ac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785320.107019:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9daf829d3c00/0x2f18ee3fd845c2a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f18ee3fd845c2ac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785320.107031:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785320.107033:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785320.107034:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785320.107076:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1876725549143424:0@lo:38:kworker.0 00000100:00080000:0.0:1789785320.108108:0:15824:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789785320.108121:0:15824:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dafb113f480 x1876725549143552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785321 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785320.108148:0:15824:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dae846a0e00 x1876725549143808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785322 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785320.108160:0:15824:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dafbf453100 x1876725549143936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785326 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785320.108171:0:15824:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dafb113c700 x1876725549144192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785328 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785320.108189:0:15824:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9daf82c82d80 x1876725549144320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785334 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785320.108197:0:15824:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1789785320.108243:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1876725549144192:0@lo:400:kworker.0 00000100:00080000:0.0:1789785320.108280:0:15824:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789785320.108304:0:15824:0:(import.c:65:import_set_state_nolock()) ffff9dae83733000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789785320.108509:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1876725549144320:0@lo:400:kworker.0 00000100:00100000:3.0:1789785320.108518:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1876725549143552:0@lo:400:kworker.0 00000100:00100000:3.0:1789785320.108547:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549143808:0@lo:400:kworker.0 00000100:00100000:3.0:1789785320.108566:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1876725549143936:0@lo:400:kworker.0 00000100:00100000:3.0:1789785320.108585:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf451180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3658:1876725549144448:0@lo:39:umount.0 00000400:00000100:3.0:1789785320.108709:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876725549144448 offset 0 length 224: 4 00010000:00010000:2.0:1789785320.452884:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785321.474485:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785322.498607:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789785323.330867:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8e00759f-51ad-47f9-8892-382c83919083->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789785323.330877:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8e00759f-51ad-47f9-8892-382c83919083->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1789785323.522809:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785324.546708:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785325.570575:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785326.597910:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785327.298789:0:3658:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789785312/real 1789785312] req@ffff9dafb113c000 x1876725549144064/t0(0) o250->MGC192.168.203.146@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789785327 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785327.298822:0:3658:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dafb113c000 x1876725549144064/t0(0) o250->MGC192.168.203.146@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789785327 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789785327.298842:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dafacaaa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789785327.298869:0:3658:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1789785327.298873:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e00759f-51ad-47f9-8892-382c83919083:3658:1876725549144064:0@lo:250:kworker.0 00000100:00080000:2.0:1789785327.299309:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8e00759f-51ad-47f9-8892-382c83919083->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789785327.299314:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1789785327.299317:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dafacaaa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789785327.299322:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.146@tcp: connect to NID 0@lo last attempt 421 00000100:00080000:2.0:1789785327.299326:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.146@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789785327.299332:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.146@tcp: import ffff9dafacaaa000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:2.0:1789785327.299382:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9daf82c81f80 x1876725549144576/t0(0) o250->MGC192.168.203.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789785327.299624:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e00759f-51ad-47f9-8892-382c83919083:3658:1876725549144576:0@lo:250:kworker.0 00000400:00000100:1.0:1789785327.299678:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876725549144576 offset 0 length 520: 4 00010000:00010000:1.0:1789785327.618557:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785328.646958:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785329.666556:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785330.370476:0:3658:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789785320/real 1789785320] req@ffff9dafbf451180 x1876725549144448/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789785330 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785330.370633:0:3658:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dafbf451180 x1876725549144448/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789785330 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789785330.370655:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dae83733000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789785330.370675:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf451180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3658:1876725549144448:0@lo:39:umount.0 00000100:00080000:0.0:1789785330.371108:0:15824:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789785330.371113:0:15824:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789785330.371118:0:15824:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789785330.373040:0:15824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c2b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c2ba expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785330.373058:0:15824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c2b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c2ba expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785330.373066:0:15824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c2b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c2ba expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785330.373073:0:15824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c2b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c2ba expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785330.373116:0:15824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789785330.373131:0:15824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845c537 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845c53e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785330.373139:0:15824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845c537 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845c53e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785330.373145:0:15824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845c537 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c53e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785330.373151:0:15824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845c537 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f18ee3fd845c53e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785330.373171:0:15824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789785330.373176:0:15824:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1789785330.373203:0:15824:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1789785330.373208:0:15824:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1789785330.373212:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789785330.373218:0:15824:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00010000:00010000:3.0:1789785330.373222:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00080000:0.0:1789785330.373223:0:15824:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9dae82b28000) has no exports 00010000:00010000:3.0:1789785330.373232:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c2b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c2ba expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785330.373243:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eaca00 already unused, calling callback (ffffffffc12b7c20) 00000020:00080000:0.0:1789785330.373248:0:15824:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9dae82b28000) has no exports 10000000:00010000:3.0:1789785330.373256:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c2b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c2ba expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785330.373267:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c2b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f18ee3fd845c2ba expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789785330.373274:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c2b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f18ee3fd845c2ba expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785330.373280:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789785330.373282:0:6522:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1789785330.373284:0:6522:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1789785330.373298:0:6522:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dafacaaa000 00010000:00010000:3.0:1789785330.373302:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c2b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f18ee3fd845c2ba expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785330.373589:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dae81eaca00/0x2f18ee3fd845c2b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f18ee3fd845c2ba expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785330.373605:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789785330.373609:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845c537 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c53e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785330.373614:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09c00 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:3.0:1789785330.373618:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845c537 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f18ee3fd845c53e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785330.373624:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845c537 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f18ee3fd845c53e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789785330.373630:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845c537 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f18ee3fd845c53e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785330.373643:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789785330.373646:0:6522:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789785330.373648:0:6522:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789785330.373654:0:6522:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dafacaaa000 00010000:00010000:3.0:1789785330.373657:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845c537 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f18ee3fd845c53e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785330.373664:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845c537 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f18ee3fd845c53e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785330.373678:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785330.373680:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785330.373682:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785330.374099:0:9538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789785330.379110:0:15824:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dae8380a1e0 - data ffff9daf9fabad80/ffff9dafbb4fec00 00000020:01000000:0.0:1789785330.380041:0:15824:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dae8380a5a0 - data ffff9daf9fada438/ffff9dafb5faf800 00100000:10000000:0.0:1789785330.389285:0:15824:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789785330.396717:0:15824:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c147 00000020:00000080:1.0:1789785330.396729:0:15824:0:(genops.c:885:class_export_put()) final put ffff9dae81ecc000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1789785330.396740:0:15824:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dae829a7000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1789785330.396744:0:15824:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dae829a7000 2 00000020:01000004:1.0:1789785330.396746:0:15824:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dae829a7000 from lustre-OST0001 00000020:00000080:1.0:1789785330.396774:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789785330.396782:0:15824:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1789785330.396785:0:15824:0:(genops.c:885:class_export_put()) final put ffff9dae829b2000/lustre-OST0001_UUID 00000020:00000080:1.0:1789785330.396788:0:15824:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae829b2000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1789785330.396794:0:15824:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1789785330.396889:0:15824:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 8e00759f-51ad-47f9-8892-382c83919083->MGS 00010000:00010000:1.0:1789785330.396903:0:15824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc2051800/0x2f18ee3fd845bea0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f18ee3fd845bea7 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789785330.396915:0:15824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc2051800/0x2f18ee3fd845bea0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f18ee3fd845bea7 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785330.396922:0:15824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1789785330.396924:0:15824:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1789785330.396927:0:15824:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1789785330.396940:0:15824:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dafacaaa000 00010000:00010000:1.0:1789785330.396943:0:15824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc2051800/0x2f18ee3fd845bea0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f18ee3fd845bea7 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785330.396955:0:15824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dae81ead200/0x2f18ee3fd845c315 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f18ee3fd845c31c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789785330.396961:0:15824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dae81ead200/0x2f18ee3fd845c315 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f18ee3fd845c31c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785330.396965:0:15824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789785330.396967:0:15824:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1789785330.396969:0:15824:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1789785330.396976:0:15824:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dafacaaa000 00010000:00010000:1.0:1789785330.397047:0:15824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dae81ead200/0x2f18ee3fd845c315 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f18ee3fd845c31c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789785330.397073:0:15824:0:(import.c:65:import_set_state_nolock()) ffff9dafacaaa000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1789785330.397077:0:15824:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789785330.397079:0:15824:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789785330.397080:0:15824:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789785330.397084:0:15824:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789785330.397093:0:15824:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9daf82c81f80 x1876725549144576/t0(0) o250->MGC192.168.203.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789785347 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789785330.397898:0:15824:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789785330.397904:0:15824:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:2.0:1789785330.397990:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e00759f-51ad-47f9-8892-382c83919083:3658:1876725549144576:0@lo:250:kworker.0 10000000:01000000:1.0:1789785330.398432:0:15824:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789785330.398441:0:15824:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845bd9d 00000020:00000080:1.0:1789785330.398448:0:15824:0:(genops.c:885:class_export_put()) final put ffff9dafacaae800/8e00759f-51ad-47f9-8892-382c83919083 00000020:01000000:1.0:1789785330.398455:0:15824:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.146@tcp (flags='') 00000020:00000080:1.0:1789785330.398462:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789785330.398468:0:15824:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.146@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789785330.398472:0:15824:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9daf983fcd28) has no exports 10000000:01000000:2.0:1789785330.398523:0:6531:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1789785330.398607:0:15824:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.146@tcp: client import never connected 00000100:00080000:1.0:1789785330.398610:0:15824:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1789785330.398613:0:15824:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789785330.398615:0:15824:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1789785330.398617:0:15824:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789785330.398651:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789785330.398657:0:15824:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.146@tcp (uuid 8e00759f-51ad-47f9-8892-382c83919083) 00000020:01000000:1.0:1789785330.398663:0:15824:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789785330.398666:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789785330.398669:0:15824:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789785330.398673:0:15824:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9dafb5e6a000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789785330.398678:0:15824:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9dafbb223370) has exports, disconnecting them 00000020:00080000:1.0:1789785330.398683:0:15824:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9dafb5e6a000), last request at 1789785095 00000020:00000080:1.0:1789785330.398686:0:15824:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c171 00000020:00080000:1.0:1789785330.398706:0:15824:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dafb5e6a000): rc 0 00000020:00000080:1.0:1789785330.398710:0:15824:0:(genops.c:885:class_export_put()) final put ffff9dafb5e6a000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789785330.399247:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae81ecc000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789785330.399261:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafacaae800/8e00759f-51ad-47f9-8892-382c83919083 for MGC192.168.203.146@tcp 00000020:00000080:3.0:1789785330.399267:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dafacaaa000 for MGC192.168.203.146@tcp 00000020:00000080:3.0:1789785330.399272:0:36:0:(genops.c:885:class_export_put()) final put ffff9dafacaae000/8e00759f-51ad-47f9-8892-382c83919083 00000020:00000080:3.0:1789785330.399274:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafacaae000/8e00759f-51ad-47f9-8892-382c83919083 for MGC192.168.203.146@tcp 00000020:01000000:3.0:1789785330.399278:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.146@tcp (8e00759f-51ad-47f9-8892-382c83919083) 00000020:00000080:3.0:1789785330.399591:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafb5e6a000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1789785330.418647:0:15824:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789785330.418656:0:15824:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789785330.418660:0:15824:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789785330.418668:0:15824:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789785330.418863:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789785330.418870:0:15824:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1789785330.418875:0:15824:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789785330.418880:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789785330.418884:0:15824:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789785330.418890:0:15824:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9dae83730000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789785330.418897:0:15824:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9dae83720000) has exports, disconnecting them 00000020:00080000:1.0:1789785330.418901:0:15824:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9dae83730000), last request at 1789785095 00000020:00000080:1.0:1789785330.418906:0:15824:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c17f 00000020:00080000:1.0:1789785330.418919:0:15824:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dae83730000): rc 0 00000020:00000080:1.0:1789785330.418923:0:15824:0:(genops.c:885:class_export_put()) final put ffff9dae83730000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1789785330.419548:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dae829b5000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789785330.419556:0:36:0:(genops.c:885:class_export_put()) final put ffff9dae82548800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789785330.419559:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae82548800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789785330.419565:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789785330.421097:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae83730000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1789785330.446580:0:15824:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789785330.446589:0:15824:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789785330.446593:0:15824:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789785330.446600:0:15824:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789785330.446708:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1789785330.446831:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:3.0:1789785330.447059:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dae83733000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1789785330.447463:0:9538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1789785330.447926:0:8466:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9dae81ea6000:8466] 2 exiting: rc = 0 00000100:00100000:2.0:1789785330.448095:0:6517:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9daf9a856800:6517] 1 exiting: rc = 0 00000100:00100000:2.0:1789785330.448170:0:6516:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9daf9a857200:6516] 0 exiting: rc = 1 00000100:00100000:3.0:1789785330.448628:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.448946:0:6520:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9dafa66ce600:6520] 2 exiting: rc = 0 00000100:00100000:0.0:1789785330.449164:0:7484:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9dafbb1b6800:7484] 3 exiting: rc = 0 00000100:00100000:3.0:1789785330.449238:0:15420:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9daf9066ca00:15420] 4 exiting: rc = 0 00000100:00100000:1.0:1789785330.449724:0:6518:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9dafa6692a00:6518] 0 exiting: rc = 1 00000100:00100000:0.0:1789785330.449835:0:6519:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9daf854d5600:6519] 1 exiting: rc = 0 00000100:00100000:3.0:1789785330.450004:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450013:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450020:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450026:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450032:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450038:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450044:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450050:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450057:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450063:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450069:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450075:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450083:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450089:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450095:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450101:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450106:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450131:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450138:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450144:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450150:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450155:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450160:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450164:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450169:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450174:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450180:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450185:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450190:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450195:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450199:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450204:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450210:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450226:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450231:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450236:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450240:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450244:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450249:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450254:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450267:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450272:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450277:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450281:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450285:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450289:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450293:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450297:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450302:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450307:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450311:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450315:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450320:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450324:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450329:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450333:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450357:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450363:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450367:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450371:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450376:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450380:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450385:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.450389:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789785330.452735:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789785330.452746:0:15824:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1789785330.452752:0:15824:0:(genops.c:885:class_export_put()) final put ffff9dae829b1000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1789785330.452757:0:15824:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae829b1000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1789785330.452771:0:15824:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1789785330.452825:0:15824:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dae829a7000 1 00000020:00000080:3.0:1789785330.452831:0:15824:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f18ee3fd845c116 00000020:00000080:3.0:1789785330.452837:0:15824:0:(genops.c:885:class_export_put()) final put ffff9dae81ebc800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789785330.452849:0:15824:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789785330.452858:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae81ebc800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789785330.452869:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789785330.452874:0:15824:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789785330.452877:0:15824:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9dafbb220000) has no exports 00000020:00000080:3.0:1789785330.494071:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789785330.494160:0:15824:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789785330.494166:0:15824:0:(genops.c:885:class_export_put()) final put ffff9dae829a7800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789785330.494170:0:15824:0:(genops.c:844:class_export_destroy()) destroying export ffff9dae829a7800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789785330.494177:0:15824:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789785330.494589:0:15824:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dae829a3000 00000020:01000000:3.0:1789785330.494609:0:15824:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789785330.494614:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789785330.494618:0:15824:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789785330.494622:0:15824:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9dafb5c3b370) has no exports 00000020:00000080:3.0:1789785330.494650:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789785330.494656:0:15824:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789785330.494659:0:15824:0:(genops.c:885:class_export_put()) final put ffff9dafb5e6e800/OSS_uuid 00000020:00000080:3.0:1789785330.494661:0:15824:0:(genops.c:844:class_export_destroy()) destroying export ffff9dafb5e6e800/OSS_uuid for OSS 00000020:01000000:3.0:1789785330.494665:0:15824:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1789785330.495006:0:6529:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789785330.495258:0:8450:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9dafba41cc00:8450] 1 exiting: rc = 0 00000100:00100000:3.0:1789785330.495454:0:8449:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9dafb5d49a00:8449] 0 exiting: rc = 1 00000100:00100000:2.0:1789785330.495598:0:8451:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9dafc18d6e00:8451] 2 exiting: rc = 0 00000100:00100000:2.0:1789785330.495663:0:8805:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9dae81ea3200:8805] 3 exiting: rc = 0 00000100:00100000:3.0:1789785330.495909:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.495921:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.495928:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.495934:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.495941:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.495947:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.495952:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.495971:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.495976:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.495982:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.495988:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.495994:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.495999:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496004:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496009:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496015:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496020:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496026:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496031:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496036:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496042:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496048:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496053:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496058:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496062:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496068:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496150:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496159:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496164:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496168:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496173:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496177:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496182:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496187:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496191:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496196:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496200:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496204:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496208:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496212:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496217:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496221:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496233:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496238:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496243:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496248:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496253:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496259:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496264:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496269:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496274:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496280:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496285:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496290:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496294:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496299:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496305:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496310:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496315:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496320:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496325:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496330:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496596:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.496611:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.497821:0:8453:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9dafbb1b7600:8453] 1 exiting: rc = 0 00000100:00100000:1.0:1789785330.498036:0:8452:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9dafbb1b7e00:8452] 0 exiting: rc = 1 00000100:00100000:2.0:1789785330.498593:0:10490:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9dae83a31400:10490] 2 exiting: rc = 0 00000100:00100000:3.0:1789785330.498838:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.498847:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.498853:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.498859:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.498864:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.498868:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.498873:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.498878:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499042:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499050:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499056:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499060:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499066:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499084:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499652:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499662:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499667:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499672:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499678:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499684:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499689:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499704:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499709:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499715:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499720:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499726:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499732:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499737:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499743:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499749:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499755:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499785:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499791:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499797:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499802:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499808:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499814:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499819:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499825:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499831:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499836:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499842:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499848:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499853:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499858:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499862:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499867:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.499873:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.500012:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.500018:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.500023:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.500028:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.500033:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.500037:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.500042:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.500047:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.500052:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.500057:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.500063:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.500068:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.500073:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.500078:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.500083:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.500104:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.504655:0:8455:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9dafc1a83c00:8455] 0 exiting: rc = 1 00000100:00100000:1.0:1789785330.504668:0:8457:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9dafc18e0e00:8457] 2 exiting: rc = 0 00000100:00100000:0.0:1789785330.505418:0:8456:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9dafc18e0000:8456] 1 exiting: rc = 0 00000100:00100000:1.0:1789785330.505737:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505745:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505752:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505757:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505762:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505767:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505773:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505779:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505797:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505802:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505807:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505812:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505818:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505823:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505828:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505834:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505839:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505854:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505860:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505865:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505869:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505875:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505881:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505898:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505905:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505911:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505917:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505923:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505929:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505935:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505941:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505947:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505953:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505959:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505964:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505970:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505976:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505981:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505987:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505992:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.505997:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.506003:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.506008:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.506019:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.506024:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.506030:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.506036:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.506052:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.506058:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.506064:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.506070:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.506204:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.506210:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.506216:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.506222:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.506227:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.506233:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.506239:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.506244:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.506249:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.506254:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.506259:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.506264:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.506278:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789785330.519665:0:8458:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9dafc18e2200:8458] 0 exiting: rc = 1 00000100:00100000:2.0:1789785330.520605:0:8459:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9dafb5c1ba00:8459] 1 exiting: rc = 0 00000100:00100000:0.0:1789785330.521198:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521207:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521212:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521217:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521223:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521228:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521240:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521278:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521285:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521290:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521295:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521300:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521305:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521309:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521314:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521318:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521322:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521327:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521332:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521554:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521562:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521567:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521572:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521578:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521584:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521700:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521718:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521723:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521728:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521733:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521738:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521744:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521748:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521755:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521762:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521769:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521776:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521782:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521788:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521793:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521799:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521804:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521809:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521815:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521821:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521826:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521831:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521836:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521855:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521861:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521866:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521871:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521876:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521882:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521896:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521900:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521906:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521912:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521917:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521922:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521926:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521939:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521944:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789785330.521948:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789785330.522797:0:8460:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9dafc1a4e200:8460] 0 exiting: rc = 1 00000100:00100000:0.0:1789785330.525321:0:8461:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9dafc1a4f400:8461] 1 exiting: rc = 0 00000100:00100000:1.0:1789785330.527234:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527244:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527260:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527293:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527300:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527306:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527313:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527320:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527327:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527334:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527357:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527365:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527370:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527377:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527400:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527425:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527433:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527439:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527445:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527452:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527458:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527465:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527471:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527478:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527483:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527490:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527497:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527518:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527526:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527534:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527542:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527548:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527555:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527563:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527569:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527576:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527582:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527589:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527596:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527618:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527626:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527632:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527638:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527644:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527649:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527655:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527661:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.527667:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.528423:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.528446:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.528452:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.528476:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.528483:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.528488:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.528494:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.528500:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.528505:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.528510:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.528516:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.528521:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.528527:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.528532:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.528537:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789785330.528549:0:15824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789785330.553325:0:15824:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789785349.657093:0:16591:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789785358.903420:0:17190:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789785358.903426:0:17190:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1789785358.903428:0:17190:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789785358.903542:0:17190:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9dafb11eb000 00000020:01000004:2.0:1789785358.903556:0:17190:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1789785358.903563:0:17190:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789785358.903576:0:17190:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9dae83723370) 00000020:00000080:2.0:1789785358.903588:0:17190:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789785358.994335:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789785358.994697:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789785358.997029:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1789785358.998400:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789785359.001505:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789785359.001839:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789785359.002143:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789785359.002542:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1789785359.003235:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789785359.003619:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1789785359.003908:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1789785359.004259:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789785359.004612:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1789785359.004954:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1789785359.005243:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789785359.006328:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789785359.006725:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789785359.007030:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789785359.007506:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789785359.007718:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1789785359.008013:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789785359.008481:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789785359.008724:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789785359.009031:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789785359.009379:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789785359.009693:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1789785359.009952:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789785359.010208:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789785359.010499:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1789785359.010702:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789785359.010988:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1789785359.011310:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789785359.011704:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1789785359.012002:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1789785359.012297:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789785359.012620:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789785359.012927:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1789785359.013209:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789785359.013535:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1789785359.013853:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1789785359.014185:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789785359.014395:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789785359.014727:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1789785359.015029:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789785359.015331:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789785359.015688:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1789785359.015939:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1789785359.019235:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1789785359.019745:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1789785359.020132:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1789785359.021015:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1789785359.021332:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1789785359.024025:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1789785359.025752:0:17190:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789785359.026137:0:17190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789785359.026145:0:17190:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789785359.026158:0:17190:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f18ee3fd845d35a 00000020:01000004:3.0:1789785359.026167:0:17190:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1789785359.026172:0:17190:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789785359.026177:0:17190:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dafb11eb000 from MGS 00000020:01000004:3.0:1789785359.026180:0:17190:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789785359.026190:0:17190:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9dafba55cd28) 00000020:00000080:3.0:1789785359.026200:0:17190:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789785359.026259:0:17190:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dafb11eb000 from MGS, refs=2 00080000:01000000:3.0:1789785359.026264:0:17190:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789785359.026269:0:17190:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f18ee3fd845d368 00000100:00100000:3.0:1789785359.026506:0:17190:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789785359.026724:0:17190:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789785359.026736:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789785359.027407:0:17190:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789785359.027477:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789785359.028275:0:17190:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789785359.034604:0:17190:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789785359.034614:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789785359.037293:0:17190:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789785359.037307:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789785359.040363:0:17190:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789785359.040632:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789785359.044600:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785359.044605:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785359.044607:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785359.046928:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785359.046935:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785359.046937:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785359.048039:0:17190:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789785359.049902:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789785359.061617:0:17190:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1789785359.078061:0:17202:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789785359.078152:0:17190:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789785359.078212:0:17190:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789785359.079111:0:17190:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789785359.079625:0:17190:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789785359.081292:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789785359.081300:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789785359.090730:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789785359.090746:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789785359.091197:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789785359.091204:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789785359.092025:0:17190:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789785359.092045:0:17190:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.146@tcp' 00000020:01000004:2.0:1789785359.092046:0:17190:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789785359.092073:0:17190:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.146@tcp (typ=mgc) 00000020:00000080:2.0:1789785359.092086:0:17190:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.146@tcp (ffff9dae837219b8) 00000020:00000080:2.0:1789785359.092098:0:17190:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789785359.092171:0:17190:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9daf85803800@MGC192.168.203.146@tcp: add connection 192.168.203.146@tcp at head 00010000:00010000:2.0:1789785359.092304:0:17190:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.146@tcp-0 is initialized 00000040:01000000:2.0:1789785359.092310:0:17190:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.146@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789785359.092463:0:17207:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789785359.106071:0:17209:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789785359.106177:0:17190:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.146@tcp (uuid ad642144-cf43-4df2-a5e5-a426cdb5453e) 00000020:00000080:2.0:1789785359.106198:0:17190:0:(genops.c:1385:class_connect()) connect: client ad642144-cf43-4df2-a5e5-a426cdb5453e, cookie 0x2f18ee3fd845d376 00000100:00080000:2.0:1789785359.106210:0:17190:0:(import.c:510:import_select_connection()) MGC192.168.203.146@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789785359.106215:0:17190:0:(import.c:624:import_select_connection()) MGC192.168.203.146@tcp: import ffff9daf85803800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:2.0:1789785359.106245:0:17190:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9daf82c81f80 x1876725549144704/t0(0) o250->MGC192.168.203.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789785359.106272:0:17190:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ad642144-cf43-4df2-a5e5-a426cdb5453e->MGS 00000020:01000004:2.0:1789785359.106302:0:17190:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789785359.106307:0:17190:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789785359.106322:0:17190:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9dae83724d28) 00000020:00000080:2.0:1789785359.106333:0:17190:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789785359.110326:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ad642144-cf43-4df2-a5e5-a426cdb5453e:3658:1876725549144704:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789785359.110428:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785359.110538:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549144704 00000100:00100000:3.0:1789785359.110547:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549144704 00000100:00100000:3.0:1789785359.110578:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789785359.110585:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3658:x1876725549144704:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1789785359.110612:0:17204:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from ad642144-cf43-4df2-a5e5-a426cdb5453e@0@lo t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:3.0:1789785359.110651:0:17204:0:(genops.c:1385:class_connect()) connect: client ad642144-cf43-4df2-a5e5-a426cdb5453e, cookie 0x2f18ee3fd845d384 00000100:00080000:3.0:1789785359.110780:0:17204:0:(import.c:65:import_set_state_nolock()) ffff9dafc189b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789785359.110832:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+5:3658:x1876725549144704:12345-0@lo:250:mount.lustre.0 Request processed in 246us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785359.110839:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789785359.110884:0:3658:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.146@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789785359.110892:0:3658:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.146@tcp: connect to target with instance 0 00000100:00080000:3.0:1789785359.110898:0:3658:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.146@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789785359.110902:0:3658:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789785359.110906:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9daf85803800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789785359.110924:0:3658:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789785359.110934:0:3658:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789785359.110940:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ad642144-cf43-4df2-a5e5-a426cdb5453e:3658:1876725549144704:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789785359.118859:0:17190:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789785359.119054:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789785359.119061:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789785359.121740:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789785359.121756:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789785359.122389:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789785359.122397:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789785359.123652:0:17190:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789785359.123834:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789785359.123840:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789785359.124508:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789785359.124515:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789785359.147665:0:17190:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789785359.147895:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789785359.147902:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789785359.149522:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789785359.149532:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789785359.153571:0:17190:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789785359.153764:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789785359.153769:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789785359.154944:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789785359.154955:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789785359.155602:0:17190:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789785359.155771:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789785359.155777:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789785359.159885:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789785359.159901:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789785359.162200:0:17190:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789785359.162467:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789785359.162474:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789785359.163207:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789785359.163215:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789785359.192728:0:17190:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789785359.193016:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789785359.193023:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789785359.194461:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789785359.194471:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789785359.195811:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789785359.195823:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789785359.197994:0:17190:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789785359.198087:0:17190:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1789785359.198094:0:17190:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.146@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789785359.198289:0:17190:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.146@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789785359.198325:0:17190:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.146@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789785359.198329:0:17190:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789785359.198331:0:17190:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789785359.198333:0:17190:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789785359.198334:0:17190:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789785359.198335:0:17190:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789785359.198375:0:17190:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789785359.198376:0:17190:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789785359.198377:0:17190:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789785359.198379:0:17190:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789785359.198381:0:17190:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789785359.198384:0:17190:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789785359.198386:0:17190:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789785359.198388:0:17190:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789785359.198389:0:17190:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789785359.198390:0:17190:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789785359.198391:0:17190:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789785359.198392:0:17190:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789785359.198393:0:17190:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789785359.198395:0:17190:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789785359.198396:0:17190:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789785359.198396:0:17190:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789785359.198425:0:17190:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789785359.198443:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549144832:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789785359.198520:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785359.198561:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549144832 00000100:00100000:2.0:1789785359.198569:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549144832 00000100:00100000:1.0:1789785359.198569:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafb5c33e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789785359.198607:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789785359.198616:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+5:17190:x1876725549144832:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789785359.198661:0:17206:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789785359.198663:0:17206:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789785359.198665:0:17206:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1789785359.199028:0:17227:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789785359.199456:0:17206:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1789785359.200605:0:17228:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1789785359.200610:0:17228:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1789785359.200614:0:17228:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1789785359.200616:0:17228:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789785359.200780:0:17228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1789785359.200953:0:17206:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789785359.200962:0:17206:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789785359.203654:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+5:17190:x1876725549144832:12345-0@lo:253:mount.lustre.0 Request processed in 5030us (5124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785359.203675:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789785359.203800:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549144832:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789785359.203827:0:17190:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789785359.203830:0:17190:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789785359.203832:0:17190:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789785359.203833:0:17190:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789785359.203834:0:17190:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789785359.203836:0:17190:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789785359.203837:0:17190:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789785359.203838:0:17190:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789785359.203840:0:17190:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789785359.203842:0:17190:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789785359.203843:0:17190:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789785359.203863:0:17190:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dafb11eb000 from lustre-MDT0000 10000000:01000000:2.0:1789785359.203893:0:17190:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789785359.203896:0:17190:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789785359.203900:0:17190:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9dae837219b8 10000000:01000000:2.0:1789785359.203904:0:17190:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789785359.204223:0:17190:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9dae837219b8 from 1 10000000:01000000:2.0:1789785359.204227:0:17190:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789785359.204264:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54000/0x2f18ee3fd845d38b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785359.204275:0:17190:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54000/0x2f18ee3fd845d38b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785359.204285:0:17190:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54000/0x2f18ee3fd845d38b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785359.204304:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549144960:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789785359.204371:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785359.204456:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb40ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1789785359.204496:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549144960 00000100:00100000:3.0:1789785359.204502:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549144960 00000100:00100000:3.0:1789785359.204575:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789785359.204584:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+5:17190:x1876725549144960:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789785359.204597:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785359.204611:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9daf814bb600/0x2f18ee3fd845d392 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d38b expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.204644:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9daf814bb600/0x2f18ee3fd845d392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d38b expref: 6 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.204654:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9daf814bb600/0x2f18ee3fd845d392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d38b expref: 6 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.204671:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bb600, rc 0) 00000100:00100000:3.0:1789785359.204712:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+6:17190:x1876725549144960:12345-0@lo:101:mount.lustre.0 Request processed in 129us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785359.204718:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789785359.204783:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549144960:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789785359.204795:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54000/0x2f18ee3fd845d38b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d392 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785359.204804:0:17190:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54000/0x2f18ee3fd845d38b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d392 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785359.204881:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549145088:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789785359.204908:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785359.205239:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf9823fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789785359.205317:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549145088 00000100:00100000:2.0:1789785359.205322:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549145088 00000100:00100000:2.0:1789785359.205375:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789785359.205390:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+6:17190:x1876725549145088:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789785359.205474:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+6:17190:x1876725549145088:12345-0@lo:501:mount.lustre.0 Request processed in 85us (564us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789785359.205481:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789785359.205556:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549145088:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789785359.205588:0:17190:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789785359.205605:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54000/0x2f18ee3fd845d38b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d392 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785359.205613:0:17190:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54000/0x2f18ee3fd845d38b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d392 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785359.205621:0:17190:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dafb11eb000 10000000:01000000:1.0:1789785359.205625:0:17190:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789785359.205636:0:17190:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9dafb11eb000 10000000:01000000:1.0:1789785359.205639:0:17190:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789785359.205642:0:17190:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9dafb11eb000 from 1 10000000:01000000:1.0:1789785359.205645:0:17190:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789785359.205664:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64800/0x2f18ee3fd845d399 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785359.205671:0:17190:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64800/0x2f18ee3fd845d399 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785359.205679:0:17190:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64800/0x2f18ee3fd845d399 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785359.205692:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549145216:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789785359.205719:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785359.205737:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf9823fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789785359.205829:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549145216 00000100:00100000:2.0:1789785359.205834:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549145216 00000100:00100000:2.0:1789785359.205850:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789785359.205856:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+6:17190:x1876725549145216:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789785359.205863:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785359.205873:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafb5d54e00/0x2f18ee3fd845d3a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d399 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785359.205889:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafb5d54e00/0x2f18ee3fd845d3a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d399 expref: 7 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785359.205896:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafb5d54e00/0x2f18ee3fd845d3a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d399 expref: 7 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785359.205903:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d54e00, rc 0) 00000100:00100000:2.0:1789785359.205946:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+7:17190:x1876725549145216:12345-0@lo:101:mount.lustre.0 Request processed in 89us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785359.205952:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789785359.206170:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549145216:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789785359.206183:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64800/0x2f18ee3fd845d399 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d3a0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785359.206205:0:17190:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64800/0x2f18ee3fd845d399 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d3a0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785359.206218:0:17190:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789785359.206233:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64800/0x2f18ee3fd845d399 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d3a0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785359.206240:0:17190:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64800/0x2f18ee3fd845d399 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d3a0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785359.206246:0:17190:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789785359.206249:0:17190:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789785359.206253:0:17190:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9dafb11eb000 10000000:01000000:1.0:1789785359.206255:0:17190:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789785359.206258:0:17190:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789785359.206260:0:17190:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789785359.206275:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65600/0x2f18ee3fd845d3a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785359.206281:0:17190:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65600/0x2f18ee3fd845d3a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785359.206288:0:17190:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65600/0x2f18ee3fd845d3a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785359.206300:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549145344:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789785359.206326:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785359.206367:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf9823fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789785359.206453:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549145344 00000100:00100000:2.0:1789785359.206458:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549145344 00000100:00100000:2.0:1789785359.206477:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789785359.206482:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+7:17190:x1876725549145344:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789785359.206490:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785359.206497:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafb5d54a00/0x2f18ee3fd845d3ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d3a7 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785359.206517:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafb5d54a00/0x2f18ee3fd845d3ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d3a7 expref: 8 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785359.206526:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafb5d54a00/0x2f18ee3fd845d3ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d3a7 expref: 8 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785359.206533:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d54a00, rc 0) 00000100:00100000:2.0:1789785359.206562:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+8:17190:x1876725549145344:12345-0@lo:101:mount.lustre.0 Request processed in 79us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785359.206568:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789785359.206697:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549145344:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789785359.206708:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65600/0x2f18ee3fd845d3a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d3ae expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785359.206716:0:17190:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65600/0x2f18ee3fd845d3a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d3ae expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785359.206759:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549145472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789785359.206784:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785359.206810:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf9823fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789785359.206856:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549145472 00000100:00100000:2.0:1789785359.206860:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549145472 00000100:00100000:2.0:1789785359.206878:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789785359.206884:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+8:17190:x1876725549145472:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789785359.207124:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+9:17190:x1876725549145472:12345-0@lo:501:mount.lustre.0 Request processed in 239us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785359.207131:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789785359.207254:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549145472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789785359.207282:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549145600:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789785359.207322:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785359.207508:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf9823fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789785359.207561:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549145600 00000100:00100000:0.0:1789785359.207566:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549145600 00000100:00100000:0.0:1789785359.207600:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789785359.207608:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+9:17190:x1876725549145600:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789785359.208564:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+9:17190:x1876725549145600:12345-0@lo:503:mount.lustre.0 Request processed in 953us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785359.208573:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789785359.208726:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549145600:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789785359.209375:0:17229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf450700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad642144-cf43-4df2-a5e5-a426cdb5453e:17229:1876725549145728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789785359.209426:0:17229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785359.209462:0:17229:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84c42a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789785359.209519:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549145728 00000100:00100000:3.0:1789785359.209527:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549145728 00000100:00100000:3.0:1789785359.209563:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789785359.209571:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+9:17229:x1876725549145728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789785359.210564:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+9:17229:x1876725549145728:12345-0@lo:502:llog_process_th.0 Request processed in 990us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785359.210572:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789785359.210808:0:17229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf450700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad642144-cf43-4df2-a5e5-a426cdb5453e:17229:1876725549145728:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789785359.210947:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789785359.210960:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785359.210963:0:17229:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789785359.210968:0:17229:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789785359.210971:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789785359.210985:0:17229:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9dae82550000) 00000020:00000080:1.0:1789785359.211109:0:17229:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789785359.211118:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789785359.211202:0:17229:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789785359.211210:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f18ee3fd845d3bc 00000020:00000080:1.0:1789785359.211606:0:17229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789785359.211611:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785359.211620:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785359.211622:0:17229:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789785359.211626:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789785359.211683:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785359.211686:0:17229:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789785359.211691:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789785359.211699:0:17229:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9dae825519b8) 00000020:00000080:1.0:1789785359.211709:0:17229:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789785359.211714:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789785359.211715:0:17229:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789785359.211718:0:17229:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789785359.211723:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789785359.211766:0:17229:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dafb11eb000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789785359.211778:0:17229:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9dae82553370) 00000020:00000080:1.0:1789785359.211786:0:17229:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789785359.211839:0:17229:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789785359.211844:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f18ee3fd845d3d1 00000020:00000080:1.0:1789785359.211984:0:17229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789785359.211991:0:17229:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789785359.211996:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2f18ee3fd845d3d8 00080000:01000000:1.0:1789785359.212114:0:17229:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789785359.212120:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f18ee3fd845d3df 00010000:00010000:2.0:1789785359.277746:0:17229:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789785359.278298:0:17229:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1789785359.278757:0:17229:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789785359.283882:0:17229:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9dae83720000) 00000020:00000080:2.0:1789785359.283904:0:17229:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789785359.284020:0:17229:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789785359.284028:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f18ee3fd845d3ed 00000020:00000080:2.0:1789785359.287096:0:17229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789785359.293881:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2f18ee3fd845d3f4 00000020:00000080:0.0:1789785359.303078:0:17229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789785359.303095:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785359.303102:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785359.303105:0:17229:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789785359.303108:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789785359.303111:0:17229:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1789785359.303113:0:17229:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789785359.303114:0:17229:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789785359.303124:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789785359.303126:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785359.303128:0:17229:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789785359.303130:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789785359.303135:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785359.303136:0:17229:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789785359.303142:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789785359.303189:0:17229:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789785359.303210:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785359.303213:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785359.303214:0:17229:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789785359.303217:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789785359.303219:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785359.303221:0:17229:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1789785359.303223:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789785359.303229:0:17229:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.146@tcp to nid 0x20000c0a8cb92 (192.168.203.146@tcp) 00000020:00000080:0.0:1789785359.303253:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789785359.303268:0:17229:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9dae82b2b370) 00000020:00000080:0.0:1789785359.303283:0:17229:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1789785359.303289:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789785359.303368:0:17229:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1789785359.303374:0:17229:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789785359.303382:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f18ee3fd845d402 00010000:00080000:0.0:1789785359.303741:0:17229:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9daf85807000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.146@tcp at head 00010000:00010000:0.0:1789785359.310069:0:17229:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1789785359.315492:0:17229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789785359.315508:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789785359.315544:0:17229:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789785359.315564:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f18ee3fd845d409 00000100:00080000:1.0:1789785359.315574:0:17229:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789785359.315580:0:17229:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9daf85807000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:1.0:1789785359.315624:0:17229:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafb113ed80 x1876725549145856/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789785359.315647:0:17229:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1789785359.315697:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785359.315708:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785359.315710:0:17229:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789785359.315713:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789785359.315716:0:17229:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1789785359.315717:0:17229:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789785359.315719:0:17229:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789785359.315720:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789785359.315723:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785359.315724:0:17229:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789785359.315727:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789785359.315730:0:17229:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789785359.315733:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785359.315734:0:17229:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789785359.315737:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789785359.315741:0:17229:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.146@tcp to nid 0x20000c0a8cb92 (192.168.203.146@tcp) 00000020:01000000:1.0:1789785359.315765:0:17229:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789785359.315768:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789785359.315796:0:17229:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9dae82554d28) 00000020:00000080:1.0:1789785359.315896:0:17229:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789785359.315903:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789785359.315972:0:17229:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789785359.315979:0:17229:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789785359.315986:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f18ee3fd845d417 00010000:00080000:1.0:1789785359.316016:0:17229:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dae84462800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.146@tcp at head 00010000:00010000:1.0:1789785359.318236:0:17229:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1789785359.319091:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549145856:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789785359.319165:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785359.319293:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549145856 00000100:00100000:0.0:1789785359.319302:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549145856 00000100:00100000:0.0:1789785359.319359:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789785359.319368:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3658:x1876725549145856:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1789785359.319386:0:17216:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:2.0:1789785359.320403:0:17229:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789785359.321051:0:17229:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789785359.326759:0:17229:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789785359.327028:0:17229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789785359.334849:0:17229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1789785359.338724:0:17235:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789785359.338732:0:17235:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1789785359.343982:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3658:x1876725549145856:12345-0@lo:38:llog_process_th.0 Request processed in 24607us (24810us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789785359.344009:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00000080:0.0:1789785359.344437:0:17229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789785359.344450:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789785359.344494:0:17229:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789785359.344512:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f18ee3fd845d41e 00000100:00080000:0.0:1789785359.344519:0:17229:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789785359.344524:0:17229:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dae84462800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:0.0:1789785359.344566:0:17229:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafbf450700 x1876725549145984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789785359.344582:0:17229:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789785359.344655:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785359.344660:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785359.344662:0:17229:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789785359.344664:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789785359.344667:0:17229:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1789785359.344669:0:17229:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789785359.344670:0:17229:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789785359.344672:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789785359.344674:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785359.344676:0:17229:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789785359.344678:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789785359.344682:0:17229:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789785359.344685:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785359.344686:0:17229:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789785359.344689:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789785359.344692:0:17229:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.146@tcp to nid 0x20000c0a8cb92 (192.168.203.146@tcp) 00000020:01000000:0.0:1789785359.344711:0:17229:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789785359.344714:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789785359.344723:0:17229:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9dae82b299b8) 00000020:00000080:0.0:1789785359.344734:0:17229:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1789785359.344744:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789785359.344809:0:17229:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789785359.344815:0:17229:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1789785359.344821:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f18ee3fd845d42c 00010000:00080000:0.0:1789785359.344848:0:17229:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dafa64af800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.146@tcp at head 00010000:00010000:0.0:1789785359.345048:0:17229:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789785359.345115:0:17229:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789785359.345130:0:17229:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1789785359.346257:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf450700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549145984:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789785359.346306:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876725549145984 offset 0 length 520: 4 00000100:00080000:3.0:1789785359.346373:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9daf85807000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789785359.346378:0:3658:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789785359.346382:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549145856:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789785359.348828:0:17229:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789785359.349072:0:17229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1789785359.349729:0:17229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1789785359.350186:0:17237:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789785359.350192:0:17237:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789785359.351169:0:17229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789785359.351181:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789785359.351217:0:17229:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789785359.351238:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f18ee3fd845d433 00000100:00080000:0.0:1789785359.351319:0:17229:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789785359.351325:0:17229:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dafa64af800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:0.0:1789785359.351488:0:17229:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafbf450380 x1876725549146112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789785359.351549:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549146112:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789785359.351613:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876725549146112 offset 0 length 520: 4 00000100:00080000:0.0:1789785359.351781:0:17229:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789785359.351839:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785359.351844:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785359.351846:0:17229:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789785359.351849:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789785359.351852:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785359.351854:0:17229:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789785359.351856:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789785359.351858:0:17229:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789785359.351860:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785359.351863:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785359.351864:0:17229:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789785359.351874:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789785359.351877:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785359.351879:0:17229:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789785359.351882:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789785359.351920:0:17229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf453480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad642144-cf43-4df2-a5e5-a426cdb5453e:17229:1876725549146240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789785359.351967:0:17229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785359.351998:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549146240 00000100:00100000:0.0:1789785359.352003:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549146240 00000100:00100000:0.0:1789785359.352037:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789785359.352045:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+9:17229:x1876725549146240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789785359.352144:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+9:17229:x1876725549146240:12345-0@lo:502:llog_process_th.0 Request processed in 99us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785359.352151:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789785359.352186:0:17229:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf9a85bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789785359.352205:0:17229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf453480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad642144-cf43-4df2-a5e5-a426cdb5453e:17229:1876725549146240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789785359.352250:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785359.352255:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785359.352257:0:17229:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789785359.352260:0:17229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1789785359.352738:0:17190:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1789785359.352759:0:17190:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789785359.352806:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65600/0x2f18ee3fd845d3a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d3ae expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.352823:0:17190:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65600/0x2f18ee3fd845d3a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d3ae expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785359.352831:0:17190:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dafb11eb000 from 1 10000000:01000000:3.0:1789785359.352833:0:17190:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789785359.352860:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf814bbe00/0x2f18ee3fd845d43a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.352868:0:17190:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9daf814bbe00/0x2f18ee3fd845d43a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.352877:0:17190:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9daf814bbe00/0x2f18ee3fd845d43a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785359.352891:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549146368:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789785359.352930:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785359.352960:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8650d240 going to sleep for 11 seconds 00000100:00100000:0.0:1789785359.352999:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549146368 00000100:00100000:0.0:1789785359.353004:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549146368 00000100:00100000:0.0:1789785359.353060:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789785359.353067:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+9:17190:x1876725549146368:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789785359.353077:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785359.353089:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dae81eace00/0x2f18ee3fd845d441 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d43a expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785359.353108:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dae81eace00/0x2f18ee3fd845d441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d43a expref: 10 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785359.353123:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dae81eace00/0x2f18ee3fd845d441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d43a expref: 10 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785359.353132:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eace00, rc 0) 00000100:00100000:0.0:1789785359.353166:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+10:17190:x1876725549146368:12345-0@lo:101:mount.lustre.0 Request processed in 100us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785359.353172:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789785359.353237:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549146368:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789785359.353257:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9daf814bbe00/0x2f18ee3fd845d43a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d441 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.353266:0:17190:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9daf814bbe00/0x2f18ee3fd845d43a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d441 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785359.353833:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549146496:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789785359.353866:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785359.354267:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8650d240 going to sleep for 11 seconds 00000100:00100000:1.0:1789785359.354492:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549146496 00000100:00100000:1.0:1789785359.354498:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549146496 00000100:00100000:1.0:1789785359.354528:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789785359.354544:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+10:17190:x1876725549146496:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789785359.354559:0:17206:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789785359.354564:0:17206:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789785359.354645:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+10:17190:x1876725549146496:12345-0@lo:256:mount.lustre.0 Request processed in 100us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785359.354652:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789785359.354745:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549146496:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789785359.355276:0:17190:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789785359.355294:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf814bbe00/0x2f18ee3fd845d43a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d441 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.355305:0:17190:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9daf814bbe00/0x2f18ee3fd845d43a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d441 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785359.355313:0:17190:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dafb11eb000 from 1 10000000:01000000:3.0:1789785359.355315:0:17190:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789785359.355359:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d448 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.355367:0:17190:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d448 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.355375:0:17190:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d448 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785359.355391:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549146624:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789785359.355426:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785359.355448:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8650d240 going to sleep for 11 seconds 00000100:00100000:1.0:1789785359.355720:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549146624 00000100:00100000:1.0:1789785359.355725:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549146624 00000100:00100000:1.0:1789785359.355748:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789785359.355754:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+10:17190:x1876725549146624:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789785359.355764:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785359.355776:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1a65000/0x2f18ee3fd845d44f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d448 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785359.355793:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1a65000/0x2f18ee3fd845d44f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d448 expref: 11 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785359.355803:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1a65000/0x2f18ee3fd845d44f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d448 expref: 11 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785359.355811:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a65000, rc 0) 00000100:00100000:1.0:1789785359.355844:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+11:17190:x1876725549146624:12345-0@lo:101:mount.lustre.0 Request processed in 90us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785359.355851:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789785359.356130:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549146624:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789785359.356143:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d448 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d44f expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.356152:0:17190:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d448 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d44f expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785359.356215:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549146752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789785359.356237:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785359.356320:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8650d240 going to sleep for 11 seconds 00000100:00100000:1.0:1789785359.356369:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549146752 00000100:00100000:1.0:1789785359.356373:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549146752 00000100:00100000:1.0:1789785359.356391:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789785359.356397:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+11:17190:x1876725549146752:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789785359.356528:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+11:17190:x1876725549146752:12345-0@lo:501:mount.lustre.0 Request processed in 131us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785359.356542:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789785359.356749:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549146752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789785359.356772:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549146880:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789785359.356804:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785359.356818:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8650d240 going to sleep for 11 seconds 00000100:00100000:1.0:1789785359.356859:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549146880 00000100:00100000:1.0:1789785359.356863:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549146880 00000100:00100000:1.0:1789785359.356886:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789785359.356891:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+11:17190:x1876725549146880:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789785359.357959:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+11:17190:x1876725549146880:12345-0@lo:503:mount.lustre.0 Request processed in 1063us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785359.357968:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789785359.358112:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549146880:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789785359.358591:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c81500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad642144-cf43-4df2-a5e5-a426cdb5453e:17239:1876725549147008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789785359.358683:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785359.358733:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1afba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789785359.358765:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549147008 00000100:00100000:0.0:1789785359.358770:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549147008 00000100:00100000:0.0:1789785359.358828:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789785359.358836:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+11:17239:x1876725549147008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789785359.359207:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+11:17239:x1876725549147008:12345-0@lo:502:llog_process_th.0 Request processed in 370us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785359.359215:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789785359.359357:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c81500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad642144-cf43-4df2-a5e5-a426cdb5453e:17239:1876725549147008:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789785359.359382:0:17239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789785359.359390:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785359.359393:0:17239:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789785359.359399:0:17239:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dafb11eb000 00000020:00000080:2.0:1789785359.359402:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789785359.359409:0:17239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789785359.359411:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785359.359412:0:17239:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789785359.359414:0:17239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789785359.359416:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785359.359418:0:17239:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789785359.359421:0:17239:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dafb11eb000 00000020:00000080:2.0:1789785359.359423:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789785359.359486:0:17239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789785359.359490:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785359.359491:0:17239:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789785359.359493:0:17239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789785359.359496:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785359.359497:0:17239:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789785359.359500:0:17239:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dafb11eb000 00000020:00000080:2.0:1789785359.359502:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789785359.359520:0:17239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789785359.359523:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785359.359524:0:17239:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789785359.359526:0:17239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789785359.359544:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789785359.359546:0:17239:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789785359.359549:0:17239:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dafb11eb000 00000020:00000080:2.0:1789785359.359551:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789785359.359584:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c81500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad642144-cf43-4df2-a5e5-a426cdb5453e:17239:1876725549147136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789785359.359614:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785359.359773:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1afba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789785359.360556:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549147136 00000100:00100000:0.0:1789785359.360563:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549147136 00000100:00100000:0.0:1789785359.360963:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789785359.360974:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+11:17239:x1876725549147136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789785359.361117:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+11:17239:x1876725549147136:12345-0@lo:502:llog_process_th.0 Request processed in 133us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785359.361125:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789785359.361371:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c81500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad642144-cf43-4df2-a5e5-a426cdb5453e:17239:1876725549147136:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789785359.361410:0:17239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785359.361424:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785359.361426:0:17239:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789785359.361430:0:17239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789785359.361547:0:17190:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789785359.363921:0:17190:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789785359.363945:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d448 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d44f expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785359.363959:0:17190:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d448 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d44f expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785359.364050:0:17190:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789785359.364053:0:17190:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dafb11eb000 10000000:01000000:0.0:1789785359.364057:0:17190:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dafb11eb000 10000000:01000000:0.0:1789785359.364061:0:17190:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789785359.364067:0:17190:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dafb11eb000 from 1 10000000:01000000:0.0:1789785359.364070:0:17190:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789785359.364865:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eac200/0x2f18ee3fd845d456 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785359.364877:0:17190:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dae81eac200/0x2f18ee3fd845d456 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785359.364890:0:17190:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dae81eac200/0x2f18ee3fd845d456 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785359.364927:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf453480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549147264:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789785359.364990:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785359.365040:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb35c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789785359.365931:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549147264 00000100:00100000:3.0:1789785359.365940:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549147264 00000100:00100000:3.0:1789785359.365991:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789785359.366000:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+11:17190:x1876725549147264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789785359.366014:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785359.366028:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9daf814ba000/0x2f18ee3fd845d45d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d456 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.366050:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9daf814ba000/0x2f18ee3fd845d45d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d456 expref: 12 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.366061:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9daf814ba000/0x2f18ee3fd845d45d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d456 expref: 12 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.366070:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814ba000, rc 0) 00000100:00100000:3.0:1789785359.366114:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:17190:x1876725549147264:12345-0@lo:101:mount.lustre.0 Request processed in 115us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785359.366120:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789785359.367426:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf453480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549147264:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789785359.367449:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dae81eac200/0x2f18ee3fd845d456 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d45d expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785359.367460:0:17190:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dae81eac200/0x2f18ee3fd845d456 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d45d expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785359.367546:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549147392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789785359.367589:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785359.367623:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549147392 00000100:00100000:2.0:1789785359.367626:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1afb780 going to sleep for 11 seconds 00000100:00100000:1.0:1789785359.367696:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549147392 00000100:00100000:1.0:1789785359.367737:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789785359.367746:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:17190:x1876725549147392:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789785359.367862:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:17190:x1876725549147392:12345-0@lo:501:mount.lustre.0 Request processed in 117us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785359.367870:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789785359.367883:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549147392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789785359.367932:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549147520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789785359.367968:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785359.367988:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549147520 00000100:00100000:2.0:1789785359.367991:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549147520 00000100:00100000:2.0:1789785359.368014:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789785359.368019:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:17190:x1876725549147520:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789785359.368089:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:17190:x1876725549147520:12345-0@lo:503:mount.lustre.0 Request processed in 69us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785359.368106:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789785359.368143:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1afb780 going to sleep for 11 seconds 00000100:00100000:2.0:1789785359.368155:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549147520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789785359.369703:0:17243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c83100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad642144-cf43-4df2-a5e5-a426cdb5453e:17243:1876725549147648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789785359.369761:0:17243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785359.369794:0:17243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1afb780 going to sleep for 11 seconds 00000100:00100000:2.0:1789785359.369812:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549147648 00000100:00100000:2.0:1789785359.369816:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549147648 00000100:00100000:2.0:1789785359.369848:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789785359.369856:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:17243:x1876725549147648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789785359.369960:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:17243:x1876725549147648:12345-0@lo:502:llog_process_th.0 Request processed in 105us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785359.369967:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789785359.370014:0:17243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c83100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad642144-cf43-4df2-a5e5-a426cdb5453e:17243:1876725549147648:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789785359.370065:0:17243:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789785359.370080:0:17243:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9dafb11db370) 00000020:00000080:2.0:1789785359.370097:0:17243:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1789785359.370169:0:17243:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dafb11eb000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789785359.370172:0:17243:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dafb11eb000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789785359.370175:0:17243:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dafb11eb000 4 00010000:00080000:2.0:1789785359.370197:0:17243:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dafc18fe800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.146@tcp at head 00010000:00010000:2.0:1789785359.373685:0:17243:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1789785359.374022:0:17243:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789785359.374063:0:17243:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789785359.374077:0:17243:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2f18ee3fd845d46b 00000100:00080000:2.0:1789785359.374087:0:17243:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789785359.374098:0:17243:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9dafc18fe800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:2.0:1789785359.374130:0:17243:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9daf82c83100 x1876725549147776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789785359.374152:0:17243:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789785359.374392:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1876725549147776:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789785359.374463:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785359.376119:0:17243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad642144-cf43-4df2-a5e5-a426cdb5453e:17243:1876725549147904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789785359.376182:0:17243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785359.376208:0:17243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf85440cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789785359.376835:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549147904 00000100:00100000:2.0:1789785359.376843:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549147904 00000100:00100000:2.0:1789785359.376884:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789785359.376892:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:17243:x1876725549147904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789785359.377034:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:17243:x1876725549147904:12345-0@lo:502:llog_process_th.0 Request processed in 142us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785359.377041:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789785359.377488:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549147776 00000100:00100000:0.0:1789785359.377494:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549147776 00000100:00100000:0.0:1789785359.377519:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789785359.377524:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1876725549147776:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789785359.377703:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1876725549147776:12345-0@lo:38:llog_process_th.0 Request processed in 177us (3239us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789785359.377710:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789785359.377748:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789785359.377756:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dafc18fe800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789785359.377759:0:3658:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789785359.377763:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1876725549147776:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789785359.378747:0:17243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad642144-cf43-4df2-a5e5-a426cdb5453e:17243:1876725549147904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789785359.378816:0:17243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad642144-cf43-4df2-a5e5-a426cdb5453e:17243:1876725549148032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789785359.378867:0:17243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785359.378897:0:17243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf85440cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785359.379083:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549148032 00000100:00100000:3.0:1789785359.379089:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549148032 00000100:00100000:3.0:1789785359.379125:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789785359.379133:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:17243:x1876725549148032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789785359.379240:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:17243:x1876725549148032:12345-0@lo:502:llog_process_th.0 Request processed in 107us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785359.379249:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789785359.379296:0:17243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad642144-cf43-4df2-a5e5-a426cdb5453e:17243:1876725549148032:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789785359.379317:0:17243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789785359.379408:0:17190:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789785359.379435:0:17190:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789785359.379453:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eac200/0x2f18ee3fd845d456 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d45d expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785359.379463:0:17190:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dae81eac200/0x2f18ee3fd845d456 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d45d expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789785359.379520:0:17190:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789785359.379522:0:17190:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789785359.379523:0:17190:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789785359.379524:0:17190:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789785359.379525:0:17190:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789785359.379526:0:17190:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789785359.379527:0:17190:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789785359.379529:0:17190:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789785359.379530:0:17190:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789785359.379532:0:17190:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789785359.379535:0:17190:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789785359.379537:0:17190:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789785359.379539:0:17190:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789785359.379540:0:17190:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789785359.379541:0:17190:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789785359.379547:0:17190:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789785359.379548:0:17190:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789785359.379549:0:17190:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789785359.379550:0:17190:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789785359.379551:0:17190:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789785359.379551:0:17190:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789785359.379565:0:17190:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789785359.379575:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf450e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549148160:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789785359.379604:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785359.379835:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb35cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789785359.380593:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549148160 00000100:00100000:2.0:1789785359.380600:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549148160 00000100:00100000:2.0:1789785359.380645:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789785359.380653:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:17190:x1876725549148160:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789785359.380676:0:17205:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789785359.380688:0:17205:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789785359.384479:0:17205:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789785359.384504:0:17205:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789785359.384521:0:17227:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789785359.384528:0:17227:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789785359.384548:0:17227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9daf814ba800/0x2f18ee3fd845d472 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.384566:0:17227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dae81eace00/0x2f18ee3fd845d441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d43a expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.384575:0:17227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9daf814ba800/0x2f18ee3fd845d472 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.384626:0:17227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dae81eace00/0x2f18ee3fd845d441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845d43a expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.384642:0:17227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dae81eace00/0x2f18ee3fd845d441 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845d43a expref: 12 pid: 17204 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785359.384856:0:17227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1876725549148288:0@lo:104: 00000100:00100000:3.0:1789785359.384953:0:17227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785359.385022:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549148288 00000100:00100000:2.0:1789785359.385054:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:17190:x1876725549148160:12345-0@lo:253:mount.lustre.0 Request processed in 4399us (5446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785359.385064:0:17227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf854403c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789785359.385065:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789785359.385122:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549148288 00000100:00100000:1.0:1789785359.385168:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789785359.385177:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad642144-cf43-4df2-a5e5-a426cdb5453e+3:17227:x1876725549148288:12345-0@lo:104: 00010000:00010000:1.0:1789785359.385189:0:17194:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9daf814bbe00/0x2f18ee3fd845d43a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845d441 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785359.385376:0:17194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789785359.385383:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad642144-cf43-4df2-a5e5-a426cdb5453e+3:17227:x1876725549148288:12345-0@lo:104: Request processed in 208us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785359.385397:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789785359.385416:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789785359.385423:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9daf814bbe00/0x2f18ee3fd845d43a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845d441 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785359.385431:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bbe00 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:1.0:1789785359.385435:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9daf814bbe00/0x2f18ee3fd845d43a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845d441 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785359.385444:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9daf814bbe00/0x2f18ee3fd845d43a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845d441 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789785359.385452:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9daf814bbe00/0x2f18ee3fd845d43a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845d441 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785359.385458:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789785359.385486:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9daf814bbe00/0x2f18ee3fd845d43a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d441 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785359.385493:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789785359.385508:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9daf814bbe00/0x2f18ee3fd845d43a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d441 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785359.385515:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9daf814bbe00/0x2f18ee3fd845d43a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d441 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785359.385736:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad642144-cf43-4df2-a5e5-a426cdb5453e:3662:1876725549148416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789785359.385768:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785359.385832:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549148416 00000100:00100000:3.0:1789785359.385837:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549148416 00010000:00010000:3.0:1789785359.385856:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dae81eace00/0x2f18ee3fd845d441 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845d43a expref: 12 pid: 17204 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785359.385879:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789785359.385886:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:3662:x1876725549148416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789785359.385896:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785359.385901:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dae81eace00/0x2f18ee3fd845d441 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845d43a expref: 12 pid: 17204 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.385920:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dae81eace00/0x2f18ee3fd845d441 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845d43a expref: 12 pid: 17204 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.385936:0:17196:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9daf814ba800/0x2f18ee3fd845d472 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.385956:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9daf814ba800/0x2f18ee3fd845d472 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789785359.385972:0:17196:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001444705s 00010000:00010000:3.0:1789785359.385977:0:17196:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9daf814ba800/0x2f18ee3fd845d472 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.385984:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9daf814ba800/0x2f18ee3fd845d472 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.385991:0:17196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9daf814ba800/0x2f18ee3fd845d472 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.385998:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9daf814ba800/0x2f18ee3fd845d472 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.386004:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814ba800 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:3.0:1789785359.386008:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9daf814ba800/0x2f18ee3fd845d472 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.386014:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9daf814ba800/0x2f18ee3fd845d472 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.386023:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9daf814ba800/0x2f18ee3fd845d472 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.386032:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785359.386066:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:3662:x1876725549148416:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785359.386073:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789785359.386116:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dae81eace00/0x2f18ee3fd845d441 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845d43a expref: 11 pid: 17204 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785359.386127:0:17227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1876725549148288:0@lo:104: 00010000:00010000:3.0:1789785359.386144:0:17227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9daf814ba800/0x2f18ee3fd845d472 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.386152:0:17227:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9daf814ba800/0x2f18ee3fd845d472 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.386158:0:17227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9daf814ba800/0x2f18ee3fd845d472 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785359.386164:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9daf814ba800/0x2f18ee3fd845d472 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785359.386361:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf450e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17190:1876725549148160:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789785359.386372:0:17190:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789785359.386375:0:17190:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789785359.386377:0:17190:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789785359.386378:0:17190:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789785359.386380:0:17190:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789785359.386381:0:17190:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789785359.386382:0:17190:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789785359.386384:0:17190:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789785359.386385:0:17190:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789785359.386387:0:17190:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789785359.386389:0:17190:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789785359.386399:0:17190:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1789785359.386637:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785359.386642:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785359.386644:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785359.388413:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad642144-cf43-4df2-a5e5-a426cdb5453e:3662:1876725549148416:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1789785359.406250:0:17190:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1789785359.406743:0:17190:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1789785359.406751:0:17251:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1789785359.406757:0:17251:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1789785359.407002:0:17252:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789785359.407057:0:17190:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1789785359.407288:0:17252:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:0.0:1789785359.408598:0:17253:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9dafbf450e00 x1876725549148544/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785359.408613:0:17253:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385a900 going to sleep for 0 seconds 00000040:01000000:1.0:1789785359.409215:0:17190:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789785359.409252:0:17190:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789785359.409589:0:17252:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789785359.409647:0:17252:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:1.0:1789785359.410400:0:17190:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789785359.410430:0:17190:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789785359.410480:0:17190:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789785359.411790:0:17190:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789785359.412702:0:17190:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789785359.412740:0:17190:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1789785359.414320:0:17190:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1789785359.415846:0:17190:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1789785359.417266:0:17190:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789785359.417300:0:17190:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa9f300dab988 00100000:10000000:1.0:1789785359.417308:0:17190:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789785359.418598:0:17190:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789785359.418615:0:17190:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.146@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789785359.418794:0:17190:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789785359.418811:0:17190:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1789785359.420132:0:17190:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789785359.420315:0:17190:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789785360.072805:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789785360.392748:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789785360.450600:0:17253:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385a900 going to sleep for 0 seconds 10000000:01000000:0.0:1789785361.091240:0:17209:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789785361.091266:0:17209:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dafb11eb000 from 7 10000000:01000000:0.0:1789785361.091271:0:17209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789785361.091333:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eadc00/0x2f18ee3fd845d479 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785361.091368:0:17209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dae81eadc00/0x2f18ee3fd845d479 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785361.091381:0:17209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dae81eadc00/0x2f18ee3fd845d479 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785361.091417:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf450000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549148672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789785361.091502:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785361.091563:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf83f30d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789785361.091595:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549148672 00000100:00100000:0.0:1789785361.091603:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549148672 00000100:00100000:0.0:1789785361.091750:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789785361.091763:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+11:17209:x1876725549148672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789785361.091780:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785361.091796:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dae81eada00/0x2f18ee3fd845d480 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d479 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785361.091825:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dae81eada00/0x2f18ee3fd845d480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d479 expref: 12 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785361.091838:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dae81eada00/0x2f18ee3fd845d480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d479 expref: 12 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785361.091848:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eada00, rc 0) 00000100:00100000:0.0:1789785361.091892:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:17209:x1876725549148672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (389us total) trans 0 rc 0/0 00010000:00010000:1.0:1789785361.093440:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785361.093890:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf450000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549148672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789785361.093936:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dae81eadc00/0x2f18ee3fd845d479 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d480 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785361.093951:0:17209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dae81eadc00/0x2f18ee3fd845d479 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d480 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785361.094048:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549148800:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789785361.094123:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785361.094162:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafac73ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1789785361.094616:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549148800 00000100:00100000:2.0:1789785361.094626:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549148800 00000100:00100000:0.0:1789785361.100108:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789785361.104956:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789785361.104983:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:17209:x1876725549148800:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789785361.105021:0:17205:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789785361.105050:0:17205:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789785361.105053:0:17205:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789785361.105219:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:17209:x1876725549148800:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 247us (11095us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785361.105229:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789785361.117024:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549148800:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789785361.117118:0:17209:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789785361.117145:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eadc00/0x2f18ee3fd845d479 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d480 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785361.117158:0:17209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dae81eadc00/0x2f18ee3fd845d479 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d480 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789785361.418735:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789785361.475754:0:17253:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385a900 going to sleep for 0 seconds 00010000:00010000:2.0:1789785362.116668:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785362.498510:0:17253:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385a900 going to sleep for 0 seconds 00010000:00010000:1.0:1789785363.141287:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785363.523414:0:17253:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385a900 going to sleep for 0 seconds 00000001:02000400:0.0:1789785363.807541:0:17496:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789785364.162523:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785364.547418:0:17253:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385a900 going to sleep for 0 seconds 00000100:00080000:2.0:1789785364.802998:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789785364.803008:0:15987:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789785364.803013:0:15987:0:(import.c:65:import_set_state_nolock()) ffff9daf85807000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789785364.803023:0:15987:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 467 00000100:00080000:2.0:1789785364.803030:0:15987:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789785364.803039:0:15987:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9daf85807000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:2.0:1789785364.803071:0:15987:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9daf82c82300 x1876725549149056/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789785364.803087:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789785364.803090:0:15987:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789785364.803093:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789785364.803113:0:15987:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789785364.803116:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789785364.803119:0:15987:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789785364.803122:0:15987:0:(import.c:65:import_set_state_nolock()) ffff9dafc18fe800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789785364.803128:0:15987:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9dafc18fe800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:2.0:1789785364.803141:0:15987:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9daf82c83b80 x1876725549149184/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789785364.803233:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad642144-cf43-4df2-a5e5-a426cdb5453e:3659:1876725549148928:0@lo:400:kworker.0 00000100:00100000:0.0:1789785364.803325:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785364.803450:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549149056:0@lo:38:kworker.0 00000100:00100000:0.0:1789785364.803487:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785364.803511:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1876725549149184:0@lo:38:kworker.0 00000100:00100000:0.0:1789785364.803536:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785364.803578:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549149056 00000100:00100000:0.0:1789785364.803588:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549149056 00000100:00100000:0.0:1789785364.803627:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789785364.803636:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3658:x1876725549149056:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789785364.803660:0:17217:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789785364.805049:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549148928 00000100:00100000:2.0:1789785364.805065:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549148928 00000100:00100000:2.0:1789785364.805145:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789785364.805156:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:3659:x1876725549148928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785364.805261:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:3659:x1876725549148928:12345-0@lo:400:kworker.0 Request processed in 105us (1935us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785364.805284:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789785364.805361:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549149184 00000100:00100000:2.0:1789785364.805367:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549149184 00000100:00100000:2.0:1789785364.805391:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789785364.805397:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1876725549149184:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789785364.805423:0:17213:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:2.0:1789785364.805471:0:17213:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2f18ee3fd845d487 00000004:00100000:2.0:1789785364.805491:0:17213:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789785364.805670:0:17213:0:(import.c:65:import_set_state_nolock()) ffff9dafc18f9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789785364.805722:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1876725549149184:12345-0@lo:38:kworker.0 Request processed in 323us (2184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785364.805728:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789785364.816679:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad642144-cf43-4df2-a5e5-a426cdb5453e:3659:1876725549148928:0@lo:400:kworker.0 00010000:00080000:1.0:1789785364.823725:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9daf82c83b80 x1876725549149184/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789785374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789785364.823753:0:3658:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789785364.823766:0:3658:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789785364.823773:0:3658:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789785364.823778:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dafc18fe800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789785364.823787:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1876725549149184:0@lo:38:kworker.0 00000100:00100000:0.0:1789785364.840000:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3658:x1876725549149056:12345-0@lo:38:kworker.0 Request processed in 36350us (36497us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789785364.840018:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789785364.840191:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9daf85807000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789785364.840198:0:3658:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789785364.840203:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549149056:0@lo:38:kworker.0 00000020:00000004:1.0:1789785364.912549:0:17548:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789785364.915107:0:17548:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789785365.187120:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785365.574144:0:17253:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385a900 going to sleep for 0 seconds 00010000:00010000:2.0:1789785366.210775:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789785366.245976:0:17598:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789785366.246221:0:17598:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789785366.595088:0:17253:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385a900 going to sleep for 0 seconds 00010000:00010000:2.0:1789785367.234472:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785367.618413:0:17253:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385a900 going to sleep for 0 seconds 00010000:00010000:3.0:1789785368.260440:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785368.642707:0:17253:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385a900 going to sleep for 0 seconds 00010000:00010000:1.0:1789785369.283465:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785369.666594:0:17253:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385a900 going to sleep for 0 seconds 00000100:00080000:2.0:1789785369.926058:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789785369.926065:0:15987:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789785369.926069:0:15987:0:(import.c:65:import_set_state_nolock()) ffff9daf85807000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789785369.926078:0:15987:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 473 00000100:00080000:2.0:1789785369.926083:0:15987:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789785369.926090:0:15987:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9daf85807000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:2.0:1789785369.926113:0:15987:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9daf82c80700 x1876725549149440/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789785369.926129:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789785369.926133:0:15987:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789785369.926135:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789785369.926138:0:15987:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789785369.926254:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad642144-cf43-4df2-a5e5-a426cdb5453e:3660:1876725549149312:0@lo:400:kworker.0 00000100:00100000:0.0:1789785369.926331:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785369.926463:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549149312 00000100:00100000:2.0:1789785369.926471:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549149312 00000100:00100000:2.0:1789785369.926525:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789785369.926536:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:3660:x1876725549149312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785369.926592:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:3660:x1876725549149312:12345-0@lo:400:kworker.0 Request processed in 58us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785369.926601:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789785369.926825:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad642144-cf43-4df2-a5e5-a426cdb5453e:3660:1876725549149312:0@lo:400:kworker.0 00000100:00100000:1.0:1789785369.926998:0:3658:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789785359/real 1789785359] req@ffff9dafbf450380 x1876725549146112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789785369 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785369.927018:0:3658:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dafbf450380 x1876725549146112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789785369 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785369.927029:0:3658:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789785359/real 1789785359] req@ffff9dafbf450700 x1876725549145984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789785369 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785369.927054:0:3658:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dafbf450700 x1876725549145984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789785369 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785369.927067:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549149440:0@lo:38:kworker.0 00000100:00100000:1.0:1789785369.927099:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789785369.927132:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dafa64af800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789785369.927150:0:3658:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789785369.927153:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549146112:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789785369.927157:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dae84462800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789785369.927161:0:3658:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789785369.927164:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf450700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549145984:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1789785369.927224:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549149440 00000100:00100000:0.0:1789785369.927228:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549149440 00000100:00100000:0.0:1789785369.927255:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789785369.927267:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3658:x1876725549149440:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789785369.927284:0:17216:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1789785369.931041:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789785369.931052:0:15987:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789785369.931075:0:15987:0:(import.c:65:import_set_state_nolock()) ffff9dae84462800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789785369.931083:0:15987:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 467 00000100:00080000:2.0:1789785369.931089:0:15987:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789785369.931096:0:15987:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dae84462800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:2.0:1789785369.931142:0:15987:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9daf82c83800 x1876725549149696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789785369.931166:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789785369.931169:0:15987:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789785369.931171:0:15987:0:(import.c:65:import_set_state_nolock()) ffff9dafa64af800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789785369.931174:0:15987:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 467 00000100:00080000:2.0:1789785369.931177:0:15987:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789785369.931180:0:15987:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dafa64af800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:2.0:1789785369.931193:0:15987:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9daf82c82300 x1876725549149824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789785369.931407:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725549149568:0@lo:400:kworker.0 00000100:00100000:2.0:1789785369.931476:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785369.931911:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549149696:0@lo:8:kworker.0 00000400:00000100:1.0:1789785369.931943:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876725549149696 offset 0 length 520: 4 00000100:00100000:1.0:1789785369.931967:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549149824:0@lo:8:kworker.0 00000400:00000100:1.0:1789785369.931986:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876725549149824 offset 0 length 520: 4 00000100:00100000:3.0:1789785369.932167:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549149568 00000100:00100000:3.0:1789785369.932175:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549149568 00000100:00100000:3.0:1789785369.932268:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789785369.932276:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725549149568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785369.932367:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725549149568:12345-0@lo:400:kworker.0 Request processed in 91us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785369.932375:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789785369.932421:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9daf82c80000 x1876725549149568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785369.932435:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725549149568:0@lo:400:kworker.0 00000100:00100000:1.0:1789785369.952334:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3658:x1876725549149440:12345-0@lo:38:kworker.0 Request processed in 25057us (25225us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789785369.952371:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789785369.953697:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9daf85807000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789785369.953707:0:3658:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789785369.953711:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549149440:0@lo:38:kworker.0 00010000:00010000:3.0:1789785370.312755:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785370.695456:0:17253:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385a900 going to sleep for 0 seconds 00010000:00010000:1.0:1789785371.337734:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789785371.653019:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789785371.728891:0:17253:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385a900 going to sleep for 0 seconds 00010000:00010000:3.0:1789785372.357019:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785372.740872:0:17253:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385a900 going to sleep for 0 seconds 00010000:00010000:0.0:1789785373.379519:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785373.764728:0:17253:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385a900 going to sleep for 0 seconds 00000020:01000004:1.0:1789785373.997572:0:17943:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789785373.997576:0:17943:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1789785373.997578:0:17943:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789785373.997868:0:17943:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9daf89062000 00000020:01000004:1.0:1789785373.997883:0:17943:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1789785373.997900:0:17943:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789785373.997914:0:17943:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9dafb5c3b370) 00000020:00000080:1.0:1789785373.997928:0:17943:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789785374.094757:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789785374.096376:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1789785374.105374:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789785374.105902:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789785374.106145:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1789785374.106395:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1789785374.106578:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789785374.106911:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1789785374.107147:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789785374.108853:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1789785374.109241:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789785374.109595:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789785374.109838:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789785374.110104:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1789785374.110946:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1789785374.111268:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1789785374.111482:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1789785374.111742:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1789785374.111929:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1789785374.112263:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1789785374.112445:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1789785374.116262:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1789785374.116720:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1789785374.116915:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1789785374.117157:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1789785374.117796:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1789785374.118126:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1789785374.122137:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1789785374.122561:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1789785374.122868:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1789785374.123119:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1789785374.123367:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1789785374.124287:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789785374.128833:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1789785374.129819:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1789785374.131078:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1789785374.131905:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789785374.133047:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789785374.134077:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1789785374.134608:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1789785374.135269:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1789785374.135628:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1789785374.136162:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1789785374.136441:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1789785374.136637:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1789785374.137031:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00080000:01000000:3.0:1789785374.138536:0:17943:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789785374.139237:0:17943:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789785374.139248:0:17943:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789785374.139259:0:17943:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f18ee3fd845d495 00000020:01000004:3.0:1789785374.139265:0:17943:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789785374.139284:0:17943:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.146@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789785374.139287:0:17943:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.146@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789785374.139293:0:17943:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789785374.139326:0:17943:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789785374.139330:0:17943:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.146@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1789785374.144375:0:17943:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.146@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789785374.144415:0:17943:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.146@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1789785374.144419:0:17943:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789785374.144421:0:17943:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789785374.144423:0:17943:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789785374.144424:0:17943:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789785374.144426:0:17943:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789785374.144427:0:17943:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789785374.144428:0:17943:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789785374.144430:0:17943:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789785374.144431:0:17943:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789785374.144434:0:17943:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1789785374.144437:0:17943:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789785374.144438:0:17943:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789785374.144439:0:17943:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789785374.144441:0:17943:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789785374.144442:0:17943:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789785374.144443:0:17943:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789785374.144444:0:17943:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789785374.144445:0:17943:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789785374.144446:0:17943:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789785374.144471:0:17943:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789785374.144489:0:17943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549149952:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789785374.144565:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785374.144614:0:17943:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84c40840 going to sleep for 11 seconds 00000100:00100000:0.0:1789785374.144769:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549149952 00000100:00100000:0.0:1789785374.144776:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549149952 00000100:00100000:0.0:1789785374.144832:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789785374.144841:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:17943:x1876725549149952:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789785374.144879:0:17205:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789785374.144882:0:17205:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1789785374.144889:0:17205:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789785374.146178:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:17943:x1876725549149952:12345-0@lo:253:mount.lustre.0 Request processed in 1333us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785374.146199:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789785374.146871:0:17943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549149952:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789785374.146884:0:17943:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789785374.146887:0:17943:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789785374.146889:0:17943:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789785374.146890:0:17943:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789785374.146892:0:17943:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789785374.146893:0:17943:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789785374.146906:0:17943:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789785374.146907:0:17943:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789785374.146909:0:17943:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789785374.146910:0:17943:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789785374.146929:0:17943:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9daf89062000 from lustre-MDT0001 10000000:01000000:1.0:1789785374.146966:0:17943:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1789785374.146969:0:17943:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789785374.146975:0:17943:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dae837219b8 local copy 00010000:00010000:1.0:1789785374.146985:0:17943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54000/0x2f18ee3fd845d38b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d392 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785374.147080:0:17943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549150080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789785374.147117:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785374.147140:0:17943:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84c40300 going to sleep for 11 seconds 00000100:00100000:0.0:1789785374.147465:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549150080 00000100:00100000:0.0:1789785374.147471:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549150080 00000100:00100000:0.0:1789785374.147506:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789785374.147514:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:17943:x1876725549150080:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789785374.147584:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:17943:x1876725549150080:12345-0@lo:501:mount.lustre.0 Request processed in 70us (466us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789785374.147591:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789785374.148002:0:17943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549150080:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789785374.148020:0:17943:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.146@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789785374.148036:0:17943:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.146@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789785374.148042:0:17943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54000/0x2f18ee3fd845d38b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d392 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.148051:0:17943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54000/0x2f18ee3fd845d38b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d392 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785374.148074:0:17943:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9daf89062000 10000000:01000000:1.0:1789785374.148078:0:17943:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789785374.148083:0:17943:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9dae837219b8 10000000:01000000:1.0:1789785374.148085:0:17943:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789785374.148089:0:17943:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9dae837219b8 from 1 10000000:01000000:1.0:1789785374.148092:0:17943:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789785374.148113:0:17943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65200/0x2f18ee3fd845d49c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.148128:0:17943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65200/0x2f18ee3fd845d49c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.148139:0:17943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65200/0x2f18ee3fd845d49c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785374.148151:0:17943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549150208:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789785374.148176:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785374.148208:0:17943:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84c40300 going to sleep for 11 seconds 00000100:00100000:0.0:1789785374.148393:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549150208 00000100:00100000:0.0:1789785374.148398:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549150208 00000100:00100000:0.0:1789785374.148427:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789785374.148434:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+12:17943:x1876725549150208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789785374.148443:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785374.148454:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dae81ead600/0x2f18ee3fd845d4a3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d49c expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785374.148485:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dae81ead600/0x2f18ee3fd845d4a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d49c expref: 13 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785374.148495:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dae81ead600/0x2f18ee3fd845d4a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d49c expref: 13 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785374.148504:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81ead600, rc 0) 00000100:00100000:0.0:1789785374.148543:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+13:17943:x1876725549150208:12345-0@lo:101:mount.lustre.0 Request processed in 110us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785374.148549:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789785374.148813:0:17943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549150208:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789785374.148826:0:17943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65200/0x2f18ee3fd845d49c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d4a3 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.148835:0:17943:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65200/0x2f18ee3fd845d49c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d4a3 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785374.148852:0:17943:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789785374.148866:0:17943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65200/0x2f18ee3fd845d49c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d4a3 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.148873:0:17943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65200/0x2f18ee3fd845d49c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d4a3 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785374.148882:0:17943:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9daf89062000 10000000:01000000:1.0:1789785374.148885:0:17943:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789785374.148889:0:17943:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9daf89062000 from 1 10000000:01000000:1.0:1789785374.148891:0:17943:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789785374.148909:0:17943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64000/0x2f18ee3fd845d4aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.148916:0:17943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64000/0x2f18ee3fd845d4aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.148924:0:17943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64000/0x2f18ee3fd845d4aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785374.148935:0:17943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549150336:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789785374.148971:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785374.148988:0:17943:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84c40300 going to sleep for 11 seconds 00000100:00100000:0.0:1789785374.149099:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549150336 00000100:00100000:0.0:1789785374.149103:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549150336 00000100:00100000:0.0:1789785374.149131:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789785374.149138:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+13:17943:x1876725549150336:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789785374.149145:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785374.149154:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dae81ead400/0x2f18ee3fd845d4b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d4aa expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785374.149166:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dae81ead400/0x2f18ee3fd845d4b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d4aa expref: 14 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785374.149175:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dae81ead400/0x2f18ee3fd845d4b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d4aa expref: 14 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785374.149182:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81ead400, rc 0) 00000100:00100000:1.0:1789785374.149499:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+14:17943:x1876725549150336:12345-0@lo:101:mount.lustre.0 Request processed in 360us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785374.149506:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789785374.149622:0:17943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549150336:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789785374.149632:0:17943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64000/0x2f18ee3fd845d4aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d4b1 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785374.149936:0:17943:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64000/0x2f18ee3fd845d4aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d4b1 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785374.149962:0:17943:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789785374.150006:0:17943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64000/0x2f18ee3fd845d4aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d4b1 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785374.150014:0:17943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64000/0x2f18ee3fd845d4aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d4b1 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785374.150021:0:17943:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789785374.150025:0:17943:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789785374.150030:0:17943:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9daf89062000 10000000:01000000:0.0:1789785374.150033:0:17943:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789785374.150036:0:17943:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1789785374.150038:0:17943:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789785374.150054:0:17943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845d4b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785374.150062:0:17943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845d4b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785374.150070:0:17943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845d4b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785374.150083:0:17943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf452680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549150464:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789785374.150110:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785374.150140:0:17943:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf987f5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789785374.152088:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549150464 00000100:00100000:1.0:1789785374.152099:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549150464 00000100:00100000:1.0:1789785374.152147:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789785374.152155:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+14:17943:x1876725549150464:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789785374.152169:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785374.152182:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1a65e00/0x2f18ee3fd845d4bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d4b8 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.152408:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1a65e00/0x2f18ee3fd845d4bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d4b8 expref: 15 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.152419:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1a65e00/0x2f18ee3fd845d4bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d4b8 expref: 15 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.152428:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a65e00, rc 0) 00000100:00100000:1.0:1789785374.152496:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+15:17943:x1876725549150464:12345-0@lo:101:mount.lustre.0 Request processed in 341us (2385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785374.152502:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789785374.153658:0:17943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf452680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549150464:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789785374.153678:0:17943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845d4b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d4bf expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785374.153689:0:17943:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845d4b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d4bf expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789785374.155857:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1789785374.158776:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789785374.162882:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789785374.162932:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1789785374.162944:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1789785374.163024:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1789785374.163043:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1789785374.163054:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1789785374.163065:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1789785374.163079:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1789785374.163091:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1789785374.163102:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1789785374.163113:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1789785374.163138:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1789785374.163150:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1789785374.163161:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1789785374.163172:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1789785374.163183:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1789785374.163564:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1789785374.163580:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1789785374.163591:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1789785374.163602:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1789785374.163612:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1789785374.163624:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1789785374.163634:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1789785374.163657:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1789785374.163662:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1789785374.163768:0:17943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549150592:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789785374.163843:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785374.163933:0:17943:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84c40cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789785374.164306:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549150592 00000100:00100000:2.0:1789785374.164313:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549150592 00000100:00100000:2.0:1789785374.164379:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789785374.164389:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+15:17943:x1876725549150592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789785374.164531:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+15:17943:x1876725549150592:12345-0@lo:501:mount.lustre.0 Request processed in 143us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785374.164549:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789785374.164673:0:17943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549150592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789785374.164709:0:17943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf452680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549150720:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789785374.164748:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785374.164774:0:17943:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf987f5300 going to sleep for 11 seconds 00000100:00100000:2.0:1789785374.164833:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549150720 00000100:00100000:2.0:1789785374.164837:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549150720 00000100:00100000:2.0:1789785374.164867:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789785374.164874:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+15:17943:x1876725549150720:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789785374.165553:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+15:17943:x1876725549150720:12345-0@lo:503:mount.lustre.0 Request processed in 677us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785374.165562:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789785374.168745:0:17943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf452680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549150720:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789785374.170019:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789785374.170118:0:17943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549150848:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789785374.170183:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785374.170659:0:17943:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84c40cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789785374.170731:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549150848 00000100:00100000:2.0:1789785374.170738:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549150848 00000100:00100000:2.0:1789785374.170784:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789785374.170792:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+15:17943:x1876725549150848:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789785374.171719:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+15:17943:x1876725549150848:12345-0@lo:502:mount.lustre.0 Request processed in 924us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785374.171729:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789785374.171845:0:17943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549150848:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789785374.172125:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789785374.172152:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1789785374.172164:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1789785374.172175:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1789785374.172186:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1789785374.172648:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1789785374.172661:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1789785374.172672:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1789785374.172683:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1789785374.172695:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1789785374.172706:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1789785374.172717:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1789785374.172746:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1789785374.172759:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1789785374.172779:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1789785374.172789:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1789785374.172813:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1789785374.172827:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1789785374.172838:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1789785374.172849:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1789785374.172860:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1789785374.172876:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:0.0:1789785374.172887:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:0.0:1789785374.172901:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:0.0:1789785374.172913:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:0.0:1789785374.172926:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:0.0:1789785374.172941:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:0.0:1789785374.172952:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:0.0:1789785374.173650:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:0.0:1789785374.173664:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:0.0:1789785374.173675:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:0.0:1789785374.173686:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1789785374.173697:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1789785374.173708:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1789785374.173719:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1789785374.173731:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1789785374.173742:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1789785374.173754:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1789785374.173765:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1789785374.173776:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1789785374.173786:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1789785374.173797:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1789785374.173822:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1789785374.173834:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1789785374.173882:0:17943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf452680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549150976:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789785374.173949:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785374.174135:0:17943:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf987f5300 going to sleep for 11 seconds 00000100:00100000:1.0:1789785374.175166:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549150976 00000100:00100000:1.0:1789785374.175174:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549150976 00000100:00100000:1.0:1789785374.175229:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789785374.175237:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+15:17943:x1876725549150976:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789785374.175368:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+15:17943:x1876725549150976:12345-0@lo:502:mount.lustre.0 Request processed in 131us (1418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785374.175376:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789785374.175671:0:17943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf452680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549150976:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789785374.175742:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1789785374.175752:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1789785374.177090:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789785374.177102:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789785374.177104:0:17947:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789785374.177109:0:17947:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1789785374.177112:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789785374.177124:0:17947:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9dafba5599b8) 00000020:00000080:3.0:1789785374.177143:0:17947:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1789785374.177148:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789785374.177290:0:17947:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789785374.177298:0:17947:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f18ee3fd845d4cd 00000020:00000080:3.0:1789785374.177511:0:17947:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789785374.177515:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789785374.177630:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789785374.177637:0:17947:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789785374.177642:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789785374.177691:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789785374.177693:0:17947:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1789785374.177697:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789785374.177704:0:17947:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9dafba558000) 00000020:00000080:3.0:1789785374.177715:0:17947:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1789785374.177718:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789785374.177720:0:17947:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1789785374.177723:0:17947:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1789785374.177729:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789785374.177774:0:17947:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9daf89062000 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1789785374.177784:0:17947:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9dafba55b370) 00000020:00000080:3.0:1789785374.177792:0:17947:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1789785374.177866:0:17947:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789785374.177874:0:17947:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f18ee3fd845d4e2 00000020:00000080:3.0:1789785374.178073:0:17947:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1789785374.178081:0:17947:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789785374.178088:0:17947:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x2f18ee3fd845d4e9 00080000:01000000:3.0:1789785374.178093:0:17947:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789785374.178097:0:17947:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f18ee3fd845d4f0 00010000:00010000:1.0:1789785374.268409:0:17947:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1789785374.269630:0:17947:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:1.0:1789785374.270178:0:17947:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789785374.272184:0:17947:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1789785374.272196:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789785374.272201:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789785374.272204:0:17947:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1789785374.272207:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789785374.272212:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789785374.272214:0:17947:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1789785374.272216:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789785374.272221:0:17947:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.146@tcp to nid 0x20000c0a8cb92 (192.168.203.146@tcp) 00000020:00000080:3.0:1789785374.272247:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789785374.272269:0:17947:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9daf86124d28) 00000020:00000080:3.0:1789785374.272289:0:17947:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1789785374.272297:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789785374.272383:0:17947:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1789785374.272389:0:17947:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789785374.272395:0:17947:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f18ee3fd845d4fe 00010000:00080000:3.0:1789785374.272431:0:17947:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dafbf3c4000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.146@tcp at head 00010000:00010000:3.0:1789785374.275822:0:17947:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1789785374.282529:0:17947:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789785374.282543:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789785374.282582:0:17947:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789785374.282600:0:17947:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f18ee3fd845d505 00000100:00080000:1.0:1789785374.282610:0:17947:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789785374.282615:0:17947:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dafbf3c4000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:1.0:1789785374.282646:0:17947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafb113ca80 x1876725549151104/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789785374.282667:0:17947:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1789785374.282731:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785374.282734:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785374.282736:0:17947:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789785374.282739:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789785374.282745:0:17947:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789785374.282747:0:17947:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789785374.282748:0:17947:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789785374.282750:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789785374.282752:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785374.282753:0:17947:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789785374.282756:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789785374.282760:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785374.282762:0:17947:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789785374.282765:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789785374.282795:0:17947:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789785374.282819:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785374.282822:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785374.282823:0:17947:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789785374.282826:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789785374.282827:0:17947:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1789785374.282829:0:17947:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789785374.282830:0:17947:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789785374.282832:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789785374.282834:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785374.282836:0:17947:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789785374.282838:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789785374.282840:0:17947:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789785374.282843:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785374.282845:0:17947:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789785374.282847:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789785374.282851:0:17947:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.146@tcp to nid 0x20000c0a8cb92 (192.168.203.146@tcp) 00000020:01000000:1.0:1789785374.282873:0:17947:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789785374.282875:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00080000:2.0:1789785374.282881:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789785374.282888:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000020:00000080:1.0:1789785374.282888:0:17947:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9dafb5c399b8) 00000100:00080000:2.0:1789785374.282893:0:8:0:(import.c:65:import_set_state_nolock()) ffff9daf85807000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789785374.282900:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 478 00000020:00000080:1.0:1789785374.282903:0:17947:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000100:00080000:2.0:1789785374.282904:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000020:00000080:1.0:1789785374.282909:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00080000:2.0:1789785374.282911:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9daf85807000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:2.0:1789785374.282930:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9daf82c81c00 x1876725549151232/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789785374.282943:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789785374.282946:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789785374.282965:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789785374.282968:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000004:00080000:1.0:1789785374.282989:0:17947:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789785374.282999:0:17947:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789785374.283014:0:17947:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f18ee3fd845d513 00010000:00080000:1.0:1789785374.283060:0:17947:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dafbf3c0000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.146@tcp at head 00010000:00010000:1.0:1789785374.283297:0:17947:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1789785374.283762:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549151104:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789785374.283855:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785374.283913:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549151232:0@lo:38:kworker.0 00000100:00100000:3.0:1789785374.283937:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785374.283990:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1876725549151360:0@lo:400:kworker.0 00000100:00100000:3.0:1789785374.284021:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785374.284067:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549151104 00000100:00100000:2.0:1789785374.284076:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549151104 00000100:00100000:3.0:1789785374.284080:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549151360 00000100:00100000:3.0:1789785374.284086:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549151360 00000100:00100000:2.0:1789785374.284103:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549151232 00000100:00100000:2.0:1789785374.284107:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549151232 00000100:00100000:2.0:1789785374.284137:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789785374.284138:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789785374.284148:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3658:x1876725549151104:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789785374.284154:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1876725549151360:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789785374.284177:0:17216:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 482 last 0 00000100:00100000:3.0:1789785374.284209:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1876725549151360:12345-0@lo:400:kworker.0 Request processed in 59us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785374.284215:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789785374.284252:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9daf82c83100 x1876725549151360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785374.284265:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1876725549151360:0@lo:400:kworker.0 00000040:01000000:0.0:1789785374.285191:0:17947:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789785374.285427:0:17947:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000020:00000080:2.0:1789785374.285488:0:17216:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f18ee3fd845d51a 00000004:00100000:2.0:1789785374.285505:0:17216:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789785374.285511:0:17216:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:0.0:1789785374.300563:0:17947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789785374.301098:0:17947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1789785374.301207:0:17947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:3.0:1789785374.301925:0:17952:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000100:00080000:2.0:1789785374.301928:0:17216:0:(import.c:65:import_set_state_nolock()) ffff9dafb5e6e000 : changing import state from RECOVER to FULL 00000040:00080000:3.0:1789785374.301931:0:17952:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1789785374.302041:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3658:x1876725549151104:12345-0@lo:38:llog_process_th.0 Request processed in 17890us (18183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785374.302052:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789785374.302076:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789785374.302083:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3658:x1876725549151232:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1789785374.302135:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3658:x1876725549151232:12345-0@lo:38:kworker.0 Request processed in 51us (18197us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789785374.302141:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789785374.302307:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789785374.302317:0:3658:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789785374.302331:0:3658:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789785374.302335:0:3658:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789785374.302367:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dafbf3c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789785374.302378:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549151104:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789785374.302393:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789785374.302397:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9daf85807000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789785374.302401:0:3658:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789785374.302405:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549151232:0@lo:38:kworker.0 00000020:00000080:1.0:1789785374.302593:0:17947:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789785374.302603:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789785374.302635:0:17947:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789785374.302652:0:17947:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f18ee3fd845d521 00000100:00080000:1.0:1789785374.302658:0:17947:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789785374.302662:0:17947:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9dafbf3c0000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:1.0:1789785374.302685:0:17947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafb113f100 x1876725549151488/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789785374.302710:0:17947:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789785374.302754:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785374.302757:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785374.302759:0:17947:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789785374.302762:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789785374.302765:0:17947:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1789785374.302766:0:17947:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789785374.302768:0:17947:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789785374.302769:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789785374.302772:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785374.302773:0:17947:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789785374.302775:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789785374.302779:0:17947:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789785374.302781:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785374.302783:0:17947:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789785374.302785:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789785374.302789:0:17947:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.146@tcp to nid 0x20000c0a8cb92 (192.168.203.146@tcp) 00000020:01000000:1.0:1789785374.302819:0:17947:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789785374.302821:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789785374.302830:0:17947:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9dafb5c38000) 00000020:00000080:1.0:1789785374.302846:0:17947:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1789785374.302851:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789785374.302918:0:17947:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1789785374.302925:0:17947:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789785374.302929:0:17947:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f18ee3fd845d52f 00010000:00080000:1.0:1789785374.302951:0:17947:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9daf862fe800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.146@tcp at head 00000100:00100000:3.0:1789785374.303031:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549151488:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789785374.303070:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876725549151488 offset 0 length 520: 4 00010000:00010000:1.0:1789785374.303150:0:17947:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1789785374.303207:0:17947:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789785374.303219:0:17947:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1789785374.303297:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789785374.303303:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789785374.303307:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789785374.303310:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789785374.304031:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549151616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789785374.304071:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785374.304199:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549151616 00000100:00100000:2.0:1789785374.304207:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549151616 00000100:00100000:2.0:1789785374.304255:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789785374.304264:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3659:x1876725549151616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789785374.304290:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789785374.304366:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3659:x1876725549151616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785374.304373:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789785374.304508:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549151616:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1789785374.304786:0:17947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789785374.306976:0:17947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1789785374.307138:0:17947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789785374.310758:0:17954:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789785374.310764:0:17954:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789785374.315924:0:17947:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789785374.315939:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789785374.315982:0:17947:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789785374.316002:0:17947:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f18ee3fd845d536 00000100:00080000:0.0:1789785374.316012:0:17947:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789785374.316017:0:17947:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9daf862fe800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:0.0:1789785374.316061:0:17947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafbf452300 x1876725549151744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789785374.316089:0:17947:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789785374.316147:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785374.316151:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785374.316153:0:17947:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789785374.316156:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789785374.316159:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785374.316161:0:17947:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789785374.316164:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789785374.316165:0:17947:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789785374.316168:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785374.316170:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:3.0:1789785374.316279:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549151744:0@lo:8:llog_process_th.0 00000020:00000080:0.0:1789785374.316322:0:17947:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789785374.316328:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789785374.316332:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785374.316334:0:17947:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000400:00000100:3.0:1789785374.316376:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876725549151744 offset 0 length 520: 4 00000100:00080000:2.0:1789785374.316474:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:00000080:0.0:1789785374.316478:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00080000:2.0:1789785374.316479:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789785374.316484:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789785374.316487:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1789785374.316513:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785374.317420:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785374.317482:0:17947:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789785374.317488:0:17947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:1.0:1789785374.317691:0:17943:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1789785374.317725:0:17943:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789785374.317748:0:17943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845d4b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d4bf expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.317760:0:17943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dae81eac600/0x2f18ee3fd845d4b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d4bf expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785374.317768:0:17943:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9daf89062000 from 1 10000000:01000000:1.0:1789785374.317771:0:17943:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789785374.317797:0:17943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845d53d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.317815:0:17943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845d53d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.317825:0:17943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845d53d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785374.317843:0:17943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549151872:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789785374.317895:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785374.317931:0:17943:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafac89d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785374.318024:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549151872 00000100:00100000:3.0:1789785374.318031:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549151872 00000100:00100000:3.0:1789785374.318073:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789785374.318081:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+15:17943:x1876725549151872:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789785374.318093:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785374.318104:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9daf814ba800/0x2f18ee3fd845d544 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d53d expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785374.318125:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9daf814ba800/0x2f18ee3fd845d544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d53d expref: 16 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785374.318146:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9daf814ba800/0x2f18ee3fd845d544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d53d expref: 16 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785374.318155:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814ba800, rc 0) 00000100:00100000:3.0:1789785374.318203:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+16:17943:x1876725549151872:12345-0@lo:101:mount.lustre.0 Request processed in 123us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785374.318210:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789785374.318618:0:17943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549151872:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789785374.318633:0:17943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845d53d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d544 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785374.318643:0:17943:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845d53d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d544 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785374.321741:0:17943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf452d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549152000:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789785374.321892:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785374.321937:0:17943:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789785374.322056:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549152000 00000100:00100000:3.0:1789785374.322063:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549152000 00000100:00100000:3.0:1789785374.322109:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789785374.322117:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+16:17943:x1876725549152000:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789785374.322134:0:17204:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789785374.322152:0:17204:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789785374.322155:0:17204:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1789785374.322409:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+16:17943:x1876725549152000:12345-0@lo:256:mount.lustre.0 Request processed in 292us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785374.322417:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789785374.322896:0:17943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf452d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549152000:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789785374.323464:0:17943:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789785374.323485:0:17943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845d53d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d544 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785374.323496:0:17943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845d53d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d544 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785374.323506:0:17943:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9daf89062000 from 1 10000000:01000000:2.0:1789785374.323509:0:17943:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789785374.323534:0:17943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55200/0x2f18ee3fd845d54b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785374.323590:0:17943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55200/0x2f18ee3fd845d54b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785374.323600:0:17943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55200/0x2f18ee3fd845d54b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785374.323618:0:17943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549152128:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789785374.323664:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785374.323692:0:17943:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafb6226900 going to sleep for 11 seconds 00000100:00100000:0.0:1789785374.327919:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549152128 00000100:00100000:0.0:1789785374.327935:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549152128 00000100:00100000:2.0:1789785374.328446:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789785374.328457:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+16:17943:x1876725549152128:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789785374.328473:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785374.328489:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafb5d55c00/0x2f18ee3fd845d552 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d54b expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785374.328514:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafb5d55c00/0x2f18ee3fd845d552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d54b expref: 17 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785374.328525:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafb5d55c00/0x2f18ee3fd845d552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d54b expref: 17 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785374.328534:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d55c00, rc 0) 00000100:00100000:2.0:1789785374.328654:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+17:17943:x1876725549152128:12345-0@lo:101:mount.lustre.0 Request processed in 199us (4989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785374.328661:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789785374.329218:0:17943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549152128:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789785374.329237:0:17943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55200/0x2f18ee3fd845d54b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d552 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.329247:0:17943:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55200/0x2f18ee3fd845d54b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d552 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789785374.329408:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789785374.329444:0:17943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549152256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789785374.329480:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785374.329518:0:17943:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafac89d540 going to sleep for 11 seconds 00000100:00100000:3.0:1789785374.329633:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549152256 00000100:00100000:3.0:1789785374.329639:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549152256 00000100:00100000:3.0:1789785374.329680:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789785374.329688:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+17:17943:x1876725549152256:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789785374.329772:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+17:17943:x1876725549152256:12345-0@lo:501:mount.lustre.0 Request processed in 83us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785374.329778:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789785374.329929:0:17943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549152256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789785374.329951:0:17943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549152384:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789785374.329995:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785374.330018:0:17943:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafac89d540 going to sleep for 11 seconds 00000100:00100000:3.0:1789785374.330062:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549152384 00000100:00100000:3.0:1789785374.330066:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549152384 00000100:00100000:3.0:1789785374.330099:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789785374.330104:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+17:17943:x1876725549152384:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789785374.330175:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+17:17943:x1876725549152384:12345-0@lo:503:mount.lustre.0 Request processed in 69us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785374.330181:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789785374.330306:0:17943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549152384:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789785374.330626:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789785374.330706:0:17943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549152512:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789785374.330740:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785374.330756:0:17943:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafb6226a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789785374.330857:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549152512 00000100:00100000:3.0:1789785374.330862:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549152512 00000100:00100000:3.0:1789785374.330891:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789785374.330897:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+17:17943:x1876725549152512:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789785374.330968:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+17:17943:x1876725549152512:12345-0@lo:502:mount.lustre.0 Request processed in 70us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785374.330974:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789785374.332232:0:17943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549152512:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789785374.333086:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789785374.333121:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1789785374.333134:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1789785374.333145:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1789785374.333157:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1789785374.333170:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1789785374.333181:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1789785374.333203:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1789785374.333216:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789785374.333227:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1789785374.333239:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1789785374.333279:0:17943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549152640:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789785374.333355:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785374.333395:0:17943:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafac89d000 going to sleep for 11 seconds 00000100:00100000:3.0:1789785374.333708:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549152640 00000100:00100000:3.0:1789785374.333714:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549152640 00000100:00100000:3.0:1789785374.333755:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789785374.333763:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+17:17943:x1876725549152640:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789785374.333869:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+17:17943:x1876725549152640:12345-0@lo:502:mount.lustre.0 Request processed in 107us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785374.333876:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789785374.335082:0:17943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549152640:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789785374.335155:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1789785374.335166:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789785374.335771:0:17956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789785374.335779:0:17956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785374.335782:0:17956:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789785374.335789:0:17956:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9daf89062000 00000020:00000080:1.0:1789785374.335791:0:17956:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789785374.335811:0:17956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785374.335814:0:17956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785374.335815:0:17956:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789785374.335818:0:17956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789785374.335820:0:17956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785374.335821:0:17956:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789785374.335825:0:17956:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9daf89062000 00000020:00000080:1.0:1789785374.335827:0:17956:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789785374.335911:0:17956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785374.335915:0:17956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785374.335917:0:17956:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789785374.335919:0:17956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789785374.335922:0:17956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785374.335923:0:17956:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789785374.335926:0:17956:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9daf89062000 00000020:00000080:1.0:1789785374.335928:0:17956:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789785374.346315:0:17956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785374.346331:0:17956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785374.346333:0:17956:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789785374.346348:0:17956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789785374.346365:0:17956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785374.346367:0:17956:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789785374.346373:0:17956:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9daf89062000 00000020:00000080:1.0:1789785374.346375:0:17956:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789785374.346442:0:17956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785374.346444:0:17956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785374.346446:0:17956:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789785374.346449:0:17956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1789785374.347161:0:17943:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789785374.347192:0:17943:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789785374.347217:0:17943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55200/0x2f18ee3fd845d54b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d552 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785374.347229:0:17943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55200/0x2f18ee3fd845d54b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d552 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785374.347298:0:17943:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789785374.347301:0:17943:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9daf89062000 10000000:01000000:0.0:1789785374.347314:0:17943:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9daf89062000 10000000:01000000:0.0:1789785374.347318:0:17943:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789785374.347324:0:17943:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9daf89062000 from 1 10000000:01000000:0.0:1789785374.347327:0:17943:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789785374.347417:0:17943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81ead000/0x2f18ee3fd845d559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785374.347427:0:17943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dae81ead000/0x2f18ee3fd845d559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785374.347439:0:17943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dae81ead000/0x2f18ee3fd845d559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785374.347464:0:17943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf453800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549152768:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789785374.348631:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785374.348675:0:17943:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84c40840 going to sleep for 11 seconds 00000100:00100000:1.0:1789785374.352048:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549152768 00000100:00100000:1.0:1789785374.352059:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549152768 00000100:00100000:1.0:1789785374.352108:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789785374.352117:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+17:17943:x1876725549152768:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789785374.352132:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785374.352148:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1a64c00/0x2f18ee3fd845d560 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d559 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.352174:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1a64c00/0x2f18ee3fd845d560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d559 expref: 18 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.352197:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1a64c00/0x2f18ee3fd845d560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d559 expref: 18 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.352207:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64c00, rc 0) 00000100:00100000:1.0:1789785374.352276:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:17943:x1876725549152768:12345-0@lo:101:mount.lustre.0 Request processed in 160us (3648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785374.352283:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789785374.352350:0:17943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf453800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549152768:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789785374.352365:0:17943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dae81ead000/0x2f18ee3fd845d559 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d560 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.352386:0:17943:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dae81ead000/0x2f18ee3fd845d559 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d560 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789785374.356883:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1789785374.357139:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789785374.357292:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1789785374.357314:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1789785374.357370:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1789785374.357385:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1789785374.357396:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1789785374.357407:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1789785374.357418:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1789785374.357429:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1789785374.357440:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1789785374.357451:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1789785374.357462:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1789785374.357473:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1789785374.357483:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1789785374.357494:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1789785374.357505:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1789785374.357516:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1789785374.357540:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1789785374.357551:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1789785374.357573:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1789785374.357585:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1789785374.357596:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1789785374.357607:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1789785374.357617:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1789785374.357629:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1789785374.357639:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1789785374.357650:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1789785374.357669:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1789785374.357680:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1789785374.357695:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1789785374.357700:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1789785374.357766:0:17943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549152896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789785374.357837:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785374.357874:0:17943:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafac89d600 going to sleep for 11 seconds 00000100:00100000:0.0:1789785374.363198:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549152896 00000100:00100000:0.0:1789785374.363212:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549152896 00000100:00100000:0.0:1789785374.363273:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789785374.363284:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:17943:x1876725549152896:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789785374.363486:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:17943:x1876725549152896:12345-0@lo:501:mount.lustre.0 Request processed in 204us (5649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785374.363494:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789785374.363629:0:17943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549152896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789785374.363683:0:17943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549153024:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789785374.363732:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785374.363763:0:17943:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafac89d600 going to sleep for 11 seconds 00000100:00100000:1.0:1789785374.363778:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549153024 00000100:00100000:1.0:1789785374.363782:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549153024 00000100:00100000:1.0:1789785374.363821:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789785374.363830:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:17943:x1876725549153024:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789785374.363908:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:17943:x1876725549153024:12345-0@lo:503:mount.lustre.0 Request processed in 78us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785374.363915:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789785374.364028:0:17943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549153024:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789785374.364510:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789785374.366123:0:17943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549153152:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789785374.366629:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785374.366665:0:17943:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafac89d900 going to sleep for 11 seconds 00000100:00100000:1.0:1789785374.366693:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549153152 00000100:00100000:1.0:1789785374.366699:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549153152 00000100:00100000:1.0:1789785374.366735:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789785374.366743:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb425c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:17943:x1876725549153152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789785374.366871:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb425c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:17943:x1876725549153152:12345-0@lo:502:mount.lustre.0 Request processed in 128us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785374.366879:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789785374.366929:0:17943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549153152:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789785374.368446:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1789785374.368478:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1789785374.368490:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1789785374.368502:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1789785374.368512:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1789785374.369043:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1789785374.369059:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1789785374.369070:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1789785374.369081:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1789785374.369092:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1789785374.369103:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1789785374.369115:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1789785374.369125:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1789785374.369137:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1789785374.369148:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1789785374.369159:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1789785374.369171:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1789785374.369182:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1789785374.370085:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1789785374.370106:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1789785374.370118:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1789785374.370129:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1789785374.370140:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1789785374.370151:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1789785374.370163:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1789785374.370174:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1789785374.371315:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1789785374.371356:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1789785374.371369:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1789785374.371380:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1789785374.371392:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1789785374.371403:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1789785374.371414:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1789785374.371426:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1789785374.371453:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1789785374.371465:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1789785374.371477:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1789785374.371488:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1789785374.371499:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1789785374.371509:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1789785374.372621:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1789785374.372648:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1789785374.372660:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1789785374.372671:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1789785374.372682:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1789785374.372694:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1789785374.372705:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1789785374.372716:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1789785374.372771:0:17943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549153280:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789785374.372855:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785374.372964:0:17943:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafac89d000 going to sleep for 11 seconds 00000100:00100000:3.0:1789785374.382641:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549153280 00000100:00100000:3.0:1789785374.382654:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549153280 00000100:00100000:3.0:1789785374.382703:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789785374.382713:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:17943:x1876725549153280:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789785374.382875:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:17943:x1876725549153280:12345-0@lo:502:mount.lustre.0 Request processed in 163us (10020us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785374.382883:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789785374.385286:0:17943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549153280:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789785374.385562:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1789785374.385588:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1789785374.385626:0:17943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549153408:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789785374.385692:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785374.385740:0:17943:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb4489c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789785374.388631:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549153408 00000100:00100000:1.0:1789785374.388643:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549153408 00000100:00100000:1.0:1789785374.388695:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789785374.388704:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:17943:x1876725549153408:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789785374.388855:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:17943:x1876725549153408:12345-0@lo:502:mount.lustre.0 Request processed in 151us (3163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785374.388871:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789785374.389075:0:17943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549153408:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789785374.389145:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1789785374.389157:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789785374.389722:0:17961:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1789785374.389736:0:17961:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9daf86120000) 00000020:00000080:3.0:1789785374.389767:0:17961:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1789785374.389856:0:17961:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9daf89062000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789785374.389860:0:17961:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9daf89062000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789785374.389862:0:17961:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9daf89062000 3 00010000:00080000:3.0:1789785374.389887:0:17961:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9daf8487f000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.146@tcp at head 00010000:00010000:3.0:1789785374.398353:0:17961:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1789785374.402171:0:17961:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1789785374.402288:0:17961:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789785374.402302:0:17961:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x2f18ee3fd845d56e 00000100:00080000:3.0:1789785374.402313:0:17961:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789785374.402320:0:17961:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9daf8487f000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:3.0:1789785374.402385:0:17961:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dae846a2d80 x1876725549153536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789785374.402407:0:17961:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789785374.402501:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789785374.402507:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789785374.402510:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789785374.402514:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789785374.402636:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1876725549153536:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789785374.402702:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785374.404099:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549153536 00000100:00100000:3.0:1789785374.404108:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549153536 00000100:00100000:3.0:1789785374.404151:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789785374.404158:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1876725549153536:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789785374.404182:0:17213:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:3.0:1789785374.405327:0:17213:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x2f18ee3fd845d575 00000004:00100000:3.0:1789785374.405356:0:17213:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789785374.405387:0:17213:0:(import.c:65:import_set_state_nolock()) ffff9daf84879800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789785374.405474:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1876725549153536:12345-0@lo:38:llog_process_th.0 Request processed in 1315us (2770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785374.405483:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789785374.405508:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1789785374.405589:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dae846a2d80 x1876725549153536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789785384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785374.405602:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000040:00080000:3.0:1789785374.405609:0:17961:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000100:00080000:0.0:1789785374.405610:0:3658:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789785374.405620:0:3658:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789785374.405626:0:3658:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789785374.405628:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9daf8487f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789785374.405635:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1876725549153536:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1789785374.405660:0:17943:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789785374.405686:0:17943:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789785374.405703:0:17943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81ead000/0x2f18ee3fd845d559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d560 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785374.405714:0:17943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dae81ead000/0x2f18ee3fd845d559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d560 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789785374.405768:0:17943:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789785374.405770:0:17943:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789785374.405771:0:17943:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789785374.405773:0:17943:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789785374.405774:0:17943:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789785374.405775:0:17943:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789785374.405777:0:17943:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789785374.405779:0:17943:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789785374.405780:0:17943:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789785374.405783:0:17943:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1789785374.405785:0:17943:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789785374.405786:0:17943:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789785374.405791:0:17943:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789785374.405792:0:17943:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789785374.405793:0:17943:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789785374.405794:0:17943:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789785374.405795:0:17943:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789785374.405796:0:17943:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789785374.405807:0:17943:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789785374.405824:0:17943:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789785374.405837:0:17943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549153664:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789785374.405872:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785374.405907:0:17943:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb448600 going to sleep for 11 seconds 00000100:00100000:0.0:1789785374.406132:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549153664 00000100:00100000:0.0:1789785374.406138:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549153664 00000100:00100000:0.0:1789785374.406183:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789785374.406192:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:17943:x1876725549153664:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789785374.406214:0:17206:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789785374.406226:0:17206:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1789785374.412441:0:17191:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1789785374.412704:0:17206:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789785374.412718:0:17206:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1789785374.412886:0:17227:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789785374.412891:0:17227:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789785374.412911:0:17227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9daf814bac00/0x2f18ee3fd845d57c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785374.412931:0:17227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dae81eada00/0x2f18ee3fd845d480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d479 expref: 18 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785374.412939:0:17227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9daf814ba800/0x2f18ee3fd845d544 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d53d expref: 18 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785374.412946:0:17227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9daf814bac00/0x2f18ee3fd845d57c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785374.412991:0:17227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9daf814ba800/0x2f18ee3fd845d544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845d53d expref: 18 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785374.413004:0:17227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9daf814ba800/0x2f18ee3fd845d544 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845d53d expref: 18 pid: 17205 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785374.413018:0:17227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1876725549153792:0@lo:104: 00000100:00100000:3.0:1789785374.413086:0:17227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789785374.413128:0:17227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dae81eada00/0x2f18ee3fd845d480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845d479 expref: 18 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785374.413137:0:17227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dae81eada00/0x2f18ee3fd845d480 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845d479 expref: 18 pid: 17206 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785374.413145:0:17227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a1c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1876725549153920:0@lo:104: 00000100:00100000:3.0:1789785374.413163:0:17227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785374.413173:0:17227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb448000 going to sleep for 11 seconds 00000100:00100000:2.0:1789785374.413326:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549153792 00000100:00100000:2.0:1789785374.413333:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549153792 00000100:00100000:2.0:1789785374.413384:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549153920 00000100:00100000:2.0:1789785374.413387:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549153920 00000100:00100000:2.0:1789785374.413399:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789785374.413406:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad642144-cf43-4df2-a5e5-a426cdb5453e+4:17227:x1876725549153792:12345-0@lo:104: 00010000:00010000:2.0:1789785374.413418:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845d53d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845d544 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785374.413468:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789785374.413473:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad642144-cf43-4df2-a5e5-a426cdb5453e+4:17227:x1876725549153792:12345-0@lo:104: Request processed in 67us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785374.413481:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789785374.413494:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789785374.413499:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad642144-cf43-4df2-a5e5-a426cdb5453e+3:17227:x1876725549153920:12345-0@lo:104: 00010000:00010000:2.0:1789785374.413506:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dae81eadc00/0x2f18ee3fd845d479 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845d480 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785374.413542:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789785374.413547:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad642144-cf43-4df2-a5e5-a426cdb5453e+3:17227:x1876725549153920:12345-0@lo:104: Request processed in 48us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785374.413552:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789785374.413566:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789785374.413577:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845d53d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845d544 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785374.413583:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a64400 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:2.0:1789785374.413587:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845d53d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845d544 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785374.413596:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845d53d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845d544 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789785374.413603:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845d53d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845d544 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785374.413609:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789785374.413632:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845d53d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d544 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785374.413637:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789785374.413653:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845d53d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d544 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785374.413660:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64400/0x2f18ee3fd845d53d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d544 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785374.413672:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789785374.413675:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dae81eadc00/0x2f18ee3fd845d479 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845d480 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785374.413680:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eadc00 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:2.0:1789785374.413683:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dae81eadc00/0x2f18ee3fd845d479 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845d480 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785374.413699:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dae81eadc00/0x2f18ee3fd845d479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845d480 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789785374.413706:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dae81eadc00/0x2f18ee3fd845d479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845d480 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785374.413711:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789785374.413724:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dae81eadc00/0x2f18ee3fd845d479 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d480 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785374.413729:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789785374.413738:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dae81eadc00/0x2f18ee3fd845d479 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d480 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785374.413745:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dae81eadc00/0x2f18ee3fd845d479 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d480 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785374.413757:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785374.413758:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785374.413760:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785374.413770:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad642144-cf43-4df2-a5e5-a426cdb5453e:3660:1876725549154048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789785374.413797:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789785374.413916:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785374.413929:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad642144-cf43-4df2-a5e5-a426cdb5453e:3661:1876725549154176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789785374.414015:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785374.414050:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549154048 00000100:00100000:3.0:1789785374.414054:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549154048 00010000:00010000:3.0:1789785374.414070:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9daf814ba800/0x2f18ee3fd845d544 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845d53d expref: 19 pid: 17205 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785374.414087:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549154176 00000100:00100000:3.0:1789785374.414089:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549154176 00010000:00010000:3.0:1789785374.414096:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dae81eada00/0x2f18ee3fd845d480 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845d479 expref: 20 pid: 17206 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785374.414107:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789785374.414112:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad642144-cf43-4df2-a5e5-a426cdb5453e+20:3660:x1876725549154048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789785374.414120:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785374.414124:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9daf814ba800/0x2f18ee3fd845d544 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845d53d expref: 20 pid: 17205 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785374.414133:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9daf814ba800/0x2f18ee3fd845d544 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845d53d expref: 20 pid: 17205 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785374.414153:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785374.414179:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad642144-cf43-4df2-a5e5-a426cdb5453e+20:3660:x1876725549154048:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785374.414185:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789785374.414314:0:17198:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789785374.414322:0:17198:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1789785374.414390:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+20:17943:x1876725549153664:12345-0@lo:253:mount.lustre.0 Request processed in 8199us (8516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785374.414398:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789785374.417498:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789785374.417527:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:3661:x1876725549154176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789785374.417544:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785374.417552:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dae81eada00/0x2f18ee3fd845d480 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845d479 expref: 18 pid: 17206 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.417567:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dae81eada00/0x2f18ee3fd845d480 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845d479 expref: 18 pid: 17206 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.417588:0:17198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9daf814bac00/0x2f18ee3fd845d57c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.417595:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9daf814bac00/0x2f18ee3fd845d57c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789785374.417611:0:17198:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004721015s 00010000:00010000:1.0:1789785374.417616:0:17198:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9daf814bac00/0x2f18ee3fd845d57c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.417623:0:17198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9daf814bac00/0x2f18ee3fd845d57c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.417650:0:17198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9daf814bac00/0x2f18ee3fd845d57c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.417658:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9daf814bac00/0x2f18ee3fd845d57c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.417664:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bac00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785374.417668:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9daf814bac00/0x2f18ee3fd845d57c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.417677:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9daf814bac00/0x2f18ee3fd845d57c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.417686:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9daf814bac00/0x2f18ee3fd845d57c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.417696:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785374.417766:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:3661:x1876725549154176:12345-0@lo:103:ldlm_bl.0 Request processed in 257us (3812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785374.417775:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789785374.417846:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad642144-cf43-4df2-a5e5-a426cdb5453e:3661:1876725549154176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789785374.418465:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad642144-cf43-4df2-a5e5-a426cdb5453e:3660:1876725549154048:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789785374.418494:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9daf814ba800/0x2f18ee3fd845d544 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845d53d expref: 17 pid: 17205 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785374.418505:0:17227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1876725549153792:0@lo:104: 00010000:00010000:1.0:1789785374.418524:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dae81eada00/0x2f18ee3fd845d480 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845d479 expref: 16 pid: 17206 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785374.418541:0:17227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a1c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1876725549153920:0@lo:104: 00010000:00010000:1.0:1789785374.418555:0:17227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9daf814bac00/0x2f18ee3fd845d57c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.418564:0:17227:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9daf814bac00/0x2f18ee3fd845d57c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.418571:0:17227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9daf814bac00/0x2f18ee3fd845d57c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785374.418576:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9daf814bac00/0x2f18ee3fd845d57c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785374.418605:0:17943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:17943:1876725549153664:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789785374.418615:0:17943:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789785374.418618:0:17943:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789785374.418619:0:17943:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789785374.418621:0:17943:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789785374.418622:0:17943:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789785374.418624:0:17943:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789785374.418625:0:17943:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789785374.418626:0:17943:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789785374.418628:0:17943:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789785374.418629:0:17943:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789785374.418638:0:17943:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:2.0:1789785374.428603:0:17943:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1789785374.429510:0:17966:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1789785374.429515:0:17966:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1789785374.429846:0:17967:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789785374.429860:0:17943:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:0.0:1789785374.430314:0:17967:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789785374.430428:0:17968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17968:1876725549154304:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789785374.430489:0:17968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785374.430537:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549154304 00000100:00100000:1.0:1789785374.430542:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549154304 00000100:00100000:1.0:1789785374.430578:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789785374.430591:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17968:x1876725549154304:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789785374.430673:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17968:x1876725549154304:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 82us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785374.430681:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789785374.430704:0:17968:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafa64c2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789785374.430725:0:17968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17968:1876725549154304:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1789785374.430750:0:17968:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789785374.430771:0:17968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17968:1876725549154432:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789785374.430808:0:17968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785374.430826:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549154432 00000100:00100000:1.0:1789785374.430829:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549154432 00000100:00100000:1.0:1789785374.430846:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789785374.430852:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17968:x1876725549154432:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789785374.430923:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17968:x1876725549154432:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 72us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785374.430930:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789785374.430944:0:17968:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafa64c2c00 going to sleep for 11 seconds 00000040:01000000:2.0:1789785374.431142:0:17943:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1789785374.431178:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789785374.431685:0:17943:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789785374.431691:0:17943:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1789785374.431724:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789785374.435294:0:17968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17968:1876725549154432:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789785374.435428:0:17968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17968:1876725549154560:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789785374.435490:0:17968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785374.436273:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549154560 00000100:00100000:1.0:1789785374.436281:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549154560 00000100:00100000:1.0:1789785374.436320:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789785374.436328:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17968:x1876725549154560:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789785374.436396:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17968:x1876725549154560:12345-0@lo:900:lod0001_rec0000.0 Request processed in 68us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785374.436413:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789785374.436437:0:17968:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafa64c2a80 going to sleep for 11 seconds 00010000:00080000:1.0:1789785374.436456:0:17968:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dafb113ce00 x1876725549154560/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789785390 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785374.436469:0:17968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17968:1876725549154560:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789785374.436528:0:17968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17968:1876725549154688:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789785374.436556:0:17968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785374.436575:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549154688 00000100:00100000:1.0:1789785374.436578:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549154688 00000100:00100000:1.0:1789785374.436598:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789785374.436603:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17968:x1876725549154688:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789785374.436674:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17968:x1876725549154688:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 69us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785374.436681:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789785374.436697:0:17968:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafa64c2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789785374.436708:0:17968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17968:1876725549154688:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1789785374.436749:0:17968:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789785374.440125:0:17943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789785374.444763:0:17943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789785374.444843:0:17943:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1789785374.445335:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789785374.446436:0:17967:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789785374.446498:0:17967:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00080000:10000000:2.0:1789785374.448084:0:17943:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:1.0:1789785374.452613:0:17968:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789785374.455131:0:17968:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789785374.455141:0:17968:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:2.0:1789785374.456131:0:17943:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789785374.457613:0:17943:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789785374.457642:0:17943:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa9f300d7f988 00100000:10000000:2.0:1789785374.457703:0:17943:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1789785374.458455:0:17943:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789785374.458483:0:17943:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.146@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789785374.458500:0:17943:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789785374.458528:0:17943:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1789785374.470051:0:17943:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000040:00080000:0.0:1789785374.471019:0:17971:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1789785374.472122:0:17943:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789785374.786493:0:17253:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385a900 going to sleep for 0 seconds 00010000:00010000:2.0:1789785375.426664:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789785375.493036:0:17971:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1789785375.757334:0:17209:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789785375.757357:0:17209:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9daf89062000 from 8 10000000:01000000:3.0:1789785375.757362:0:17209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789785375.757408:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf814bb000/0x2f18ee3fd845d583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785375.757419:0:17209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9daf814bb000/0x2f18ee3fd845d583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785375.757430:0:17209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9daf814bb000/0x2f18ee3fd845d583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785375.757453:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549154816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789785375.757514:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785375.757616:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb448180 going to sleep for 11 seconds 00000100:00100000:1.0:1789785375.757697:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549154816 00000100:00100000:1.0:1789785375.757702:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549154816 00000100:00100000:1.0:1789785375.760868:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789785375.760888:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+16:17209:x1876725549154816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789785375.760917:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785375.760935:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1a65c00/0x2f18ee3fd845d58a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d583 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785375.760960:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1a65c00/0x2f18ee3fd845d58a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d583 expref: 17 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785375.760971:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1a65c00/0x2f18ee3fd845d58a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d583 expref: 17 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785375.760980:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a65c00, rc 0) 00000100:00100000:1.0:1789785375.761057:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+17:17209:x1876725549154816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (3541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785375.761064:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789785375.761365:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549154816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789785375.761382:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9daf814bb000/0x2f18ee3fd845d583 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d58a expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785375.761392:0:17209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9daf814bb000/0x2f18ee3fd845d583 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d58a expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785375.761451:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c81880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549154944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789785375.761486:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785375.761515:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf92353900 going to sleep for 11 seconds 00000100:00100000:3.0:1789785375.761571:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549154944 00000100:00100000:3.0:1789785375.761577:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549154944 00000100:00100000:3.0:1789785375.761613:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789785375.761620:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf459850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+17:17209:x1876725549154944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789785375.761633:0:17204:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789785375.761647:0:17204:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789785375.761653:0:17204:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789785375.761738:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf459850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+17:17209:x1876725549154944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785375.761745:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789785375.761861:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c81880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549154944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789785375.761908:0:17209:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789785375.761915:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf814bb000/0x2f18ee3fd845d583 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d58a expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785375.761927:0:17209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9daf814bb000/0x2f18ee3fd845d583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d58a expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785375.761937:0:17209:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789785375.761939:0:17209:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dafb11eb000 from 8 10000000:01000000:0.0:1789785375.761942:0:17209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789785375.761959:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785375.761966:0:17209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785375.761975:0:17209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785375.761987:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf451880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549155072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789785375.762012:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785375.762033:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789785375.762079:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549155072 00000100:00100000:2.0:1789785375.762083:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549155072 00000100:00100000:2.0:1789785375.762099:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789785375.762105:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf45b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+17:17209:x1876725549155072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789785375.762111:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785375.762119:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafb5d54c00/0x2f18ee3fd845d598 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d591 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785375.762133:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafb5d54c00/0x2f18ee3fd845d598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d591 expref: 18 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785375.762147:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafb5d54c00/0x2f18ee3fd845d598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d591 expref: 18 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785375.762155:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d54c00, rc 0) 00000100:00100000:2.0:1789785375.762195:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf45b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:17209:x1876725549155072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785375.762201:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789785375.762305:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf451880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549155072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789785375.762314:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d591 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d598 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785375.762322:0:17209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d591 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d598 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785375.762375:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf451880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549155200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789785375.762399:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785375.762428:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1789785375.762478:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549155200 00000100:00100000:1.0:1789785375.762482:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549155200 00000100:00100000:1.0:1789785375.762499:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789785375.762504:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf45a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:17209:x1876725549155200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789785375.762513:0:17206:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789785375.762523:0:17206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789785375.762526:0:17206:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789785375.762672:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf45a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:17209:x1876725549155200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 167us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785375.762679:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789785375.764888:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf451880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549155200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789785375.764957:0:17209:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789785375.764966:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d591 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d598 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785375.764976:0:17209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d598 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785375.812543:0:17253:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385a900 going to sleep for 0 seconds 00010000:00010000:3.0:1789785376.463271:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785376.835824:0:17253:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385a900 going to sleep for 0 seconds 00010000:00010000:1.0:1789785377.476374:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785377.868869:0:17253:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385a900 going to sleep for 0 seconds 00010000:00010000:2.0:1789785378.503492:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785378.882995:0:17253:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385a900 going to sleep for 0 seconds 00010000:00010000:1.0:1789785379.527549:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785379.652833:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549155328:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1789785379.653018:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789785379.653034:0:15987:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789785379.653038:0:15987:0:(import.c:65:import_set_state_nolock()) ffff9daf85807000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789785379.653047:0:15987:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9daf85807000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:1.0:1789785379.653070:0:15987:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafb113df80 x1876725549155584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789785379.653087:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789785379.653091:0:15987:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789785379.653093:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789785379.653096:0:15987:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789785379.653110:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789785379.653113:0:15987:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789785379.653115:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789785379.653118:0:15987:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789785379.653138:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549155840:0@lo:400:kworker.0 00000100:00100000:1.0:1789785379.653199:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785379.653250:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789785379.653256:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549155968:0@lo:400:kworker.0 00000100:00100000:1.0:1789785379.653282:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785379.653308:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad642144-cf43-4df2-a5e5-a426cdb5453e:3659:1876725549155456:0@lo:400:kworker.0 00000100:00100000:1.0:1789785379.653360:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785379.653384:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789785379.653388:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549155712:0@lo:400:kworker.0 00000100:00100000:1.0:1789785379.653410:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785379.653451:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549155584:0@lo:38:kworker.0 00000100:00100000:1.0:1789785379.653474:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785379.653838:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549155840 00000100:00100000:1.0:1789785379.653845:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549155840 00000100:00100000:1.0:1789785379.653878:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549155584 00000100:00100000:1.0:1789785379.653880:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549155584 00000100:00100000:1.0:1789785379.653893:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789785379.653901:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549155840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785379.653953:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549155840:12345-0@lo:400:kworker.0 Request processed in 52us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785379.653961:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789785379.653977:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789785379.653981:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3658:x1876725549155584:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789785379.654005:0:17217:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:1.0:1789785379.654038:0:17217:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f18ee3fd845d59f 00000004:00100000:1.0:1789785379.654054:0:17217:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789785379.654060:0:17217:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1789785379.654134:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549155968 00000100:00100000:1.0:1789785379.654138:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549155968 00000100:00100000:1.0:1789785379.654164:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549155712 00000100:00100000:1.0:1789785379.654167:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549155712 00000100:00100000:1.0:1789785379.654180:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789785379.654187:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549155968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785379.654221:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549155968:12345-0@lo:400:kworker.0 Request processed in 33us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785379.654226:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789785379.654239:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789785379.654253:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549155712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785379.654286:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549155712:12345-0@lo:400:kworker.0 Request processed in 35us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785379.654292:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789785379.654311:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549155456 00000100:00100000:1.0:1789785379.654314:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549155456 00000100:00100000:1.0:1789785379.654361:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789785379.654368:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf458850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:3659:x1876725549155456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785379.654397:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf458850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:3659:x1876725549155456:12345-0@lo:400:kworker.0 Request processed in 30us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785379.654402:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1789785379.654455:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dafb113dc00 x1876725549155712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785379.654469:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549155712:0@lo:400:kworker.0 00000100:00100000:3.0:1789785379.655027:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785379.655097:0:17216:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1789785379.655106:0:17216:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00080000:2.0:1789785379.655414:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dafb113d500 x1876725549155968/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785379.655427:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549155968:0@lo:400:kworker.0 00000100:00100000:2.0:1789785379.655442:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549155840:0@lo:400:kworker.0 00000100:00100000:1.0:1789785379.661369:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad642144-cf43-4df2-a5e5-a426cdb5453e:3659:1876725549155456:0@lo:400:kworker.0 00000100:00100000:0.0:1789785379.665503:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549155328 00000100:00100000:0.0:1789785379.665518:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549155328 00000100:00100000:1.0:1789785379.683061:0:18200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789785379.683081:0:18200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549155328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789785379.683118:0:18200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789785379.683217:0:18200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549155328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (28190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785379.683225:0:18200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789785379.684133:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549155328:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1789785379.690680:0:17217:0:(import.c:65:import_set_state_nolock()) ffff9dafc18fe000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789785379.691617:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3658:x1876725549155584:12345-0@lo:38:kworker.0 Request processed in 37629us (38137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785379.691629:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789785379.692654:0:3658:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789785379.692667:0:3658:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789785379.692672:0:3658:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789785379.692676:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9daf85807000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789785379.692701:0:3658:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000001a035ed6): req@ffff9dafbf450e00 x1876725549148544/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785379.692721:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549155584:0@lo:38:kworker.0 00000100:00100000:0.0:1789785379.692820:0:17253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785379.692855:0:17253:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385a900 going to sleep for 11 seconds 00000100:00100000:0.0:1789785379.692870:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549148544 00000100:00100000:0.0:1789785379.692875:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549148544 00000100:00100000:0.0:1789785379.692910:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789785379.692919:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17253:x1876725549148544:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789785379.692992:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17253:x1876725549148544:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 74us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785379.693010:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789785379.693039:0:17253:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf450e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17253:1876725549148544:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1789785379.693068:0:17253:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789785379.693105:0:17253:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf450e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17253:1876725549156096:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789785379.693133:0:17253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785379.693154:0:17253:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385a900 going to sleep for 11 seconds 00000100:00100000:0.0:1789785379.693166:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549156096 00000100:00100000:0.0:1789785379.693168:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549156096 00000100:00100000:0.0:1789785379.693189:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789785379.693195:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17253:x1876725549156096:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789785379.693285:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17253:x1876725549156096:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 89us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785379.693291:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789785379.693314:0:17253:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf450e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17253:1876725549156096:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789785379.693404:0:17253:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf450e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17253:1876725549156224:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789785379.693427:0:17253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785379.693441:0:17253:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8385a900 going to sleep for 11 seconds 00000100:00100000:0.0:1789785379.693452:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549156224 00000100:00100000:0.0:1789785379.693455:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549156224 00000100:00100000:0.0:1789785379.693471:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789785379.693490:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf453800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17253:x1876725549156224:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789785379.693536:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf453800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17253:x1876725549156224:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 59us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785379.693543:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789785379.693575:0:17253:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf450e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17253:1876725549156224:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1789785379.693611:0:17253:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789785379.695589:0:17253:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789785379.695660:0:17253:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:0.0:1789785379.695665:0:17253:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:1.0:1789785379.697322:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549156352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789785379.697404:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785379.697457:0:18200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549156352 00000100:00100000:1.0:1789785379.697464:0:18200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549156352 00000100:00100000:1.0:1789785379.697501:0:18200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789785379.697509:0:18200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3659:x1876725549156352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789785379.697538:0:18200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789785379.697586:0:18200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3659:x1876725549156352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785379.697593:0:18200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789785379.697632:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549156352:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1789785379.818725:0:18214:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789785380.546560:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789785380.994581:0:18266:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789785380.994849:0:18266:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789785381.570894:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789785381.892305:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1789785382.199290:0:18317:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789785382.199983:0:18317:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789785382.595247:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789785383.214817:0:18365:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe9d077f90 20000000:00000080:3.0:1789785383.214835:0:18365:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9daf86360800 uarg=0000000000000000 20000000:01000000:3.0:1789785383.214946:0:18365:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789785383.214953:0:18365:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789785383.214958:0:18365:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789785383.223774:0:18366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1789785383.227564:0:18365:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789785383.242646:0:18365:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789785383.242952:0:18365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d5a6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785383.242970:0:18365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc1a65000/0x2f18ee3fd845d44f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d448 expref: 17 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785383.242978:0:18365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafb5d55c00/0x2f18ee3fd845d552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d54b expref: 17 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785383.243001:0:18365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d5a6 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785383.243042:0:18365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafb5d55c00/0x2f18ee3fd845d552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845d54b expref: 17 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785383.243057:0:18365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dafb5d55c00/0x2f18ee3fd845d552 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845d54b expref: 17 pid: 17206 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785383.243072:0:18365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c81180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18365:1876725549156480:0@lo:104: 00000100:00100000:2.0:1789785383.243137:0:18365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789785383.243192:0:18365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc1a65000/0x2f18ee3fd845d44f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845d448 expref: 17 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785383.243201:0:18365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dafc1a65000/0x2f18ee3fd845d44f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845d448 expref: 17 pid: 17206 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785383.243209:0:18365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c83480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18365:1876725549156608:0@lo:104: 00000100:00100000:2.0:1789785383.243231:0:18365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785383.243254:0:18365:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf83e57300 going to sleep for 11 seconds 00000100:00100000:3.0:1789785383.244714:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549156480 00000100:00100000:3.0:1789785383.244727:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549156480 00000100:00100000:3.0:1789785383.244777:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549156608 00000100:00100000:3.0:1789785383.244781:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549156608 00000100:00100000:3.0:1789785383.244796:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789785383.244807:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad642144-cf43-4df2-a5e5-a426cdb5453e+4:18365:x1876725549156480:12345-0@lo:104: 00010000:00010000:3.0:1789785383.244822:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55200/0x2f18ee3fd845d54b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845d552 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.244911:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789785383.244917:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad642144-cf43-4df2-a5e5-a426cdb5453e+4:18365:x1876725549156480:12345-0@lo:104: Request processed in 113us (1781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785383.244924:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789785383.244955:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789785383.244961:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad642144-cf43-4df2-a5e5-a426cdb5453e+3:18365:x1876725549156608:12345-0@lo:104: 00010000:00010000:3.0:1789785383.244970:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d448 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845d44f expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.245005:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789785383.245010:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad642144-cf43-4df2-a5e5-a426cdb5453e+3:18365:x1876725549156608:12345-0@lo:104: Request processed in 50us (1779us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785383.245016:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789785383.245033:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789785383.245039:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55200/0x2f18ee3fd845d54b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845d552 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.245046:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55200 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:3.0:1789785383.245050:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55200/0x2f18ee3fd845d54b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845d552 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.245057:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55200/0x2f18ee3fd845d54b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845d552 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789785383.245064:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55200/0x2f18ee3fd845d54b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845d552 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785383.245069:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789785383.245101:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55200/0x2f18ee3fd845d54b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d552 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.245107:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789785383.245129:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55200/0x2f18ee3fd845d54b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d552 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.245147:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55200/0x2f18ee3fd845d54b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d552 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.245158:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789785383.245162:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d448 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845d44f expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.245167:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bb800 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:3.0:1789785383.245169:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d448 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845d44f expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.245176:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d448 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845d44f expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789785383.245183:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d448 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845d44f expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785383.245189:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789785383.245202:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d448 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d44f expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.245209:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789785383.245224:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d448 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d44f expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.245231:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d448 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d44f expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.245244:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785383.245252:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785383.245254:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785383.245260:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785383.245274:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad642144-cf43-4df2-a5e5-a426cdb5453e:3661:1876725549156864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789785383.245310:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785383.245370:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549156864 00000100:00100000:3.0:1789785383.245374:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549156864 00010000:00010000:3.0:1789785383.245393:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc1a65000/0x2f18ee3fd845d44f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845d448 expref: 18 pid: 17206 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785383.245413:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789785383.245419:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:3661:x1876725549156864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789785383.245429:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785383.245435:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc1a65000/0x2f18ee3fd845d44f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845d448 expref: 18 pid: 17206 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.245446:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc1a65000/0x2f18ee3fd845d44f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845d448 expref: 18 pid: 17206 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.245599:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785383.245634:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:3661:x1876725549156864:12345-0@lo:103:ldlm_bl.0 Request processed in 214us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785383.245642:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789785383.245679:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad642144-cf43-4df2-a5e5-a426cdb5453e:3661:1876725549156864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789785383.246102:0:18365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c81180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18365:1876725549156480:0@lo:104: 00010000:00010000:2.0:1789785383.246113:0:18365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1a65000/0x2f18ee3fd845d44f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845d448 expref: 17 pid: 17206 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785383.246124:0:18365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c83480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18365:1876725549156608:0@lo:104: 00010000:00010000:2.0:1789785383.246142:0:18365:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d5a6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785383.246878:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789785383.246892:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad642144-cf43-4df2-a5e5-a426cdb5453e:3659:1876725549156736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789785383.246933:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785383.247060:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549156736 00000100:00100000:3.0:1789785383.247066:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549156736 00010000:00010000:3.0:1789785383.247089:0:17963:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafb5d55c00/0x2f18ee3fd845d552 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845d54b expref: 17 pid: 17206 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785383.247121:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789785383.247139:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad642144-cf43-4df2-a5e5-a426cdb5453e+17:3659:x1876725549156736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789785383.247149:0:17963:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785383.247154:0:17963:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafb5d55c00/0x2f18ee3fd845d552 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845d54b expref: 17 pid: 17206 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.247165:0:17963:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafb5d55c00/0x2f18ee3fd845d552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845d54b expref: 17 pid: 17206 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.247180:0:17963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafb5d55c00/0x2f18ee3fd845d552 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845d54b expref: 17 pid: 17206 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.247192:0:17963:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d5a6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.247200:0:17963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d5a6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.247214:0:17963:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d5a6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.247221:0:17963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d5a6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.247228:0:17963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d5a6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.247235:0:17963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d5a6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.247241:0:17963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54200 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:3.0:1789785383.247245:0:17963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d5a6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.247259:0:17963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d5a6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.247269:0:17963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d5a6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.247278:0:17963:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785383.247313:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad642144-cf43-4df2-a5e5-a426cdb5453e+16:3659:x1876725549156736:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785383.247320:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789785383.247370:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad642144-cf43-4df2-a5e5-a426cdb5453e:3659:1876725549156736:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789785383.247439:0:18365:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d5a6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785383.247448:0:18365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d5a6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785383.247463:0:18365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d5a6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785383.620282:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785384.642587:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789785384.647482:0:17209:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789785384.647493:0:17209:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9daf89062000 from 13 10000000:01000000:1.0:1789785384.647500:0:17209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789785384.647563:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64600/0x2f18ee3fd845d5ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785384.647577:0:17209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64600/0x2f18ee3fd845d5ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785384.647592:0:17209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64600/0x2f18ee3fd845d5ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785384.647625:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549156992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789785384.647712:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785384.647775:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf92353540 going to sleep for 11 seconds 00000100:00100000:0.0:1789785384.652143:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549156992 00000100:00100000:0.0:1789785384.652166:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549156992 00000100:00100000:0.0:1789785384.652258:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789785384.652271:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf45a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+16:17209:x1876725549156992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789785384.652292:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785384.652318:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dae81eacc00/0x2f18ee3fd845d5b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d5ad expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785384.652375:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dae81eacc00/0x2f18ee3fd845d5b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d5ad expref: 17 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785384.652387:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dae81eacc00/0x2f18ee3fd845d5b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d5ad expref: 17 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785384.652398:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eacc00, rc 0) 00000100:00100000:0.0:1789785384.652501:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf45a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+17:17209:x1876725549156992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 233us (4788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785384.652508:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789785384.652833:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549156992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789785384.652876:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64600/0x2f18ee3fd845d5ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d5b4 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785384.652887:0:17209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64600/0x2f18ee3fd845d5ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d5b4 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785384.652980:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549157120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789785384.653022:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785384.653066:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf92353540 going to sleep for 11 seconds 00000100:00100000:0.0:1789785384.654445:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549157120 00000100:00100000:0.0:1789785384.654475:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549157120 00000100:00100000:0.0:1789785384.654543:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789785384.654554:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+17:17209:x1876725549157120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789785384.654760:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+17:17209:x1876725549157120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (1738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785384.654769:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789785384.654888:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549157120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789785384.654952:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549157248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789785384.655006:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785384.655045:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf92353540 going to sleep for 11 seconds 00000100:00100000:0.0:1789785384.655106:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549157248 00000100:00100000:0.0:1789785384.655741:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549157248 00000100:00100000:1.0:1789785384.657497:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789785384.657512:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf45a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+17:17209:x1876725549157248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789785384.657713:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf45a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+17:17209:x1876725549157248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 204us (2706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785384.657731:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789785384.657828:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549157248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789785384.658823:0:18406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789785384.659024:0:17209:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789785384.659054:0:17209:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789785384.659068:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64600/0x2f18ee3fd845d5ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d5b4 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785384.659081:0:17209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64600/0x2f18ee3fd845d5ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d5b4 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785384.659092:0:17209:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789785384.659095:0:17209:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dafb11eb000 from 13 10000000:01000000:2.0:1789785384.659098:0:17209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789785384.659148:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55a00/0x2f18ee3fd845d5bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785384.659156:0:17209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55a00/0x2f18ee3fd845d5bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785384.659182:0:17209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55a00/0x2f18ee3fd845d5bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785384.659208:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549157376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789785384.659485:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785384.659535:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf83e57f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789785384.659671:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549157376 00000100:00100000:0.0:1789785384.659679:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549157376 00000100:00100000:0.0:1789785384.659772:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789785384.659783:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf459450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+17:17209:x1876725549157376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789785384.659799:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785384.659815:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dae81eac000/0x2f18ee3fd845d5c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d5bb expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785384.659841:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dae81eac000/0x2f18ee3fd845d5c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d5bb expref: 18 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785384.659852:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dae81eac000/0x2f18ee3fd845d5c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d5bb expref: 18 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785384.659862:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eac000, rc 0) 00000100:00100000:0.0:1789785384.659906:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf459450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:17209:x1876725549157376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785384.659914:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789785384.659956:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549157376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789785384.659982:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55a00/0x2f18ee3fd845d5bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d5c2 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785384.659991:0:17209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55a00/0x2f18ee3fd845d5bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d5c2 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785384.660056:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf450e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549157504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789785384.660081:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785384.660095:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafac89d780 going to sleep for 11 seconds 00000100:00100000:0.0:1789785384.660106:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549157504 00000100:00100000:0.0:1789785384.660121:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549157504 00000100:00100000:0.0:1789785384.660201:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789785384.660208:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf458c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:17209:x1876725549157504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789785384.660451:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf458c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:17209:x1876725549157504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785384.660458:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789785384.660490:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf450e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549157504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789785384.660518:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf450e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549157632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789785384.660564:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785384.660579:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafac89d780 going to sleep for 11 seconds 00000100:00100000:0.0:1789785384.660591:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549157632 00000100:00100000:0.0:1789785384.660595:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549157632 00000100:00100000:0.0:1789785384.660613:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789785384.660619:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf45b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:17209:x1876725549157632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789785384.660708:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf45b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:17209:x1876725549157632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785384.660734:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789785384.660774:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf450e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549157632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789785384.662389:0:18407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789785384.662551:0:17209:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789785384.662575:0:17209:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789785384.662588:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55a00/0x2f18ee3fd845d5bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d5c2 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785384.662601:0:17209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55a00/0x2f18ee3fd845d5bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d5c2 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785384.771038:0:3658:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789785374/real 1789785374] req@ffff9dafbf452300 x1876725549151744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789785384 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785384.771079:0:3658:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dafbf452300 x1876725549151744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789785384 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785384.771091:0:3658:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789785374/real 1789785374] req@ffff9dafb113f100 x1876725549151488/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789785384 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785384.771102:0:3658:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dafb113f100 x1876725549151488/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789785384 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785384.771112:0:3658:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789785369/real 1789785369] req@ffff9daf82c83800 x1876725549149696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789785384 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785384.771125:0:3658:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9daf82c83800 x1876725549149696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789785384 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785384.771134:0:3658:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789785369/real 1789785369] req@ffff9daf82c82300 x1876725549149824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789785384 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785384.771144:0:3658:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9daf82c82300 x1876725549149824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789785384 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789785384.771165:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9daf862fe800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789785384.771194:0:3658:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789785384.771198:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549151744:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789785384.771211:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dafbf3c0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789785384.771216:0:3658:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789785384.771219:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549151488:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789785384.771223:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dae84462800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789785384.771227:0:3658:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789785384.771230:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549149696:0@lo:8:kworker.0 00000100:00080000:0.0:1789785384.771233:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dafa64af800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789785384.771237:0:3658:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789785384.771240:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549149824:0@lo:8:kworker.0 00000100:00080000:1.0:1789785384.771673:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789785384.771677:0:15987:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789785384.771680:0:15987:0:(import.c:65:import_set_state_nolock()) ffff9dae84462800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789785384.771686:0:15987:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 478 00000100:00080000:1.0:1789785384.771692:0:15987:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789785384.771700:0:15987:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dae84462800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:1.0:1789785384.771734:0:15987:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafb113f100 x1876725549158016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789785384.771748:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789785384.771751:0:15987:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789785384.771753:0:15987:0:(import.c:65:import_set_state_nolock()) ffff9dafa64af800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789785384.771756:0:15987:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 478 00000100:00080000:1.0:1789785384.771759:0:15987:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789785384.771763:0:15987:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dafa64af800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:1.0:1789785384.771774:0:15987:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafb113ce00 x1876725549158144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789785384.771794:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789785384.771796:0:15987:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789785384.771798:0:15987:0:(import.c:65:import_set_state_nolock()) ffff9dafbf3c0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789785384.771800:0:15987:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 482 00000100:00080000:1.0:1789785384.771803:0:15987:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789785384.771805:0:15987:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9dafbf3c0000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:1.0:1789785384.771815:0:15987:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafb113d500 x1876725549158528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789785384.771830:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789785384.771833:0:15987:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789785384.771834:0:15987:0:(import.c:65:import_set_state_nolock()) ffff9daf862fe800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789785384.771837:0:15987:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 482 00000100:00080000:1.0:1789785384.771840:0:15987:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789785384.771843:0:15987:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9daf862fe800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:1.0:1789785384.771854:0:15987:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dae84603800 x1876725549158656/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789785384.771936:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876725549158272:0@lo:400:kworker.0 00000100:00100000:1.0:1789785384.772013:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785384.772055:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789785384.772061:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549157888:0@lo:400:kworker.0 00000100:00100000:1.0:1789785384.772088:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785384.772105:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549158912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789785384.772124:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785384.772169:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549158272 00000100:00100000:1.0:1789785384.772177:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549158272 00000100:00100000:1.0:1789785384.772245:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789785384.772256:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876725549158272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785384.772312:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876725549158272:12345-0@lo:400:kworker.0 Request processed in 58us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785384.772321:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789785384.772372:0:18200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549157888 00000100:00100000:1.0:1789785384.772376:0:18200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549157888 00000100:00100000:1.0:1789785384.772400:0:18200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549158912 00000100:00100000:1.0:1789785384.772410:0:18200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549158912 00000100:00100000:1.0:1789785384.772426:0:18200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789785384.772431:0:18200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3660:x1876725549157888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785384.772467:0:18200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3660:x1876725549157888:12345-0@lo:400:kworker.0 Request processed in 36us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785384.772473:0:18200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789785384.772483:0:18200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789785384.772488:0:18200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3660:x1876725549158912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789785384.772515:0:18200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789785384.772546:0:18200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3660:x1876725549158912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785384.772552:0:18200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789785384.772583:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549158016:0@lo:8:kworker.0 00000400:00000100:1.0:1789785384.772604:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876725549158016 offset 0 length 520: 4 00000100:00100000:1.0:1789785384.772629:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549158144:0@lo:8:kworker.0 00000400:00000100:1.0:1789785384.772645:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876725549158144 offset 0 length 520: 4 00000100:00100000:1.0:1789785384.772657:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549158528:0@lo:8:kworker.0 00000400:00000100:1.0:1789785384.772676:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876725549158528 offset 0 length 520: 4 00000100:00100000:1.0:1789785384.772687:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549158656:0@lo:8:kworker.0 00000400:00000100:1.0:1789785384.772705:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876725549158656 offset 0 length 520: 4 00000100:00100000:1.0:1789785384.772756:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549157888:0@lo:400:kworker.0 00000100:00100000:1.0:1789785384.772770:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549158912:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1789785384.772781:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dafb113df80 x1876725549158272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785384.772798:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876725549158272:0@lo:400:kworker.0 00000100:00100000:3.0:1789785384.773146:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad642144-cf43-4df2-a5e5-a426cdb5453e:3662:1876725549157760:0@lo:400:kworker.0 00000100:00100000:3.0:1789785384.773190:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785384.773215:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725549158784:0@lo:400:kworker.0 00000100:00100000:3.0:1789785384.773244:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785384.773265:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789785384.773271:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549158400:0@lo:400:kworker.0 00000100:00100000:3.0:1789785384.773294:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785384.773321:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789785384.773329:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549159040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789785384.773435:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785384.773927:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549157760 00000100:00100000:3.0:1789785384.773934:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549157760 00000100:00100000:3.0:1789785384.773976:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789785384.774181:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf458450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:3662:x1876725549157760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785384.774235:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf458450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:3662:x1876725549157760:12345-0@lo:400:kworker.0 Request processed in 58us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785384.774243:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789785384.774280:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549158784 00000100:00100000:3.0:1789785384.774285:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549158784 00000100:00100000:3.0:1789785384.774312:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789785384.774319:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725549158784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785384.774374:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725549158784:12345-0@lo:400:kworker.0 Request processed in 55us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785384.774380:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789785384.774415:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad642144-cf43-4df2-a5e5-a426cdb5453e:3662:1876725549157760:0@lo:400:kworker.0 00010000:00080000:3.0:1789785384.774429:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dae84601180 x1876725549158784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785384.774891:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725549158784:0@lo:400:kworker.0 00000100:00100000:3.0:1789785384.774935:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549158400 00000100:00100000:3.0:1789785384.774939:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549158400 00000100:00100000:3.0:1789785384.774972:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549159040 00000100:00100000:3.0:1789785384.774975:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549159040 00000100:00100000:1.0:1789785384.775408:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789785384.775422:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1876725549158400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785384.775492:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1876725549158400:12345-0@lo:400:kworker.0 Request processed in 74us (2196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785384.775500:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789785384.775518:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789785384.775524:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549159040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789785384.775552:0:17216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789785384.775589:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549159040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (2153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785384.775595:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789785384.775633:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549158400:0@lo:400:kworker.0 00000100:00100000:3.0:1789785384.775670:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549159040:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789785385.668015:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789785385.736461:0:17971:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:0.0:1789785385.805619:0:17944:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1789785386.693577:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785387.714821:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785388.739953:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785389.768275:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785389.895860:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549159168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789785389.895938:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785389.896005:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789785389.896012:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549159296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789785389.896037:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785389.896086:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549159168 00000100:00100000:3.0:1789785389.896095:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549159168 00000100:00100000:3.0:1789785389.896147:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549159296 00000100:00100000:3.0:1789785389.896150:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549159296 00000100:00100000:3.0:1789785389.896170:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789785389.896179:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549159168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789785389.896215:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789785389.896265:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549159168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785389.896273:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789785389.896291:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789785389.896298:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549159296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789785389.896314:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789785389.896361:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549159296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785389.896367:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789785389.896408:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549159296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789785389.896421:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549159168:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1789785389.902697:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789785389.902705:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789785389.902718:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789785389.902722:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789785389.902738:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789785389.902741:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789785389.902744:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789785389.902747:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789785389.902829:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad642144-cf43-4df2-a5e5-a426cdb5453e:3659:1876725549159424:0@lo:400:kworker.0 00000100:00100000:3.0:1789785389.902904:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785389.902953:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789785389.902960:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549159552:0@lo:400:kworker.0 00000100:00100000:3.0:1789785389.902985:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785389.903012:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549159424 00000100:00100000:3.0:1789785389.903018:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549159424 00000100:00100000:3.0:1789785389.903061:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789785389.903070:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf45b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:3659:x1876725549159424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785389.903115:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf45b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:3659:x1876725549159424:12345-0@lo:400:kworker.0 Request processed in 46us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785389.903122:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789785389.903154:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789785389.903162:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725549159680:0@lo:400:kworker.0 00000100:00100000:3.0:1789785389.903184:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785389.903208:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549159552 00000100:00100000:3.0:1789785389.903212:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549159552 00000100:00100000:3.0:1789785389.903235:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549159680 00000100:00100000:3.0:1789785389.903238:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549159680 00000100:00100000:3.0:1789785389.903263:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789785389.903268:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549159552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785389.903300:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549159552:12345-0@lo:400:kworker.0 Request processed in 32us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785389.903306:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789785389.903319:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789785389.903324:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725549159680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785389.903373:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725549159680:12345-0@lo:400:kworker.0 Request processed in 49us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785389.903380:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789785389.903413:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dae84604380 x1876725549159680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785389.903426:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725549159680:0@lo:400:kworker.0 00010000:00080000:3.0:1789785389.903457:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dae846a2d80 x1876725549159552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785389.903465:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549159552:0@lo:400:kworker.0 00000100:00100000:3.0:1789785389.903474:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad642144-cf43-4df2-a5e5-a426cdb5453e:3659:1876725549159424:0@lo:400:kworker.0 00000020:01000004:2.0:1789785390.325492:0:18713:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789785390.325497:0:18713:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789785390.325498:0:18713:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789785390.326627:0:18713:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9daf84978000 00000020:01000004:2.0:1789785390.326646:0:18713:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789785390.326660:0:18713:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789785390.326674:0:18713:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9dafb11d8000) 00000020:00000080:2.0:1789785390.326701:0:18713:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789785390.397061:0:18713:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789785390.398158:0:18713:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789785390.398631:0:18713:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789785390.398839:0:18713:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789785390.399082:0:18713:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789785390.399266:0:18713:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789785390.399525:0:18713:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:1.0:1789785390.402025:0:18713:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789785390.402221:0:18713:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789785390.402233:0:18713:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789785390.402244:0:18713:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2f18ee3fd845d5d0 00000020:01000004:1.0:1789785390.402250:0:18713:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789785390.402272:0:18713:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.146@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789785390.402282:0:18713:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.146@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789785390.402288:0:18713:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789785390.402293:0:18713:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789785390.402304:0:18713:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9dafb5c3cd28) 00000020:00000080:1.0:1789785390.402316:0:18713:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1789785390.403665:0:18713:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789785390.403835:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789785390.403841:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789785390.404619:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789785390.404625:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789785390.408238:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789785390.408254:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789785390.409830:0:18713:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789785390.410160:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789785390.410167:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789785390.415937:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789785390.415951:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789785390.433304:0:18713:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789785390.433802:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789785390.433809:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789785390.435204:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789785390.435213:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789785390.436216:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789785390.436232:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789785390.442699:0:18713:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789785390.442909:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789785390.442916:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789785390.443849:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789785390.443858:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789785390.487979:0:18713:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789785390.488272:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789785390.488278:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789785390.489578:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789785390.489588:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789785390.490053:0:18713:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789785390.490082:0:18713:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1789785390.490088:0:18713:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.146@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789785390.506330:0:18713:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.146@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789785390.506431:0:18713:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.146@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789785390.506436:0:18713:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789785390.506438:0:18713:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789785390.506439:0:18713:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789785390.506440:0:18713:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789785390.506441:0:18713:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789785390.506442:0:18713:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789785390.506443:0:18713:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789785390.506444:0:18713:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789785390.506445:0:18713:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789785390.506449:0:18713:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789785390.506451:0:18713:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789785390.506452:0:18713:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789785390.506453:0:18713:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789785390.506454:0:18713:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789785390.506455:0:18713:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789785390.506462:0:18713:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789785390.506463:0:18713:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789785390.506463:0:18713:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789785390.506464:0:18713:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789785390.506488:0:18713:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789785390.506646:0:18713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf452300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549159808:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789785390.506746:0:18713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785390.506791:0:18713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf854400c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785390.506861:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549159808 00000100:00100000:3.0:1789785390.506868:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549159808 00000100:00100000:3.0:1789785390.506925:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789785390.506933:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:18713:x1876725549159808:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789785390.506971:0:17206:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789785390.506974:0:17206:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789785390.506978:0:17206:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789785390.507425:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:18713:x1876725549159808:12345-0@lo:253:mount.lustre.0 Request processed in 491us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785390.507434:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789785390.507838:0:18713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf452300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549159808:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789785390.507851:0:18713:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789785390.507853:0:18713:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789785390.507854:0:18713:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789785390.507856:0:18713:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789785390.507857:0:18713:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789785390.507858:0:18713:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789785390.507859:0:18713:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789785390.507860:0:18713:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789785390.507862:0:18713:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789785390.507863:0:18713:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789785390.507894:0:18713:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9daf84978000 from lustre-OST0000 10000000:01000000:0.0:1789785390.507933:0:18713:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789785390.507936:0:18713:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789785390.507943:0:18713:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dae837219b8 local copy 00010000:00010000:0.0:1789785390.507953:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54000/0x2f18ee3fd845d38b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d392 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785390.508055:0:18713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf452300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549159936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789785390.508090:0:18713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785390.508126:0:18713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf854403c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785390.508368:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549159936 00000100:00100000:3.0:1789785390.508373:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549159936 00000100:00100000:3.0:1789785390.508420:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789785390.508429:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:18713:x1876725549159936:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789785390.508498:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:18713:x1876725549159936:12345-0@lo:501:mount.lustre.0 Request processed in 70us (407us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789785390.508515:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789785390.508752:0:18713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf452300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549159936:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789785390.508773:0:18713:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.146@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789785390.508791:0:18713:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.146@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789785390.508805:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54000/0x2f18ee3fd845d38b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d392 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785390.508813:0:18713:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54000/0x2f18ee3fd845d38b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d392 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785390.508837:0:18713:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9daf84978000 10000000:01000000:0.0:1789785390.508842:0:18713:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789785390.508847:0:18713:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789785390.508849:0:18713:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789785390.508853:0:18713:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789785390.508855:0:18713:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789785390.508875:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eac400/0x2f18ee3fd845d5de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785390.508883:0:18713:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dae81eac400/0x2f18ee3fd845d5de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785390.508891:0:18713:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dae81eac400/0x2f18ee3fd845d5de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785390.508905:0:18713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf452300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549160064:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789785390.508934:0:18713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785390.509008:0:18713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf854403c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789785390.509226:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549160064 00000100:00100000:2.0:1789785390.509232:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549160064 00000100:00100000:2.0:1789785390.509303:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789785390.509312:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+18:18713:x1876725549160064:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789785390.509322:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785390.509334:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafb5d54400/0x2f18ee3fd845d5e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d5de expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785390.509387:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafb5d54400/0x2f18ee3fd845d5e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d5de expref: 19 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785390.509407:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafb5d54400/0x2f18ee3fd845d5e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d5de expref: 19 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785390.509425:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d54400, rc 0) 00000100:00100000:2.0:1789785390.509460:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+19:18713:x1876725549160064:12345-0@lo:101:mount.lustre.0 Request processed in 150us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785390.509466:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789785390.509547:0:18713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf452300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549160064:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789785390.509559:0:18713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dae81eac400/0x2f18ee3fd845d5de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d5e5 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785390.509569:0:18713:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dae81eac400/0x2f18ee3fd845d5de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d5e5 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789785390.510814:0:18713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789785390.511395:0:18713:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789785390.514101:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789785390.514155:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789785390.514172:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789785390.514186:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789785390.514196:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789785390.514207:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789785390.514231:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789785390.514236:0:18713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789785390.514622:0:18713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549160192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789785390.514698:0:18713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785390.514791:0:18713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf83f30000 going to sleep for 11 seconds 00000100:00100000:2.0:1789785390.514842:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549160192 00000100:00100000:2.0:1789785390.514849:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549160192 00000100:00100000:2.0:1789785390.514936:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789785390.514947:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+19:18713:x1876725549160192:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789785390.515139:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+19:18713:x1876725549160192:12345-0@lo:501:mount.lustre.0 Request processed in 193us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785390.515147:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789785390.521522:0:18713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549160192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789785390.521616:0:18713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549160320:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789785390.521715:0:18713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785390.521763:0:18713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf83f30000 going to sleep for 11 seconds 00000100:00100000:3.0:1789785390.521895:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549160320 00000100:00100000:3.0:1789785390.521902:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549160320 00000100:00100000:3.0:1789785390.521953:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789785390.521962:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+19:18713:x1876725549160320:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789785390.522917:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+19:18713:x1876725549160320:12345-0@lo:503:mount.lustre.0 Request processed in 952us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785390.522934:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789785390.523093:0:18713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549160320:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789785390.524864:0:18713:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789785390.524980:0:18713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549160448:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789785390.526141:0:18713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785390.526190:0:18713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafbb40ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1789785390.526265:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549160448 00000100:00100000:3.0:1789785390.526273:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549160448 00000100:00100000:3.0:1789785390.526415:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789785390.526427:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+19:18713:x1876725549160448:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789785390.527630:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+19:18713:x1876725549160448:12345-0@lo:502:mount.lustre.0 Request processed in 1201us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785390.527641:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789785390.527740:0:18713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549160448:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789785390.527981:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789785390.528023:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789785390.528038:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789785390.528052:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789785390.528064:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789785390.528076:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789785390.528089:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789785390.528101:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789785390.528115:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1789785390.528127:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1789785390.528139:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1789785390.528152:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1789785390.528185:0:18713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549160576:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789785390.528231:0:18713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785390.535850:0:18713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf83f30000 going to sleep for 11 seconds 00000100:00100000:2.0:1789785390.538486:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549160576 00000100:00100000:2.0:1789785390.538500:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549160576 00000100:00100000:2.0:1789785390.538557:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789785390.538567:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+19:18713:x1876725549160576:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789785390.538757:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+19:18713:x1876725549160576:12345-0@lo:502:mount.lustre.0 Request processed in 191us (10525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785390.538773:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789785390.538893:0:18713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549160576:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789785390.538998:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1789785390.539016:0:18713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1789785390.541071:0:18730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789785390.541082:0:18730:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1789785390.541089:0:18730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785390.541091:0:18730:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789785390.541097:0:18730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789785390.541123:0:18730:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9dae83570000) 00000020:00000080:1.0:1789785390.541148:0:18730:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789785390.541156:0:18730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789785390.541249:0:18730:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9daf84978000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789785390.541258:0:18730:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789785390.541266:0:18730:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2f18ee3fd845d5f3 00010000:00010000:1.0:1789785390.544445:0:18730:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1789785390.552746:0:18730:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967326 00080000:10000000:2.0:1789785390.554570:0:18730:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1789785390.576769:0:18730:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789785390.576783:0:18730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785390.576790:0:18730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785390.576792:0:18730:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789785390.576797:0:18730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789785390.576801:0:18730:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1789785390.576802:0:18730:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789785390.576804:0:18730:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789785390.576805:0:18730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789785390.576808:0:18730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785390.576809:0:18730:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789785390.576812:0:18730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789785390.576815:0:18730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785390.576816:0:18730:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789785390.576820:0:18730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789785390.576822:0:18730:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789785390.576824:0:18730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785390.576826:0:18730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785390.576828:0:18730:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789785390.576830:0:18730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789785390.576832:0:18730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785390.576834:0:18730:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789785390.576837:0:18730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789785390.576869:0:18730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785390.576873:0:18730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785390.576874:0:18730:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789785390.576877:0:18730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1789785390.581158:0:18713:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789785390.581219:0:18713:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789785390.581238:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eac400/0x2f18ee3fd845d5de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d5e5 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785390.581251:0:18713:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dae81eac400/0x2f18ee3fd845d5de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d5e5 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789785390.584286:0:18713:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9daf84978000 from 1 10000000:01000000:3.0:1789785390.584293:0:18713:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789785390.584333:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d5fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785390.584374:0:18713:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d5fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785390.584385:0:18713:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d5fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785390.584418:0:18713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84604380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549160704:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789785390.584485:0:18713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785390.584713:0:18713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84c40600 going to sleep for 11 seconds 00000100:00100000:0.0:1789785390.584834:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549160704 00000100:00100000:0.0:1789785390.584842:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549160704 00000100:00100000:0.0:1789785390.584930:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789785390.584939:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+19:18713:x1876725549160704:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789785390.584960:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785390.584972:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dae81eaca00/0x2f18ee3fd845d601 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d5fa expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785390.584994:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dae81eaca00/0x2f18ee3fd845d601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d5fa expref: 20 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785390.585004:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dae81eaca00/0x2f18ee3fd845d601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d5fa expref: 20 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785390.585012:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eaca00, rc 0) 00000100:00100000:0.0:1789785390.585064:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+20:18713:x1876725549160704:12345-0@lo:101:mount.lustre.0 Request processed in 127us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785390.585070:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789785390.585155:0:18713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84604380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549160704:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789785390.585170:0:18713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d5fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d601 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.585179:0:18713:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d5fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d601 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789785390.592025:0:18713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789785390.592473:0:18713:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789785390.592737:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789785390.592761:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789785390.592778:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789785390.592784:0:18713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789785390.592851:0:18713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549160832:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789785390.592912:0:18713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785390.593688:0:18713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6000 going to sleep for 11 seconds 00000100:00100000:3.0:1789785390.595845:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549160832 00000100:00100000:3.0:1789785390.595859:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549160832 00000100:00100000:3.0:1789785390.598287:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789785390.598307:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+20:18713:x1876725549160832:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789785390.598878:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+20:18713:x1876725549160832:12345-0@lo:501:mount.lustre.0 Request processed in 579us (5963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785390.598910:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789785390.599117:0:18713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549160832:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789785390.599179:0:18713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549160960:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789785390.599230:0:18713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785390.599264:0:18713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6000 going to sleep for 11 seconds 00000100:00100000:0.0:1789785390.599329:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549160960 00000100:00100000:0.0:1789785390.599335:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549160960 00000100:00100000:2.0:1789785390.599670:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789785390.599688:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+20:18713:x1876725549160960:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789785390.599777:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+20:18713:x1876725549160960:12345-0@lo:503:mount.lustre.0 Request processed in 99us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785390.599785:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789785390.599829:0:18713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549160960:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789785390.600222:0:18713:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789785390.600299:0:18713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549161088:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789785390.600333:0:18713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785390.600381:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549161088 00000100:00100000:2.0:1789785390.600386:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549161088 00000100:00100000:2.0:1789785390.600710:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789785390.600718:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+20:18713:x1876725549161088:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789785390.600792:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+20:18713:x1876725549161088:12345-0@lo:502:mount.lustre.0 Request processed in 74us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785390.600798:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789785390.600831:0:18713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6000 going to sleep for 11 seconds 00000100:00100000:2.0:1789785390.600844:0:18713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549161088:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789785390.601117:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789785390.601153:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789785390.601171:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789785390.601185:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789785390.601198:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789785390.601209:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789785390.601223:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789785390.601236:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1789785390.601248:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789785390.601260:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1789785390.601273:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1789785390.601295:0:18713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549161216:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789785390.601331:0:18713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785390.601383:0:18713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6000 going to sleep for 11 seconds 00000100:00100000:3.0:1789785390.601611:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549161216 00000100:00100000:3.0:1789785390.601616:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549161216 00000100:00100000:3.0:1789785390.601652:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789785390.601659:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+20:18713:x1876725549161216:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789785390.601749:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+20:18713:x1876725549161216:12345-0@lo:502:mount.lustre.0 Request processed in 90us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785390.601756:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789785390.601990:0:18713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549161216:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789785390.602034:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1789785390.602042:0:18713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789785390.607596:0:18734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789785390.607610:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785390.607613:0:18734:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789785390.607620:0:18734:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9daf84978000 00000020:00000080:1.0:1789785390.607623:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789785390.607632:0:18734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785390.607634:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785390.607636:0:18734:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789785390.607638:0:18734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789785390.607641:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785390.607642:0:18734:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789785390.607645:0:18734:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9daf84978000 00000020:00000080:1.0:1789785390.607647:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789785390.607722:0:18734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785390.607727:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785390.607728:0:18734:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789785390.607730:0:18734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789785390.607733:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785390.607740:0:18734:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789785390.607744:0:18734:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9daf84978000 00000020:00000080:1.0:1789785390.607746:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789785390.607766:0:18734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785390.607769:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785390.607770:0:18734:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789785390.607772:0:18734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789785390.607775:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785390.607776:0:18734:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789785390.607779:0:18734:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9daf84978000 00000020:00000080:1.0:1789785390.607781:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789785390.607804:0:18734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785390.607807:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785390.607808:0:18734:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789785390.607811:0:18734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1789785390.612252:0:18713:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789785390.612298:0:18713:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789785390.612319:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d5fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d601 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785390.612331:0:18713:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d5fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d601 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785390.612438:0:18713:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789785390.612442:0:18713:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9daf84978000 10000000:01000000:0.0:1789785390.612445:0:18713:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9daf84978000 10000000:01000000:0.0:1789785390.612449:0:18713:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789785390.612455:0:18713:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9daf84978000 from 1 10000000:01000000:0.0:1789785390.612458:0:18713:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789785390.612501:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eace00/0x2f18ee3fd845d608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785390.612521:0:18713:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dae81eace00/0x2f18ee3fd845d608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785390.612531:0:18713:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dae81eace00/0x2f18ee3fd845d608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785390.612555:0:18713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf452300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549161344:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789785390.612619:0:18713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785390.612691:0:18713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf85440600 going to sleep for 11 seconds 00000100:00100000:0.0:1789785390.617766:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549161344 00000100:00100000:0.0:1789785390.617779:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549161344 00000100:00100000:0.0:1789785390.617830:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789785390.617840:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+20:18713:x1876725549161344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789785390.617857:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785390.617874:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dae81ead800/0x2f18ee3fd845d60f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d608 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785390.617913:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dae81ead800/0x2f18ee3fd845d60f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d608 expref: 21 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785390.617924:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dae81ead800/0x2f18ee3fd845d60f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d608 expref: 21 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785390.617933:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81ead800, rc 0) 00000100:00100000:0.0:1789785390.618007:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:18713:x1876725549161344:12345-0@lo:101:mount.lustre.0 Request processed in 168us (5387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785390.618015:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789785390.618082:0:18713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf452300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549161344:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789785390.618098:0:18713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dae81eace00/0x2f18ee3fd845d608 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d60f expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785390.618107:0:18713:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dae81eace00/0x2f18ee3fd845d608 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d60f expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789785390.619823:0:18713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1789785390.621194:0:18713:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789785390.621642:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789785390.621668:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789785390.621693:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789785390.621708:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789785390.621721:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789785390.621733:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789785390.621745:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789785390.621756:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789785390.621781:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789785390.621794:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789785390.621807:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789785390.621819:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789785390.621832:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789785390.621843:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789785390.621854:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789785390.621865:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789785390.621875:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789785390.621886:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789785390.625158:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789785390.625186:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789785390.625200:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789785390.625212:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789785390.625225:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789785390.625238:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789785390.625250:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1789785390.625262:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1789785390.625275:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1789785390.625286:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1789785390.625299:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1789785390.625311:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1789785390.625322:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1789785390.625335:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1789785390.625994:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1789785390.626009:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1789785390.626022:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1789785390.626035:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1789785390.626058:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1789785390.626086:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1789785390.626092:0:18713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789785390.626191:0:18713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549161472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789785390.626252:0:18713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785390.626287:0:18713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf9017b240 going to sleep for 11 seconds 00000100:00100000:0.0:1789785390.626390:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549161472 00000100:00100000:0.0:1789785390.626405:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549161472 00000100:00100000:0.0:1789785390.626449:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789785390.626458:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:18713:x1876725549161472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789785390.626765:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:18713:x1876725549161472:12345-0@lo:501:mount.lustre.0 Request processed in 307us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785390.626772:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789785390.628042:0:18713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549161472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789785390.628094:0:18713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549161600:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789785390.628146:0:18713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785390.628176:0:18713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf9017b240 going to sleep for 11 seconds 00000100:00100000:0.0:1789785390.628377:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549161600 00000100:00100000:0.0:1789785390.628384:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549161600 00000100:00100000:0.0:1789785390.628595:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789785390.628605:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:18713:x1876725549161600:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789785390.628719:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:18713:x1876725549161600:12345-0@lo:503:mount.lustre.0 Request processed in 115us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785390.628726:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789785390.628860:0:18713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549161600:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789785390.632603:0:18713:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789785390.632729:0:18713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549161728:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789785390.632806:0:18713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785390.632842:0:18713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf9017b240 going to sleep for 11 seconds 00000100:00100000:0.0:1789785390.635008:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549161728 00000100:00100000:0.0:1789785390.635020:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549161728 00000100:00100000:0.0:1789785390.635072:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789785390.635082:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:18713:x1876725549161728:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789785390.635246:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:18713:x1876725549161728:12345-0@lo:502:mount.lustre.0 Request processed in 165us (2439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785390.635254:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789785390.636642:0:18713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549161728:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789785390.636875:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789785390.636920:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789785390.636946:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789785390.636958:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789785390.636971:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789785390.636984:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789785390.636997:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789785390.637026:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789785390.637042:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789785390.637054:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789785390.637066:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789785390.637077:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789785390.637089:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789785390.637101:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789785390.637113:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789785390.637126:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789785390.637139:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789785390.637153:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789785390.637166:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789785390.637179:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789785390.637192:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789785390.637204:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789785390.637216:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789785390.637240:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789785390.637254:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1789785390.637266:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1789785390.637277:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1789785390.637288:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1789785390.637301:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1789785390.637315:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1789785390.637328:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1789785390.637362:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1789785390.637377:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1789785390.637391:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1789785390.638043:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1789785390.638072:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1789785390.638085:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1789785390.638096:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1789785390.638109:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1789785390.638138:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1789785390.638153:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1789785390.638166:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1789785390.638178:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1789785390.638191:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1789785390.638205:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1789785390.638217:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1789785390.638230:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1789785390.638242:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1789785390.638290:0:18713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549161856:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789785390.640647:0:18713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785390.640729:0:18713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6000 going to sleep for 11 seconds 00000100:00100000:0.0:1789785390.641632:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549161856 00000100:00100000:0.0:1789785390.641642:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549161856 00000100:00100000:0.0:1789785390.641703:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789785390.641713:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:18713:x1876725549161856:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789785390.641858:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:18713:x1876725549161856:12345-0@lo:502:mount.lustre.0 Request processed in 146us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785390.641865:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789785390.643721:0:18713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549161856:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789785390.643944:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1789785390.643972:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1789785390.644007:0:18713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549161984:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789785390.644066:0:18713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785390.644109:0:18713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae827d6000 going to sleep for 11 seconds 00000100:00100000:0.0:1789785390.644493:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549161984 00000100:00100000:0.0:1789785390.644501:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549161984 00000100:00100000:0.0:1789785390.644561:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789785390.644570:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:18713:x1876725549161984:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789785390.644675:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:18713:x1876725549161984:12345-0@lo:502:mount.lustre.0 Request processed in 106us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785390.644692:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789785390.646178:0:18713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549161984:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789785390.646248:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1789785390.646258:0:18713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789785390.648082:0:18739:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789785390.648098:0:18739:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9dae82b2cd28) 00000020:00000080:0.0:1789785390.648122:0:18739:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1789785390.648194:0:18739:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9daf84978000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789785390.648198:0:18739:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9daf84978000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789785390.648200:0:18739:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9daf84978000 3 00010000:00080000:0.0:1789785390.648235:0:18739:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dae82a04800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.146@tcp at head 00010000:00010000:3.0:1789785390.653236:0:18739:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1789785390.655025:0:18739:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789785390.655088:0:18739:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789785390.655104:0:18739:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2f18ee3fd845d61d 00000100:00080000:3.0:1789785390.655114:0:18739:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789785390.655120:0:18739:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dae82a04800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:3.0:1789785390.655152:0:18739:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dae84605180 x1876725549162112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789785390.655199:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1876725549162112:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789785390.655263:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789785390.655321:0:18739:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789785390.656149:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549162112 00000100:00100000:2.0:1789785390.656168:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549162112 00000100:00100000:2.0:1789785390.656931:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789785390.656946:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1876725549162112:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789785390.656987:0:17211:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:2.0:1789785390.657028:0:17211:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2f18ee3fd845d624 00000004:00100000:2.0:1789785390.657049:0:17211:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789785390.657087:0:17211:0:(import.c:65:import_set_state_nolock()) ffff9dae8353b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789785390.657179:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1876725549162112:12345-0@lo:38:llog_process_th.0 Request processed in 232us (1913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785390.657187:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789785390.657279:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dae84605180 x1876725549162112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789785400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785390.657297:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789785390.657304:0:3658:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789785390.657311:0:3658:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789785390.657320:0:3658:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789785390.657323:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dae82a04800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789785390.657330:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1876725549162112:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1789785390.658097:0:18739:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789785390.658116:0:18739:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9dae82b28000) 00000020:00000080:0.0:1789785390.658135:0:18739:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1789785390.658269:0:18739:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9daf84978000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789785390.658273:0:18739:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9daf84978000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789785390.658282:0:18739:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9daf84978000 3 00010000:00080000:0.0:1789785390.658314:0:18739:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9daf8626d800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.146@tcp at head 00010000:00010000:0.0:1789785390.661906:0:18739:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1789785390.662106:0:18739:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1789785390.662147:0:18739:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789785390.662159:0:18739:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x2f18ee3fd845d632 00000100:00080000:0.0:1789785390.662169:0:18739:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789785390.662175:0:18739:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9daf8626d800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:0.0:1789785390.662206:0:18739:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafbf452300 x1876725549162240/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789785390.662244:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3658:1876725549162240:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789785390.662311:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785390.662620:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549162240 00000100:00100000:1.0:1789785390.662627:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549162240 00000100:00100000:1.0:1789785390.662659:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789785390.662668:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1876725549162240:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789785390.662701:0:17213:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:1.0:1789785390.662730:0:17213:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x2f18ee3fd845d639 00000100:00080000:3.0:1789785390.664488:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789785390.664496:0:15987:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789785390.664498:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789785390.664501:0:15987:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789785390.664513:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789785390.664526:0:15987:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789785390.664528:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789785390.664531:0:15987:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789785390.664750:0:18739:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789785390.664960:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789785390.664964:0:15987:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789785390.664966:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789785390.664968:0:15987:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789785390.664970:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789785390.664973:0:15987:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789785390.664975:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789785390.664977:0:15987:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1789785390.665875:0:18739:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1789785390.670061:0:18713:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789785390.670110:0:18713:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789785390.670131:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eace00/0x2f18ee3fd845d608 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d60f expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785390.670143:0:18713:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dae81eace00/0x2f18ee3fd845d608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d60f expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789785390.670205:0:18713:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789785390.670207:0:18713:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789785390.670208:0:18713:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789785390.670209:0:18713:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789785390.670210:0:18713:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789785390.670211:0:18713:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789785390.670218:0:18713:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789785390.670219:0:18713:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789785390.670221:0:18713:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789785390.670224:0:18713:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789785390.670226:0:18713:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789785390.670227:0:18713:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789785390.670228:0:18713:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789785390.670229:0:18713:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789785390.670230:0:18713:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789785390.670230:0:18713:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789785390.670231:0:18713:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789785390.670232:0:18713:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789785390.670233:0:18713:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789785390.670258:0:18713:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789785390.670278:0:18713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84606d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549162368:0@lo:253:mount.lustre.0 00000004:00100000:1.0:1789785390.677068:0:17213:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789785390.677117:0:17213:0:(import.c:65:import_set_state_nolock()) ffff9dae81f93000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789785390.679014:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1876725549162240:12345-0@lo:38:llog_process_th.0 Request processed in 16339us (16696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785390.679026:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789785390.679098:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dafbf452300 x1876725549162240/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789785400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785390.679110:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789785390.679118:0:3658:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1789785390.679127:0:3658:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789785390.679131:0:3658:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789785390.679134:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9daf8626d800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789785390.679140:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3658:1876725549162240:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789785390.681607:0:18713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785390.681651:0:18713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc19c4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789785390.681809:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549162368 00000100:00100000:0.0:1789785390.681817:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549162368 00000100:00100000:0.0:1789785390.681865:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789785390.681873:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:18713:x1876725549162368:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789785390.681906:0:17206:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789785390.681919:0:17206:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789785390.685808:0:17206:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789785390.685829:0:17206:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1789785390.686990:0:17227:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789785390.686996:0:17227:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789785390.687018:0:17227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dafc1a65400/0x2f18ee3fd845d640 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.687037:0:17227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafc1a65c00/0x2f18ee3fd845d58a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d583 expref: 21 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.687045:0:17227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafb5d54c00/0x2f18ee3fd845d598 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d591 expref: 21 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.687053:0:17227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dafc1a65400/0x2f18ee3fd845d640 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.687089:0:17227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafb5d54c00/0x2f18ee3fd845d598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845d591 expref: 21 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.687102:0:17227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dafb5d54c00/0x2f18ee3fd845d598 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845d591 expref: 21 pid: 17205 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785390.687116:0:17227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84602a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1876725549162496:0@lo:104: 00000100:00100000:1.0:1789785390.687193:0:17227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789785390.687235:0:17227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafc1a65c00/0x2f18ee3fd845d58a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845d583 expref: 21 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.687244:0:17227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dafc1a65c00/0x2f18ee3fd845d58a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845d583 expref: 21 pid: 17205 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785390.689551:0:17227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84600000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1876725549162624:0@lo:104: 00000100:00100000:1.0:1789785390.689617:0:17227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785390.689662:0:17227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf9017be40 going to sleep for 11 seconds 00000100:00100000:1.0:1789785390.689704:0:17195:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789785390.689721:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549162496 00000100:00100000:1.0:1789785390.689728:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549162496 00000100:00100000:1.0:1789785390.689762:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549162624 00000100:00100000:1.0:1789785390.689764:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549162624 00000100:00100000:1.0:1789785390.689779:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789785390.689787:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84602680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad642144-cf43-4df2-a5e5-a426cdb5453e+4:17227:x1876725549162496:12345-0@lo:104: 00010000:00010000:1.0:1789785390.689803:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845d598 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785390.690255:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:18713:x1876725549162368:12345-0@lo:253:mount.lustre.0 Request processed in 8380us (8651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785390.690264:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789785390.691057:0:18713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84606d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:18713:1876725549162368:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789785390.691072:0:18713:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789785390.691075:0:18713:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789785390.691077:0:18713:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789785390.691078:0:18713:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789785390.691079:0:18713:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789785390.691080:0:18713:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789785390.691081:0:18713:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789785390.691082:0:18713:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789785390.691084:0:18713:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789785390.691085:0:18713:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789785390.691102:0:18713:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1789785390.692151:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789785390.692159:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84602680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad642144-cf43-4df2-a5e5-a426cdb5453e+4:17227:x1876725549162496:12345-0@lo:104: Request processed in 2371us (4965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785390.692169:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789785390.692199:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789785390.692210:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a42050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad642144-cf43-4df2-a5e5-a426cdb5453e+3:17227:x1876725549162624:12345-0@lo:104: 00010000:00010000:1.0:1789785390.692222:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9daf814bb000/0x2f18ee3fd845d583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845d58a expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.693615:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789785390.693624:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a42050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad642144-cf43-4df2-a5e5-a426cdb5453e+3:17227:x1876725549162624:12345-0@lo:104: Request processed in 1416us (4005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785390.693633:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789785390.693694:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789785390.693701:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845d598 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.693710:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eac800 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:1.0:1789785390.693714:0:17199:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845d598 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.693723:0:17199:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845d598 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789785390.693731:0:17199:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845d598 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785390.693737:0:17199:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789785390.693773:0:17199:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d591 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d598 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.693779:0:17199:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789785390.693797:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d591 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d598 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.693804:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d591 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d598 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785390.694046:0:17227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84602a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1876725549162496:0@lo:104: 00000100:00100000:0.0:1789785390.694056:0:17227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84600000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1876725549162624:0@lo:104: 00010000:00010000:0.0:1789785390.694076:0:17227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dafc1a65400/0x2f18ee3fd845d640 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785390.694611:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789785390.696481:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785390.696484:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785390.696486:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785390.696516:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad642144-cf43-4df2-a5e5-a426cdb5453e:3662:1876725549162752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789785390.696583:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785390.696656:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549162752 00000100:00100000:1.0:1789785390.696663:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549162752 00010000:00010000:1.0:1789785390.696699:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafb5d54c00/0x2f18ee3fd845d598 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845d591 expref: 21 pid: 17205 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785390.696729:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789785390.696737:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84601880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:3662:x1876725549162752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789785390.696748:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785390.696754:0:17197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafb5d54c00/0x2f18ee3fd845d598 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845d591 expref: 21 pid: 17205 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.696764:0:17197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafb5d54c00/0x2f18ee3fd845d598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845d591 expref: 21 pid: 17205 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.696781:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafb5d54c00/0x2f18ee3fd845d598 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845d591 expref: 21 pid: 17205 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.696794:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785390.696834:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84601880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad642144-cf43-4df2-a5e5-a426cdb5453e+20:3662:x1876725549162752:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785390.696840:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789785390.696869:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad642144-cf43-4df2-a5e5-a426cdb5453e:3662:1876725549162752:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789785390.701011:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785390.701016:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785390.701019:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785390.701915:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9daf814bb000/0x2f18ee3fd845d583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845d58a expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.701930:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bb000 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:1.0:1789785390.701934:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9daf814bb000/0x2f18ee3fd845d583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845d58a expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.701945:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9daf814bb000/0x2f18ee3fd845d583 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845d58a expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789785390.701952:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9daf814bb000/0x2f18ee3fd845d583 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845d58a expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785390.701959:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789785390.702018:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9daf814bb000/0x2f18ee3fd845d583 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d58a expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.702026:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789785390.702051:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9daf814bb000/0x2f18ee3fd845d583 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d58a expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.702058:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9daf814bb000/0x2f18ee3fd845d583 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d58a expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.702076:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785390.702078:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785390.702080:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785390.702103:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad642144-cf43-4df2-a5e5-a426cdb5453e:3659:1876725549162880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789785390.702170:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785390.702233:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549162880 00000100:00100000:1.0:1789785390.703925:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549162880 00010000:00010000:1.0:1789785390.703966:0:17198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafc1a65c00/0x2f18ee3fd845d58a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845d583 expref: 20 pid: 17205 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785390.705089:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789785390.705102:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad642144-cf43-4df2-a5e5-a426cdb5453e+20:3659:x1876725549162880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789785390.705116:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785390.705122:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafc1a65c00/0x2f18ee3fd845d58a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845d583 expref: 20 pid: 17205 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.705133:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafc1a65c00/0x2f18ee3fd845d58a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845d583 expref: 20 pid: 17205 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.705151:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1a65c00/0x2f18ee3fd845d58a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845d583 expref: 20 pid: 17205 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.705165:0:17198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dafc1a65400/0x2f18ee3fd845d640 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.705173:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1a65400/0x2f18ee3fd845d640 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789785390.705189:0:17198:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.018193576s 00010000:00010000:1.0:1789785390.705194:0:17198:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dafc1a65400/0x2f18ee3fd845d640 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.705200:0:17198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dafc1a65400/0x2f18ee3fd845d640 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.705207:0:17198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dafc1a65400/0x2f18ee3fd845d640 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.705223:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dafc1a65400/0x2f18ee3fd845d640 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.705230:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65400 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785390.705234:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dafc1a65400/0x2f18ee3fd845d640 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.705241:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dafc1a65400/0x2f18ee3fd845d640 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.706164:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dafc1a65400/0x2f18ee3fd845d640 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785390.706176:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785390.706257:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad642144-cf43-4df2-a5e5-a426cdb5453e+19:3659:x1876725549162880:12345-0@lo:103:ldlm_bl.0 Request processed in 1146us (4073us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785390.706265:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789785390.706360:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad642144-cf43-4df2-a5e5-a426cdb5453e:3659:1876725549162880:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789785390.707081:0:17227:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dafc1a65400/0x2f18ee3fd845d640 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785390.707092:0:17227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dafc1a65400/0x2f18ee3fd845d640 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785390.707100:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafc1a65400/0x2f18ee3fd845d640 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1789785390.710045:0:18713:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789785390.721763:0:18713:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789785390.721772:0:18713:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789785390.721806:0:18713:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789785390.721962:0:18713:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.146@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789785390.721987:0:18713:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789785390.722003:0:18713:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1789785390.725186:0:18713:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789785390.725591:0:18713:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789785390.787631:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789785391.106971:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1789785391.342732:0:18794:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789785391.342898:0:18794:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789785391.813046:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789785392.003490:0:17209:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789785392.003497:0:17209:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9daf89062000 from 9 10000000:01000000:2.0:1789785392.003501:0:17209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789785392.004074:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55000/0x2f18ee3fd845d647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785392.004086:0:17209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55000/0x2f18ee3fd845d647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785392.004097:0:17209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55000/0x2f18ee3fd845d647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785392.004123:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549163008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789785392.005511:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785392.005559:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf982a89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785392.006083:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549163008 00000100:00100000:3.0:1789785392.006091:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549163008 00000100:00100000:3.0:1789785392.006145:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789785392.006154:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+19:17209:x1876725549163008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789785392.006235:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785392.006254:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9daf814ba400/0x2f18ee3fd845d64e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d647 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785392.006278:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9daf814ba400/0x2f18ee3fd845d64e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d647 expref: 20 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785392.006289:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9daf814ba400/0x2f18ee3fd845d64e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d647 expref: 20 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785392.006298:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814ba400, rc 0) 00000100:00100000:3.0:1789785392.006366:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+20:17209:x1876725549163008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 214us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785392.006374:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789785392.006762:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549163008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789785392.006782:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55000/0x2f18ee3fd845d647 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d64e expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785392.006794:0:17209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55000/0x2f18ee3fd845d647 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d64e expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785392.006877:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84602680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549163136:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789785392.006919:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785392.006960:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8280a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789785392.006991:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549163136 00000100:00100000:2.0:1789785392.006997:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549163136 00000100:00100000:2.0:1789785392.007040:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789785392.007048:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+20:17209:x1876725549163136:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789785392.007061:0:17206:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789785392.007075:0:17206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789785392.007078:0:17206:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1789785392.007154:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+20:17209:x1876725549163136:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785392.007161:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789785392.011933:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84602680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549163136:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789785392.012020:0:17209:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789785392.012031:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55000/0x2f18ee3fd845d647 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d64e expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785392.012042:0:17209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55000/0x2f18ee3fd845d647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d64e expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785392.012052:0:17209:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789785392.012055:0:17209:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dafb11eb000 from 9 10000000:01000000:1.0:1789785392.012057:0:17209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789785392.012088:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65c00/0x2f18ee3fd845d655 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785392.012096:0:17209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65c00/0x2f18ee3fd845d655 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785392.012105:0:17209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65c00/0x2f18ee3fd845d655 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785392.012124:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84602680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549163264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789785392.012261:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785392.012447:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549163264 00000100:00100000:0.0:1789785392.012454:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549163264 00000100:00100000:0.0:1789785392.012507:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789785392.012517:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+20:17209:x1876725549163264:12345-0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789785392.012528:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8280a540 going to sleep for 11 seconds 00010000:00010000:0.0:1789785392.012530:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785392.012544:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845d65c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d655 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785392.012567:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845d65c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d655 expref: 21 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785392.012578:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845d65c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d655 expref: 21 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785392.012587:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dae81eadc00, rc 0) 00000100:00100000:0.0:1789785392.012636:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:17209:x1876725549163264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785392.012642:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789785392.012872:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84602680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549163264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789785392.012893:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65c00/0x2f18ee3fd845d655 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d65c expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785392.012903:0:17209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65c00/0x2f18ee3fd845d655 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d65c expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785392.012947:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84602680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549163392:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789785392.012980:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785392.013108:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8280a540 going to sleep for 11 seconds 00000100:00100000:0.0:1789785392.013156:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549163392 00000100:00100000:0.0:1789785392.013161:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549163392 00000100:00100000:0.0:1789785392.013225:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789785392.013233:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:17209:x1876725549163392:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789785392.013254:0:17206:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789785392.013267:0:17206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789785392.013270:0:17206:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1789785392.013577:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:17209:x1876725549163392:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 344us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785392.013583:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789785392.013650:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84602680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549163392:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789785392.013709:0:17209:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789785392.013716:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65c00/0x2f18ee3fd845d655 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d65c expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785392.013724:0:17209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65c00/0x2f18ee3fd845d655 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d65c expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785392.838317:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785393.860025:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785394.891737:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785395.010512:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789785395.010579:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549163520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789785395.010632:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549163648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789785395.010702:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785395.010751:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549163648 00000100:00100000:1.0:1789785395.010760:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549163648 00000100:00100000:3.0:1789785395.010795:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785395.010879:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549163520 00000100:00100000:1.0:1789785395.010883:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549163520 00000100:00100000:1.0:1789785395.010909:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789785395.010919:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549163648:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789785395.010928:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789785395.010938:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549163520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789785395.010953:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000004:00000024:3.0:1789785395.010959:0:17216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789785395.011020:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549163520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785395.011027:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549163648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785395.011036:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789785395.011091:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549163648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789785395.011154:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789785395.011185:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549163520:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789785395.919598:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789785395.971005:0:17971:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1789785396.036425:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789785396.036432:0:15987:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789785396.036435:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789785396.036438:0:15987:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789785396.036454:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789785396.036457:0:15987:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789785396.036460:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789785396.036463:0:15987:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789785396.036502:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad642144-cf43-4df2-a5e5-a426cdb5453e:3662:1876725549163776:0@lo:400:kworker.0 00000100:00100000:1.0:1789785396.036602:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785396.036660:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725549164288:0@lo:400:kworker.0 00000100:00100000:1.0:1789785396.036692:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785396.043631:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876725549164032:0@lo:400:kworker.0 00000100:00100000:2.0:1789785396.043722:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549163904:0@lo:400:kworker.0 00000100:00100000:2.0:1789785396.043757:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785396.043812:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549164416:0@lo:400:kworker.0 00000100:00100000:2.0:1789785396.043859:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549164160:0@lo:400:kworker.0 00000100:00100000:2.0:1789785396.043886:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785396.046021:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549163904 00000100:00100000:1.0:1789785396.046033:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549163904 00000100:00100000:1.0:1789785396.046093:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549164160 00000100:00100000:1.0:1789785396.046097:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549164160 00000100:00100000:1.0:1789785396.046117:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789785396.046127:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549163904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785396.046202:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549163904:12345-0@lo:400:kworker.0 Request processed in 75us (2444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785396.046209:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789785396.046227:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789785396.046233:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549164160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785396.046293:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549164160:12345-0@lo:400:kworker.0 Request processed in 60us (2406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785396.046299:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789785396.046330:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549163776 00000100:00100000:1.0:1789785396.046334:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549163776 00000100:00100000:1.0:1789785396.046372:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789785396.046377:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:3662:x1876725549163776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785396.046406:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:3662:x1876725549163776:12345-0@lo:400:kworker.0 Request processed in 29us (9805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785396.046412:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789785396.047421:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549164160:0@lo:400:kworker.0 00000100:00100000:2.0:1789785396.047457:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785396.050712:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549164288 00000100:00100000:0.0:1789785396.050728:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549164288 00000100:00100000:0.0:1789785396.050818:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789785396.050829:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725549164288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785396.051666:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad642144-cf43-4df2-a5e5-a426cdb5453e:3662:1876725549163776:0@lo:400:kworker.0 00000100:00100000:2.0:1789785396.051978:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549164544:0@lo:400:kworker.0 00000100:00100000:2.0:1789785396.052048:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785396.052076:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785396.052101:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549163904:0@lo:400:kworker.0 00000100:00100000:1.0:1789785396.052191:0:17211:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789785396.052199:0:17211:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789785396.052217:0:17213:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789785396.052223:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549164032 00000100:00100000:1.0:1789785396.052227:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549164032 00000100:00100000:1.0:1789785396.052256:0:17213:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789785396.052260:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549164544 00000100:00100000:1.0:1789785396.052262:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549164544 00000100:00100000:1.0:1789785396.052288:0:17213:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789785396.052292:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549164416 00000100:00100000:1.0:1789785396.052294:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549164416 00000100:00100000:1.0:1789785396.052305:0:17213:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789785396.052311:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789785396.052318:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876725549164032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785396.052392:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876725549164032:12345-0@lo:400:kworker.0 Request processed in 74us (4934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785396.052399:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789785396.052426:0:17213:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789785396.052431:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789785396.052437:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1876725549164544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785396.052470:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1876725549164544:12345-0@lo:400:kworker.0 Request processed in 28us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785396.052475:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789785396.052484:0:17213:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789785396.052488:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789785396.052494:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549164416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785396.052524:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549164416:12345-0@lo:400:kworker.0 Request processed in 30us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785396.052529:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1789785396.052557:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae84600700 x1876725549164416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785396.052568:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549164416:0@lo:400:kworker.0 00010000:00080000:1.0:1789785396.052591:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae84603b80 x1876725549164032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785396.052600:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876725549164032:0@lo:400:kworker.0 00010000:00080000:1.0:1789785396.052610:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae84600380 x1876725549164544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785396.052617:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549164544:0@lo:400:kworker.0 00000100:00100000:1.0:1789785396.056314:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725549164288:12345-0@lo:400:kworker.0 Request processed in 5482us (19615us total) trans 0 rc 0/0 00010000:00080000:0.0:1789785396.056494:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae84601f80 x1876725549164288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785396.056510:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725549164288:0@lo:400:kworker.0 00000100:00100000:1.0:1789785396.056783:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789785396.057155:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789785396.057162:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:3.0:1789785396.720753:0:19084:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789785396.932057:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789785397.594155:0:19136:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789785397.594477:0:19136:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789785397.955609:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789785398.143835:0:19187:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789785398.144040:0:19187:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789785398.982544:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785399.877800:0:3658:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789785384/real 1789785384] req@ffff9dafb113d500 x1876725549158528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789785399 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785399.877844:0:3658:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dafb113d500 x1876725549158528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789785399 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785399.877857:0:3658:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789785384/real 1789785384] req@ffff9dae84603800 x1876725549158656/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789785399 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785399.877869:0:3658:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dae84603800 x1876725549158656/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789785399 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789785399.877893:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dafbf3c0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789785399.877910:0:3658:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789785399.877914:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549158528:0@lo:8:kworker.0 00000100:00080000:1.0:1789785399.877920:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9daf862fe800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789785399.877925:0:3658:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789785399.877928:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549158656:0@lo:8:kworker.0 00000100:00080000:2.0:1789785399.878503:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789785399.878508:0:15987:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789785399.878511:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789785399.878514:0:15987:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789785399.878550:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789785399.878554:0:15987:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789785399.878558:0:15987:0:(import.c:65:import_set_state_nolock()) ffff9dafbf3c0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789785399.878564:0:15987:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 493 00000100:00080000:2.0:1789785399.878571:0:15987:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789785399.878579:0:15987:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9dafbf3c0000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:2.0:1789785399.878605:0:15987:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9daf82c83480 x1876725549165184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789785399.878625:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789785399.878628:0:15987:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789785399.878630:0:15987:0:(import.c:65:import_set_state_nolock()) ffff9daf862fe800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789785399.878633:0:15987:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 493 00000100:00080000:2.0:1789785399.878636:0:15987:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789785399.878639:0:15987:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9daf862fe800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:2.0:1789785399.878651:0:15987:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9daf82c80380 x1876725549165312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789785399.878804:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad642144-cf43-4df2-a5e5-a426cdb5453e:3661:1876725549164672:0@lo:400:kworker.0 00000100:00100000:1.0:1789785399.878893:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785399.878938:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549165440:0@lo:400:kworker.0 00000100:00100000:1.0:1789785399.878966:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785399.878991:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789785399.878996:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549164800:0@lo:400:kworker.0 00000100:00100000:1.0:1789785399.879035:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785399.879054:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1876725549165568:0@lo:400:kworker.0 00000100:00100000:1.0:1789785399.879100:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785399.879131:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549164928:0@lo:400:kworker.0 00000100:00100000:1.0:1789785399.879156:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785399.879173:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549165696:0@lo:400:kworker.0 00000100:00100000:1.0:1789785399.879194:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785399.879210:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789785399.879215:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549165056:0@lo:400:kworker.0 00000100:00100000:1.0:1789785399.879234:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785399.879266:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549165440 00000100:00100000:1.0:1789785399.879276:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549165440 00000100:00100000:1.0:1789785399.879317:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549165568 00000100:00100000:1.0:1789785399.879320:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549165568 00000100:00100000:1.0:1789785399.879366:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549164928 00000100:00100000:1.0:1789785399.879369:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549164928 00000100:00100000:1.0:1789785399.879380:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549165696 00000100:00100000:1.0:1789785399.879382:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549165696 00000100:00100000:1.0:1789785399.879401:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789785399.879411:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549165440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785399.879470:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549165440:12345-0@lo:400:kworker.0 Request processed in 60us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785399.879478:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789785399.879498:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789785399.879504:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1876725549165568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785399.879529:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1876725549165568:12345-0@lo:400:kworker.0 Request processed in 25us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785399.879534:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789785399.879545:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789785399.879559:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549164928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785399.879592:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549164928:12345-0@lo:400:kworker.0 Request processed in 34us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785399.879599:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789785399.879621:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789785399.879628:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549165696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785399.879657:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549165696:12345-0@lo:400:kworker.0 Request processed in 30us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785399.879663:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789785399.879682:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549164800 00000100:00100000:1.0:1789785399.879685:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549164800 00000100:00100000:1.0:1789785399.879708:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549165056 00000100:00100000:1.0:1789785399.879710:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549165056 00000100:00100000:1.0:1789785399.879723:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789785399.879728:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549164800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785399.879761:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549164800:12345-0@lo:400:kworker.0 Request processed in 32us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785399.879768:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789785399.879778:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789785399.879783:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549165056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785399.879805:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549165056:12345-0@lo:400:kworker.0 Request processed in 22us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785399.879811:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789785399.879864:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549165056:0@lo:400:kworker.0 00010000:00080000:1.0:1789785399.879875:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9daf82c80a80 x1876725549164928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785399.879898:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549164928:0@lo:400:kworker.0 00010000:00080000:1.0:1789785399.879908:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9daf82c83800 x1876725549165696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785399.879916:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549165696:0@lo:400:kworker.0 00000100:00100000:1.0:1789785399.879949:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549165184:0@lo:8:kworker.0 00000100:00100000:1.0:1789785399.879977:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785399.880001:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549165312:0@lo:8:kworker.0 00000100:00100000:1.0:1789785399.880041:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785399.880082:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549165184 00000100:00100000:1.0:1789785399.880086:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549165184 00000100:00100000:1.0:1789785399.880103:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549165312 00000100:00100000:1.0:1789785399.880106:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549165312 00000100:00100000:1.0:1789785399.880115:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789785399.880121:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84603480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3658:x1876725549165184:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789785399.880152:0:18717:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 508 last 0 00000020:00000080:1.0:1789785399.880185:0:18717:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f18ee3fd845d663 00002000:00100000:1.0:1789785399.880202:0:18717:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9dae81f96800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396e ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1789785399.880207:0:18717:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1789785399.880211:0:18717:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789785399.880452:0:18717:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1789785399.880480:0:18717:0:(import.c:65:import_set_state_nolock()) ffff9dae81f96000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789785399.880524:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84603480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3658:x1876725549165184:12345-0@lo:8:kworker.0 Request processed in 401us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785399.880530:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789785399.880550:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789785399.880554:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3658:x1876725549165312:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789785399.880567:0:18717:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1789785399.881480:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789785399.881488:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789785399.881515:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549164672 00000100:00100000:2.0:1789785399.881524:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549164672 00000100:00100000:2.0:1789785399.881575:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789785399.881585:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:3661:x1876725549164672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785399.881659:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:3661:x1876725549164672:12345-0@lo:400:kworker.0 Request processed in 76us (2767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785399.881667:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:2.0:1789785399.882152:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9daf82c83480 x1876725549165184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789785419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785399.882164:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789785399.882176:0:3658:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789785399.882185:0:3658:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789785399.882192:0:3658:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789785399.882195:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dafbf3c0000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789785399.882221:0:3658:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789785399.882227:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549165184:0@lo:8:kworker.0 00000100:00100000:2.0:1789785399.882275:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549164800:0@lo:400:kworker.0 00010000:00080000:2.0:1789785399.882289:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9daf82c82300 x1876725549165568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785399.882299:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1876725549165568:0@lo:400:kworker.0 00000100:00100000:2.0:1789785399.882308:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad642144-cf43-4df2-a5e5-a426cdb5453e:3661:1876725549164672:0@lo:400:kworker.0 00010000:00080000:2.0:1789785399.882321:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9daf82c81880 x1876725549165440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785399.882330:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549165440:0@lo:400:kworker.0 00000004:00080000:3.0:1789785399.883737:0:17953:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789785399.883773:0:17953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84605c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17953:1876725549165952:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1789785399.883846:0:17953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785399.883882:0:17953:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8513f240 going to sleep for 11 seconds 00000004:00080000:3.0:1789785399.883906:0:17952:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789785399.885120:0:17952:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 508138779071ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789785399.885136:0:17952:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1789785399.885388:0:18718:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789785399.885397:0:18718:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789785399.885415:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789785399.885438:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549165824:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789785399.885502:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785399.886908:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549165824 00000100:00100000:3.0:1789785399.886925:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549165824 00000100:00100000:3.0:1789785399.886995:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789785399.887007:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3659:x1876725549165824:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789785399.887404:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789785399.887427:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549165952 00000100:00100000:0.0:1789785399.887432:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549165952 00002000:00000024:3.0:1789785399.888099:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789785399.888204:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3659:x1876725549165824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1197us (2699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785399.888225:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789785399.888287:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae84606d80 x1876725549165824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785399.888313:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549165824:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789785399.888394:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789785399.888404:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17953:x1876725549165952:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1789785399.892254:0:17944:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:3.0:1789785399.897147:0:18720:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1789785399.897165:0:18720:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1789785399.897464:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17953:x1876725549165952:12345-0@lo:7:osp-pre-0-1.0 Request processed in 9053us (13609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785399.897478:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789785399.904830:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3658:x1876725549165312:12345-0@lo:8:kworker.0 Request processed in 24265us (24779us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789785399.904850:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789785399.905187:0:17953:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae84605c00 x1876725549165952/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789785415 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785399.905207:0:17953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84605c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17953:1876725549165952:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1789785399.905225:0:17953:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789785399.905285:0:17953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf452d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17953:1876725549166080:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789785399.905526:0:17953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785399.905606:0:17953:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8398e480 going to sleep for 11 seconds 00000100:00100000:1.0:1789785399.905789:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549166080 00000100:00100000:1.0:1789785399.905797:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549166080 00000100:00100000:1.0:1789785399.905893:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789785399.905904:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf450700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17953:x1876725549166080:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789785399.905946:0:18718:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1789785399.906010:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf450700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17953:x1876725549166080:12345-0@lo:5:osp-pre-0-1.0 Request processed in 96us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785399.906018:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789785399.906266:0:17953:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafbf452d80 x1876725549166080/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789785415 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785399.906279:0:17953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf452d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17953:1876725549166080:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789785399.906290:0:17953:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1789785399.906514:0:17953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84601880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17953:1876725549166208:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789785399.906762:0:17953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785399.906829:0:17953:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf83f30b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789785399.906867:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549166208 00000100:00100000:0.0:1789785399.906873:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549166208 00000100:00100000:0.0:1789785399.906993:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789785399.907060:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84600a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17953:x1876725549166208:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789785399.907165:0:18720:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00080000:3.0:1789785399.910310:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9daf862fe800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789785399.910322:0:3658:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789785399.910327:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549165312:0@lo:8:kworker.0 00000001:00080000:3.0:1789785399.940443:0:18714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1789785399.940473:0:18714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789785399.940751:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84600a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17953:x1876725549166208:12345-0@lo:5:osp-pre-0-1.0 Request processed in 33687us (33982us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789785399.940765:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789785399.940878:0:17953:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dae84601880 x1876725549166208/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789785415 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785399.940892:0:17953:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789785399.940901:0:17953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84601880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17953:1876725549166208:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789785399.940920:0:17953:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1789785399.940992:0:17953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c81880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17953:1876725549166336:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789785399.941452:0:17953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785399.941487:0:17953:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf982a89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785399.941878:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549166336 00000100:00100000:3.0:1789785399.941887:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549166336 00000100:00100000:3.0:1789785399.941947:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789785399.941960:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17953:x1876725549166336:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789785399.942043:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17953:x1876725549166336:12345-0@lo:900:osp-pre-0-1.0 Request processed in 86us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785399.942051:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789785399.942123:0:17953:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9daf82c81880 x1876725549166336/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789785415 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785399.942138:0:17953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c81880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17953:1876725549166336:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1789785400.002660:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785400.130645:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549166464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789785400.130735:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785400.131141:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549166464 00000100:00100000:0.0:1789785400.131151:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549166464 00000100:00100000:0.0:1789785400.131205:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789785400.131216:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549166464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789785400.131257:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789785400.131318:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549166464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785400.131326:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789785400.131396:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549166464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789785400.132322:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789785400.132462:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549166592:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789785400.132505:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785400.133015:0:18200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549166592 00000100:00100000:2.0:1789785400.133023:0:18200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549166592 00000100:00100000:2.0:1789785400.133135:0:18200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789785400.133146:0:18200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549166592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789785400.133194:0:18200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789785400.133310:0:18200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549166592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 165us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785400.133319:0:18200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789785400.133496:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549166592:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789785401.028473:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789785401.347090:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789785402.050554:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785403.074820:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785404.100197:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789785404.849402:0:19532:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789785404.849407:0:19532:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789785404.849408:0:19532:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789785404.849585:0:19532:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9dae8353e800 00000020:01000004:2.0:1789785404.849601:0:19532:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789785404.849617:0:19532:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789785404.849634:0:19532:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9dafb11dcd28) 00000020:00000080:2.0:1789785404.849654:0:19532:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789785404.915015:0:19532:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789785404.916449:0:19532:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789785404.916793:0:19532:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789785404.917036:0:19532:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789785404.917436:0:19532:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789785404.917696:0:19532:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789785404.917985:0:19532:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:1.0:1789785404.920734:0:19532:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789785404.920931:0:19532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789785404.920945:0:19532:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789785404.920957:0:19532:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2f18ee3fd845d671 00000020:01000004:1.0:1789785404.920963:0:19532:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789785404.920985:0:19532:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.146@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789785404.920989:0:19532:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.146@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789785404.920995:0:19532:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789785404.921021:0:19532:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1789785404.921025:0:19532:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.146@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789785404.944282:0:19532:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.146@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789785404.944488:0:19532:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.146@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1789785404.944493:0:19532:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789785404.944495:0:19532:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789785404.944496:0:19532:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789785404.944498:0:19532:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789785404.944499:0:19532:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789785404.944505:0:19532:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789785404.944506:0:19532:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789785404.944507:0:19532:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789785404.944509:0:19532:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789785404.944512:0:19532:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1789785404.944514:0:19532:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789785404.944515:0:19532:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789785404.944516:0:19532:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789785404.944517:0:19532:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789785404.944518:0:19532:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789785404.944519:0:19532:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789785404.944520:0:19532:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789785404.944521:0:19532:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789785404.944522:0:19532:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789785404.944545:0:19532:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789785404.944783:0:19532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf450380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549166720:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789785404.944860:0:19532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785404.944908:0:19532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84d82840 going to sleep for 11 seconds 00000100:00100000:1.0:1789785404.946616:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549166720 00000100:00100000:1.0:1789785404.946628:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549166720 00000100:00100000:1.0:1789785404.946692:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789785404.947069:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:19532:x1876725549166720:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789785404.947107:0:17205:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789785404.947110:0:17205:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789785404.947114:0:17205:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789785404.951219:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:19532:x1876725549166720:12345-0@lo:253:mount.lustre.0 Request processed in 4510us (6351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785404.951232:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789785404.951698:0:19532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf450380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549166720:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789785404.951724:0:19532:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789785404.951728:0:19532:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789785404.951729:0:19532:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789785404.951731:0:19532:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789785404.951732:0:19532:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789785404.951733:0:19532:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789785404.951734:0:19532:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789785404.951735:0:19532:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789785404.951737:0:19532:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789785404.951739:0:19532:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789785404.951762:0:19532:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dae8353e800 from lustre-OST0001 10000000:01000000:0.0:1789785404.951789:0:19532:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789785404.951792:0:19532:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789785404.951800:0:19532:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dae837219b8 local copy 00010000:00010000:0.0:1789785404.951810:0:19532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54000/0x2f18ee3fd845d38b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d392 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785404.951938:0:19532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf450380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549166848:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789785404.951975:0:19532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785404.952004:0:19532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84d820c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789785404.952114:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549166848 00000100:00100000:2.0:1789785404.952121:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549166848 00000100:00100000:2.0:1789785404.952165:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789785404.952174:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:19532:x1876725549166848:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789785404.952241:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:19532:x1876725549166848:12345-0@lo:501:mount.lustre.0 Request processed in 68us (265us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789785404.952248:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789785404.952532:0:19532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf450380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549166848:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789785404.952567:0:19532:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.146@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789785404.952619:0:19532:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.146@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789785404.952626:0:19532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54000/0x2f18ee3fd845d38b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d392 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785404.952635:0:19532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54000/0x2f18ee3fd845d38b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d392 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785404.952662:0:19532:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dae8353e800 10000000:01000000:0.0:1789785404.952667:0:19532:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789785404.952672:0:19532:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789785404.952674:0:19532:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789785404.952679:0:19532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789785404.952681:0:19532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789785404.954233:0:19532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eada00/0x2f18ee3fd845d678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785404.954248:0:19532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dae81eada00/0x2f18ee3fd845d678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785404.954258:0:19532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dae81eada00/0x2f18ee3fd845d678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785404.954308:0:19532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf450380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549166976:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789785404.954385:0:19532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785404.954806:0:19532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84d820c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789785404.954892:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549166976 00000100:00100000:1.0:1789785404.954899:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549166976 00000100:00100000:1.0:1789785404.954940:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789785404.954957:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:19532:x1876725549166976:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789785404.954971:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785404.954985:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1a64a00/0x2f18ee3fd845d67f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d678 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785404.955008:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1a64a00/0x2f18ee3fd845d67f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d678 expref: 22 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785404.955017:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1a64a00/0x2f18ee3fd845d67f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d678 expref: 22 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785404.955025:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1a64a00, rc 0) 00000100:00100000:1.0:1789785404.955076:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+22:19532:x1876725549166976:12345-0@lo:101:mount.lustre.0 Request processed in 120us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785404.955082:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789785404.955883:0:19532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf450380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549166976:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789785404.955901:0:19532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dae81eada00/0x2f18ee3fd845d678 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d67f expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785404.955911:0:19532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dae81eada00/0x2f18ee3fd845d678 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d67f expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789785404.957907:0:19532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789785404.959130:0:19532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789785404.965904:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789785404.965967:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789785404.965984:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789785404.966011:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789785404.966024:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789785404.966034:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789785404.966058:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789785404.966063:0:19532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789785404.966180:0:19532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf450380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549167104:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789785404.966259:0:19532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785404.966925:0:19532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84d82540 going to sleep for 11 seconds 00000100:00100000:1.0:1789785404.970508:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549167104 00000100:00100000:1.0:1789785404.970523:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549167104 00000100:00100000:2.0:1789785404.972081:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789785404.972093:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+22:19532:x1876725549167104:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789785404.972288:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+22:19532:x1876725549167104:12345-0@lo:501:mount.lustre.0 Request processed in 196us (6028us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785404.972461:0:19532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf450380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549167104:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789785404.972509:0:19532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf450380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549167232:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789785404.972722:0:19532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785404.973009:0:19532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84d82540 going to sleep for 11 seconds 00000100:00100000:2.0:1789785404.974429:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789785404.974479:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549167232 00000100:00100000:2.0:1789785404.974486:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549167232 00000100:00100000:3.0:1789785404.975991:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789785404.976011:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+22:19532:x1876725549167232:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789785404.978857:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+22:19532:x1876725549167232:12345-0@lo:503:mount.lustre.0 Request processed in 2847us (6127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785404.978873:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789785404.978999:0:19532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf450380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549167232:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789785404.979628:0:19532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789785404.979729:0:19532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf450380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549167360:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789785404.979791:0:19532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785404.980111:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549167360 00000100:00100000:2.0:1789785404.980119:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549167360 00000100:00100000:0.0:1789785404.980138:0:19532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84d82540 going to sleep for 11 seconds 00000100:00100000:2.0:1789785404.980155:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789785404.980165:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+22:19532:x1876725549167360:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789785404.981750:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+22:19532:x1876725549167360:12345-0@lo:502:mount.lustre.0 Request processed in 1581us (1954us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785404.981847:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789785404.982250:0:19532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf450380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549167360:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789785404.982859:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789785404.982883:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789785404.982890:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789785404.982897:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789785404.982905:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789785404.982911:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789785404.982918:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789785404.982924:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789785404.982931:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1789785404.982967:0:19532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf450380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549167488:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789785404.983012:0:19532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785404.983048:0:19532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84d82540 going to sleep for 11 seconds 00000100:00100000:3.0:1789785404.984058:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549167488 00000100:00100000:3.0:1789785404.984075:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549167488 00000100:00100000:3.0:1789785404.984138:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789785404.984149:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+22:19532:x1876725549167488:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789785404.984291:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+22:19532:x1876725549167488:12345-0@lo:502:mount.lustre.0 Request processed in 142us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785404.984300:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789785404.984538:0:19532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf450380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549167488:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789785404.984828:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789785404.984841:0:19532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1789785404.986143:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789785404.986155:0:19536:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1789785404.986162:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785404.986165:0:19536:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789785404.986172:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789785404.986190:0:19536:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9dae83573370) 00000020:00000080:1.0:1789785404.986219:0:19536:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789785404.986227:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789785404.986333:0:19536:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dae8353e800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789785404.986362:0:19536:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789785404.986383:0:19536:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2f18ee3fd845d68d 00010000:00010000:2.0:1789785404.996334:0:19536:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1789785404.997719:0:19536:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00000100:00100000:2.0:1789785404.998136:0:3658:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789785384/real 1789785384] req@ffff9dafb113f100 x1876725549158016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789785404 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785404.998164:0:3658:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dafb113f100 x1876725549158016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789785404 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785404.998174:0:3658:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789785384/real 1789785384] req@ffff9dafb113ce00 x1876725549158144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789785404 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785404.998185:0:3658:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dafb113ce00 x1876725549158144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789785404 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789785404.998203:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dae84462800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789785404.998230:0:3658:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789785404.998234:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549158016:0@lo:8:kworker.0 00000100:00080000:2.0:1789785404.998240:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dafa64af800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789785404.998246:0:3658:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789785404.998249:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549158144:0@lo:8:kworker.0 00000100:00080000:0.0:1789785404.998384:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789785404.998388:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789785404.998391:0:37:0:(import.c:65:import_set_state_nolock()) ffff9dae84462800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789785404.998396:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 493 00000100:00080000:0.0:1789785404.998411:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789785404.998418:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dae84462800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:0.0:1789785404.998438:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafbf450000 x1876725549167744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789785404.998462:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789785404.998465:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789785404.998467:0:37:0:(import.c:65:import_set_state_nolock()) ffff9dafa64af800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789785404.998471:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 493 00000100:00080000:0.0:1789785404.998473:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789785404.998477:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dafa64af800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:0.0:1789785404.998489:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafbf453480 x1876725549167872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789785404.998525:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789785404.998528:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789785404.998530:0:37:0:(import.c:65:import_set_state_nolock()) ffff9daf862fe800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789785404.998533:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 508 00000100:00080000:0.0:1789785404.998535:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789785404.998538:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9daf862fe800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:0.0:1789785404.998549:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafbf451180 x1876725549168384/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789785404.998613:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549168256:0@lo:400:kworker.0 00000100:00100000:0.0:1789785404.998678:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785404.998922:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789785404.998930:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf451c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549168128:0@lo:400:kworker.0 00000100:00100000:0.0:1789785404.998958:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785404.998978:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1876725549168768:0@lo:400:kworker.0 00000100:00100000:0.0:1789785404.999000:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785404.999051:0:19259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549168256 00000100:00100000:0.0:1789785404.999059:0:19259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549168256 00000100:00100000:0.0:1789785404.999109:0:19259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789785404.999118:0:19259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549168256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785404.999165:0:19259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549168256:12345-0@lo:400:kworker.0 Request processed in 48us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785404.999172:0:19259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789785404.999195:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549168128 00000100:00100000:0.0:1789785404.999199:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549168128 00000100:00100000:0.0:1789785404.999224:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789785404.999231:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549168128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785404.999264:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549168128:12345-0@lo:400:kworker.0 Request processed in 34us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785404.999270:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1789785404.999284:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789785404.999328:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf451c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549168128:0@lo:400:kworker.0 00010000:00080000:0.0:1789785404.999358:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafbf452a00 x1876725549168256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789785420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785404.999368:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549168256:0@lo:400:kworker.0 00000100:00100000:1.0:1789785404.999474:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876725549168000:0@lo:400:kworker.0 00000100:00100000:1.0:1789785404.999510:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785404.999528:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1876725549168640:0@lo:400:kworker.0 00000100:00100000:1.0:1789785404.999547:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785404.999587:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789785404.999594:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549167616:0@lo:400:kworker.0 00000100:00100000:1.0:1789785404.999618:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785404.999637:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1876725549168512:0@lo:400:kworker.0 00000100:00100000:1.0:1789785404.999657:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785404.999685:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549168768 00000100:00100000:1.0:1789785404.999689:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549168768 00000100:00100000:1.0:1789785404.999730:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549168000 00000100:00100000:1.0:1789785404.999733:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549168000 00000100:00100000:1.0:1789785404.999745:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549168640 00000100:00100000:1.0:1789785404.999747:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549168640 00000100:00100000:1.0:1789785404.999759:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549168512 00000100:00100000:1.0:1789785404.999761:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549168512 00000100:00100000:1.0:1789785404.999775:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789785404.999781:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1876725549168768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785404.999817:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1876725549168768:12345-0@lo:400:kworker.0 Request processed in 36us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785404.999822:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789785404.999835:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789785404.999841:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876725549168000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785404.999871:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876725549168000:12345-0@lo:400:kworker.0 Request processed in 31us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785404.999877:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789785404.999890:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789785404.999904:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1876725549168640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785404.999931:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1876725549168640:12345-0@lo:400:kworker.0 Request processed in 29us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785404.999937:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789785404.999950:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789785404.999955:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1876725549168512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785404.999980:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1876725549168512:12345-0@lo:400:kworker.0 Request processed in 25us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785404.999986:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789785405.000009:0:18200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549167616 00000100:00100000:1.0:1789785405.000013:0:18200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549167616 00000100:00100000:1.0:1789785405.000034:0:18200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789785405.000041:0:18200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549167616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785405.000069:0:18200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549167616:12345-0@lo:400:kworker.0 Request processed in 29us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785405.000075:0:18200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789785405.000091:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789785405.000094:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789785405.000111:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549167616:0@lo:400:kworker.0 00010000:00080000:1.0:1789785405.000119:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafbf453100 x1876725549168512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785405.000127:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1876725549168512:0@lo:400:kworker.0 00010000:00080000:1.0:1789785405.000135:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafbf451f80 x1876725549168000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785405.000142:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876725549168000:0@lo:400:kworker.0 00010000:00080000:1.0:1789785405.000159:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafbf452d80 x1876725549168640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785405.000166:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1876725549168640:0@lo:400:kworker.0 00010000:00080000:1.0:1789785405.000211:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafbf452300 x1876725549168768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785405.000218:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1876725549168768:0@lo:400:kworker.0 00000100:00100000:2.0:1789785405.000840:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549167744:0@lo:8:kworker.0 00000100:00100000:2.0:1789785405.000881:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785405.000918:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549167872:0@lo:8:kworker.0 00000100:00100000:2.0:1789785405.000939:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785405.000950:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf451180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549168384:0@lo:8:kworker.0 00000100:00100000:2.0:1789785405.000970:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785405.001671:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549167744 00000100:00100000:0.0:1789785405.001680:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549167744 00000100:00100000:0.0:1789785405.001717:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549167872 00000100:00100000:0.0:1789785405.001720:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549167872 00000100:00100000:0.0:1789785405.001729:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549168384 00000100:00100000:0.0:1789785405.001731:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549168384 00000100:00100000:0.0:1789785405.001741:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789785405.001747:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3658:x1876725549167744:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789785405.001794:0:18717:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:0.0:1789785405.001823:0:18717:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f18ee3fd845d694 00002000:00100000:0.0:1789785405.001839:0:18717:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9daf8626b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396e ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789785405.001844:0:18717:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789785405.001847:0:18717:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789785405.001921:0:18717:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789785405.001949:0:18717:0:(import.c:65:import_set_state_nolock()) ffff9daf8626f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789785405.002016:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3658:x1876725549167744:12345-0@lo:8:kworker.0 Request processed in 267us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785405.002024:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789785405.002039:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789785405.002043:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3658:x1876725549167872:12345-0@lo:8:kworker.0 00010000:02000000:0.0:1789785405.002055:0:18717:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-OST0001: Not available for connect from 0@lo (not set up) 00010000:00080000:2.0:1789785405.005648:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dafbf450000 x1876725549167744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789785430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785405.005664:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789785405.005674:0:3658:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789785405.005685:0:3658:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789785405.005691:0:3658:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789785405.005695:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dae84462800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789785405.005723:0:3658:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789785405.005729:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549167744:0@lo:8:kworker.0 00000004:00080000:2.0:1789785405.005800:0:17236:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1789785405.005821:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c83800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17236:1876725549169024:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789785405.005880:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785405.005901:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf92353f00 going to sleep for 11 seconds 00000004:00080000:2.0:1789785405.005915:0:17235:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789785405.006003:0:17235:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 513259663871ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789785405.006010:0:17235:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1789785405.006113:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789785405.006126:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549168896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789785405.006157:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785405.006219:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549168896 00000100:00100000:1.0:1789785405.006226:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549168896 00000100:00100000:1.0:1789785405.006281:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789785405.006291:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84601880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1876725549168896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789785405.006319:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789785405.006393:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84601880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1876725549168896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785405.006401:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789785405.006427:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549169024 00000100:00100000:1.0:1789785405.006431:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549169024 00000100:00100000:1.0:1789785405.006447:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789785405.006453:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3658:x1876725549168384:12345-0@lo:8:kworker.0 00010000:02000000:1.0:1789785405.006473:0:18718:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-OST0001: Not available for connect from 0@lo (not set up) 00000100:00100000:1.0:1789785405.006509:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3658:x1876725549168384:12345-0@lo:8:kworker.0 Request processed in 54us (5537us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789785405.006515:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789785405.006535:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789785405.006541:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17236:x1876725549169024:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:1.0:1789785405.006782:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789785405.006816:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9daf82c80380 x1876725549168896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785405.006833:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549168896:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789785405.006862:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9daf862fe800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789785405.006867:0:3658:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789785405.006870:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf451180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549168384:0@lo:8:kworker.0 00080000:10000000:3.0:1789785405.023085:0:19536:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00002000:00080000:2.0:1789785405.024807:0:18718:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789785405.024821:0:18718:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789785405.024829:0:18718:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000100:00100000:0.0:1789785405.030081:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3658:x1876725549167872:12345-0@lo:8:kworker.0 Request processed in 28024us (29129us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789785405.030099:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789785405.032464:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dafa64af800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789785405.032476:0:3658:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789785405.032481:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549167872:0@lo:8:kworker.0 00000020:00000080:1.0:1789785405.033240:0:19536:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789785405.033254:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785405.033261:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785405.033263:0:19536:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789785405.033266:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789785405.033270:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785405.033272:0:19536:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789785405.033275:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789785405.033277:0:19536:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789785405.033279:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785405.033282:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785405.033283:0:19536:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789785405.033285:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789785405.033288:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785405.033302:0:19536:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789785405.033307:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789785405.033369:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789785405.033374:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789785405.033375:0:19536:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789785405.033379:0:19536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1789785405.039087:0:19532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789785405.039155:0:19532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789785405.039179:0:19532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eada00/0x2f18ee3fd845d678 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d67f expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.039192:0:19532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dae81eada00/0x2f18ee3fd845d678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d67f expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785405.039201:0:19532:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dae8353e800 from 1 10000000:01000000:0.0:1789785405.039203:0:19532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789785405.039240:0:19532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d69b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.039261:0:19532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d69b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.039272:0:19532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d69b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785405.039797:0:19532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549169152:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789785405.039879:0:19532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785405.039929:0:19532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84d82540 going to sleep for 11 seconds 00000100:00100000:3.0:1789785405.041735:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549169152 00000100:00100000:3.0:1789785405.041748:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549169152 00000100:00100000:3.0:1789785405.041803:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789785405.041813:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+22:19532:x1876725549169152:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789785405.041828:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785405.041845:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9daf814baa00/0x2f18ee3fd845d6a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d69b expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.041886:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9daf814baa00/0x2f18ee3fd845d6a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d69b expref: 23 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.041902:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9daf814baa00/0x2f18ee3fd845d6a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d69b expref: 23 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.041911:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814baa00, rc 0) 00000100:00100000:3.0:1789785405.041985:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+23:19532:x1876725549169152:12345-0@lo:101:mount.lustre.0 Request processed in 173us (2105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785405.041992:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789785405.044008:0:19532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549169152:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789785405.044034:0:19532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d69b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d6a2 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.044047:0:19532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d69b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d6a2 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789785405.062047:0:19532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789785405.062411:0:19532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789785405.062678:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789785405.062717:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789785405.062738:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789785405.062743:0:19532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789785405.062824:0:19532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549169280:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789785405.062896:0:19532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785405.062953:0:19532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84d829c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785405.067499:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549169280 00000100:00100000:3.0:1789785405.067515:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549169280 00000100:00100000:3.0:1789785405.067603:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789785405.067616:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+23:19532:x1876725549169280:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789785405.067800:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+23:19532:x1876725549169280:12345-0@lo:501:mount.lustre.0 Request processed in 187us (4903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785405.067808:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000004:00080000:3.0:1789785405.067849:0:17191:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1789785405.068019:0:19532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549169280:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789785405.068068:0:19532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549169408:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789785405.068131:0:19532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785405.068158:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549169408 00000100:00100000:0.0:1789785405.068163:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549169408 00000100:00100000:0.0:1789785405.068199:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789785405.068206:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+23:19532:x1876725549169408:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789785405.068281:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+23:19532:x1876725549169408:12345-0@lo:503:mount.lustre.0 Request processed in 75us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785405.068287:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789785405.068360:0:19532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84d829c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789785405.068373:0:19532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549169408:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789785405.069055:0:19532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789785405.069125:0:19532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549169536:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789785405.069165:0:19532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785405.069272:0:19532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84d82540 going to sleep for 11 seconds 00000100:00100000:1.0:1789785405.078870:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549169536 00000100:00100000:1.0:1789785405.078902:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549169536 00000100:00100000:1.0:1789785405.078954:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789785405.078963:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+23:19532:x1876725549169536:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789785405.079138:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+23:19532:x1876725549169536:12345-0@lo:502:mount.lustre.0 Request processed in 175us (9971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785405.079146:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789785405.079423:0:19532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549169536:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789785405.079666:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789785405.079696:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789785405.079727:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789785405.079743:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789785405.079756:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789785405.079769:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789785405.079782:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789785405.079794:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1789785405.079806:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789785405.079819:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1789785405.079831:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1789785405.079874:0:19532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549169664:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789785405.079926:0:19532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785405.079962:0:19532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84d82540 going to sleep for 11 seconds 00000100:00100000:3.0:1789785405.080247:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549169664 00000100:00100000:3.0:1789785405.080253:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549169664 00000100:00100000:3.0:1789785405.080297:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789785405.080306:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+23:19532:x1876725549169664:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789785405.080429:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+23:19532:x1876725549169664:12345-0@lo:502:mount.lustre.0 Request processed in 124us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785405.080438:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789785405.080536:0:19532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549169664:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789785405.080588:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1789785405.080597:0:19532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00002000:00010000:2.0:1789785405.083988:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789785405.084002:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845d6a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.084018:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=513s v=(0 0) 00010000:00010000:2.0:1789785405.084023:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785405.084029:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845d6a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.084063:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845d6a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.084074:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845d6a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.084082:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845d6a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:0.0:1789785405.084199:0:19540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789785405.084208:0:19540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785405.084211:0:19540:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789785405.084218:0:19540:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dae8353e800 00000020:00000080:0.0:1789785405.084221:0:19540:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789785405.084229:0:19540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785405.084232:0:19540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785405.084233:0:19540:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789785405.084236:0:19540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789785405.084238:0:19540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785405.084239:0:19540:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789785405.084243:0:19540:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dae8353e800 00000020:00000080:0.0:1789785405.084244:0:19540:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789785405.084311:0:19540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00010000:00010000:2.0:1789785405.084355:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00000080:0.0:1789785405.085936:0:19540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785405.085942:0:19540:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789785405.085950:0:19540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789785405.085955:0:19540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785405.085956:0:19540:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789785405.085961:0:19540:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dae8353e800 00000020:00000080:0.0:1789785405.085963:0:19540:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789785405.086011:0:19540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785405.087544:0:19540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785405.087549:0:19540:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789785405.087557:0:19540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789785405.087562:0:19540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785405.087563:0:19540:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00010000:00010000:1.0:1789785405.094873:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789785405.094891:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845d6a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.094908:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55400 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785405.094914:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845d6a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.094928:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845d6a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.094964:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845d6a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.094973:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845d6a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.095055:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785405.095058:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785405.095060:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789785405.097985:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789785405.098001:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000005646d8/0x2f18ee3fd845d6b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.098031:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=513s v=(0 0) 00010000:00010000:3.0:1789785405.098047:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785405.098054:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000005646d8/0x2f18ee3fd845d6b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.098071:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000005646d8/0x2f18ee3fd845d6b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.098081:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000005646d8/0x2f18ee3fd845d6b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.098089:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000005646d8/0x2f18ee3fd845d6b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.098110:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789785405.098810:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789785405.098819:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000005646d8/0x2f18ee3fd845d6b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.098953:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bbc00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:2.0:1789785405.098958:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000005646d8/0x2f18ee3fd845d6b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.098967:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000005646d8/0x2f18ee3fd845d6b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.098986:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000005646d8/0x2f18ee3fd845d6b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.098994:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000005646d8/0x2f18ee3fd845d6b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.099023:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785405.099025:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785405.099026:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789785405.099177:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789785405.099184:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7a709d7/0x2f18ee3fd845d6b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.099196:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=513s v=(0 0) 00010000:00010000:3.0:1789785405.099200:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785405.099205:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7a709d7/0x2f18ee3fd845d6b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.099215:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7a709d7/0x2f18ee3fd845d6b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.099235:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7a709d7/0x2f18ee3fd845d6b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.099242:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7a709d7/0x2f18ee3fd845d6b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.099267:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789785405.099811:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789785405.099817:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bcb29bc/0x2f18ee3fd845d6be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.099826:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=513s v=(0 0) 00010000:00010000:3.0:1789785405.099830:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785405.099834:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bcb29bc/0x2f18ee3fd845d6be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.099844:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bcb29bc/0x2f18ee3fd845d6be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.099851:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bcb29bc/0x2f18ee3fd845d6be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.099857:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004bcb29bc/0x2f18ee3fd845d6be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.099886:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789785405.100111:0:18743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789785405.100117:0:18743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7a709d7/0x2f18ee3fd845d6b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.100125:0:18743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814ba200 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:2.0:1789785405.100129:0:18743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7a709d7/0x2f18ee3fd845d6b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.100138:0:18743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7a709d7/0x2f18ee3fd845d6b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.100152:0:18743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7a709d7/0x2f18ee3fd845d6b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.100159:0:18743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7a709d7/0x2f18ee3fd845d6b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.100186:0:18743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789785405.100190:0:18743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004bcb29bc/0x2f18ee3fd845d6be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.100196:0:18743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bae00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:2.0:1789785405.100207:0:18743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004bcb29bc/0x2f18ee3fd845d6be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.100215:0:18743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004bcb29bc/0x2f18ee3fd845d6be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.100225:0:18743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004bcb29bc/0x2f18ee3fd845d6be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.100232:0:18743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bcb29bc/0x2f18ee3fd845d6be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.100243:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785405.100245:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785405.100247:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789785405.104381:0:19540:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dae8353e800 00000020:00000080:0.0:1789785405.104389:0:19540:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789785405.105251:0:19540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789785405.105259:0:19540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789785405.105261:0:19540:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789785405.105266:0:19540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1789785405.105810:0:19532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789785405.105861:0:19532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789785405.105876:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785405.105885:0:19532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d69b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d6a2 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.105897:0:19532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d69b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d6a2 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785405.105952:0:19532:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789785405.105955:0:19532:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dae8353e800 10000000:01000000:2.0:1789785405.105958:0:19532:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dae8353e800 10000000:01000000:2.0:1789785405.105963:0:19532:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789785405.105968:0:19532:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dae8353e800 from 1 10000000:01000000:2.0:1789785405.105970:0:19532:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00002000:00010000:3.0:1789785405.106000:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789785405.106005:0:19532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54600/0x2f18ee3fd845d6cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.106007:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bf02b96/0x2f18ee3fd845d6c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.106014:0:19532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54600/0x2f18ee3fd845d6cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.106020:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=513s v=(0 0) 00010000:00010000:3.0:1789785405.106023:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785405.106023:0:19532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54600/0x2f18ee3fd845d6cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.106029:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bf02b96/0x2f18ee3fd845d6c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.106041:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bf02b96/0x2f18ee3fd845d6c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785405.106046:0:19532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549169792:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789785405.106049:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bf02b96/0x2f18ee3fd845d6c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.106056:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bf02b96/0x2f18ee3fd845d6c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.106082:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789785405.106113:0:19532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785405.106141:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549169792 00000100:00100000:3.0:1789785405.106147:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549169792 00000100:00100000:3.0:1789785405.106186:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789785405.106202:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+23:19532:x1876725549169792:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789785405.106216:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785405.106237:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9daf814bba00/0x2f18ee3fd845d6d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d6cc expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.106258:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9daf814bba00/0x2f18ee3fd845d6d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d6cc expref: 24 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.106268:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9daf814bba00/0x2f18ee3fd845d6d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d6cc expref: 24 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.106277:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bba00, rc 0) 00010000:00010000:0.0:1789785405.106460:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789785405.106467:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bf02b96/0x2f18ee3fd845d6c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.106475:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bb200 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:0.0:1789785405.106480:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bf02b96/0x2f18ee3fd845d6c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.106489:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bf02b96/0x2f18ee3fd845d6c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.106507:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bf02b96/0x2f18ee3fd845d6c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.106514:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bf02b96/0x2f18ee3fd845d6c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.106531:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785405.106533:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785405.106535:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785405.107748:0:19532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafb62260c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785405.110184:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:19532:x1876725549169792:12345-0@lo:101:mount.lustre.0 Request processed in 3982us (4064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785405.110197:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789785405.116480:0:19532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549169792:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789785405.116511:0:19532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54600/0x2f18ee3fd845d6cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d6d3 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.116525:0:19532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54600/0x2f18ee3fd845d6cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d6d3 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789785405.116695:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789785405.116704:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d6da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.116717:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=513s v=(0 0) 00010000:00010000:2.0:1789785405.116722:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785405.116728:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d6da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.116742:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d6da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.116765:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d6da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.116773:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d6da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.116792:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789785405.116806:0:18743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789785405.116811:0:18743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d6da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.116818:0:18743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54c00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:2.0:1789785405.116822:0:18743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d6da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.116900:0:18743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d6da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.116917:0:18743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d6da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.116924:0:18743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d6da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.116943:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785405.116951:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785405.116953:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789785405.118051:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789785405.118060:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092f7378c/0x2f18ee3fd845d6e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.118074:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=513s v=(0 0) 00010000:00010000:2.0:1789785405.118078:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785405.118084:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092f7378c/0x2f18ee3fd845d6e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.118096:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092f7378c/0x2f18ee3fd845d6e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.118106:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092f7378c/0x2f18ee3fd845d6e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.118113:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092f7378c/0x2f18ee3fd845d6e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.118316:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789785405.121385:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789785405.121404:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092f7378c/0x2f18ee3fd845d6e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.121423:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55800 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785405.121430:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092f7378c/0x2f18ee3fd845d6e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.121445:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092f7378c/0x2f18ee3fd845d6e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.121471:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092f7378c/0x2f18ee3fd845d6e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.121479:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092f7378c/0x2f18ee3fd845d6e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.121507:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785405.121509:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785405.121511:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789785405.122057:0:19532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1789785405.122584:0:19532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789785405.123069:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789785405.123097:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789785405.123111:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00010000:00010000:0.0:1789785405.123233:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789785405.123246:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789785405.123267:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789785405.123285:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789785405.123299:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789785405.123319:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789785405.123331:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789785405.123506:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789785405.123524:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789785405.123537:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789785405.123551:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789785405.123565:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789785405.123589:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789785405.123603:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789785405.123614:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789785405.123624:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789785405.123636:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789785405.123649:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789785405.123663:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789785405.123677:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789785405.123690:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789785405.123705:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789785405.123718:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1789785405.123730:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1789785405.123741:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1789785405.123751:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1789785405.123763:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1789785405.123774:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1789785405.123785:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1789785405.123797:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1789785405.123807:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1789785405.123817:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1789785405.123840:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1789785405.124003:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1789785405.124024:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1789785405.124054:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1789785405.124072:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1789785405.124094:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00002000:00010000:3.0:1789785405.124251:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789785405.124260:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456be35e/0x2f18ee3fd845d6e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.124276:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=513s v=(0 0) 00010000:00010000:3.0:1789785405.124280:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785405.124286:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000456be35e/0x2f18ee3fd845d6e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.124458:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000456be35e/0x2f18ee3fd845d6e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.124469:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456be35e/0x2f18ee3fd845d6e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.124477:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000456be35e/0x2f18ee3fd845d6e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.124503:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789785405.124512:0:18743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789785405.124518:0:18743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000456be35e/0x2f18ee3fd845d6e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.124525:0:18743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814ba600 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:3.0:1789785405.124530:0:18743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000456be35e/0x2f18ee3fd845d6e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.124539:0:18743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000456be35e/0x2f18ee3fd845d6e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789785405.124632:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1789785405.124656:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1789785405.124672:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1789785405.124685:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1789785405.124696:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1789785405.124708:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1789785405.124727:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1789785405.124737:0:19532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1789785405.125093:0:19532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549169920:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789785405.125222:0:19532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785405.125261:0:19532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8513f240 going to sleep for 11 seconds 00010000:00010000:3.0:1789785405.125664:0:18743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000456be35e/0x2f18ee3fd845d6e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.125677:0:18743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000456be35e/0x2f18ee3fd845d6e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.125698:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785405.125700:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785405.125769:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785405.126005:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549169920 00000100:00100000:1.0:1789785405.126013:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549169920 00000100:00100000:1.0:1789785405.126063:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789785405.126072:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:19532:x1876725549169920:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789785405.126207:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:19532:x1876725549169920:12345-0@lo:501:mount.lustre.0 Request processed in 134us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785405.126215:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789785405.126301:0:19532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549169920:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789785405.126376:0:19532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549170048:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789785405.126420:0:19532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785405.126447:0:19532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8513f240 going to sleep for 11 seconds 00000100:00100000:3.0:1789785405.129098:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549170048 00000100:00100000:3.0:1789785405.129112:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549170048 00000100:00100000:3.0:1789785405.129172:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789785405.129183:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:19532:x1876725549170048:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789785405.129373:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:19532:x1876725549170048:12345-0@lo:503:mount.lustre.0 Request processed in 190us (2952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785405.129382:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789785405.130659:0:19532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549170048:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789785405.131138:0:19532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789785405.131232:0:19532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549170176:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789785405.131301:0:19532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785405.131365:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549170176 00000100:00100000:2.0:1789785405.131371:0:19532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf9094f540 going to sleep for 11 seconds 00000100:00100000:1.0:1789785405.131372:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549170176 00000100:00100000:1.0:1789785405.131426:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789785405.131435:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:19532:x1876725549170176:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789785405.131530:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:19532:x1876725549170176:12345-0@lo:502:mount.lustre.0 Request processed in 96us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785405.131543:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789785405.131599:0:19532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549170176:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789785405.131752:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789785405.131775:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789785405.131788:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789785405.131802:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789785405.131817:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789785405.131831:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789785405.131920:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789785405.131998:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789785405.132014:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789785405.132026:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789785405.132040:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789785405.132055:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789785405.132071:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789785405.132101:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789785405.132118:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789785405.132132:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789785405.132270:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789785405.132290:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789785405.132303:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789785405.132315:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789785405.132327:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789785405.132361:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789785405.132376:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789785405.132388:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789785405.132401:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1789785405.132413:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1789785405.132425:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1789785405.132441:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1789785405.132472:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1789785405.132503:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1789785405.132519:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1789785405.132534:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1789785405.132548:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1789785405.132560:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1789785405.132582:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1789785405.132599:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1789785405.132613:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1789785405.132627:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1789785405.132642:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1789785405.132659:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1789785405.132674:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1789785405.132694:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1789785405.132709:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1789785405.132723:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1789785405.132737:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1789785405.132760:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1789785405.132774:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1789785405.132786:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1789785405.132822:0:19532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549170304:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789785405.133007:0:19532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785405.133041:0:19532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8513f540 going to sleep for 11 seconds 00000100:00100000:1.0:1789785405.133081:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549170304 00002000:00010000:3.0:1789785405.133087:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1789785405.133087:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549170304 00010000:00010000:3.0:1789785405.133100:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bcb29bc/0x2f18ee3fd845d6ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.133117:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=513s v=(0 0) 00010000:00010000:3.0:1789785405.133122:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1789785405.133129:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00010000:00010000:3.0:1789785405.133130:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bcb29bc/0x2f18ee3fd845d6ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785405.133140:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:19532:x1876725549170304:12345-0@lo:502:mount.lustre.0 00010000:00010000:3.0:1789785405.133150:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bcb29bc/0x2f18ee3fd845d6ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.133161:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bcb29bc/0x2f18ee3fd845d6ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.133170:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004bcb29bc/0x2f18ee3fd845d6ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.133189:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789785405.133236:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:19532:x1876725549170304:12345-0@lo:502:mount.lustre.0 Request processed in 97us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785405.133244:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00010000:1.0:1789785405.133285:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789785405.133292:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004bcb29bc/0x2f18ee3fd845d6ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.133302:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bae00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785405.133307:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004bcb29bc/0x2f18ee3fd845d6ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.133317:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004bcb29bc/0x2f18ee3fd845d6ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.133370:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004bcb29bc/0x2f18ee3fd845d6ef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.133380:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bcb29bc/0x2f18ee3fd845d6ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.133397:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785405.133399:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785405.133401:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785405.133422:0:19532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549170304:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789785405.133558:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1789785405.133593:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1789785405.133615:0:19532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549170432:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789785405.133645:0:19532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785405.133665:0:19532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8513f540 going to sleep for 11 seconds 00000100:00100000:1.0:1789785405.133676:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549170432 00000100:00100000:1.0:1789785405.133683:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549170432 00000100:00100000:1.0:1789785405.133700:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789785405.133706:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:19532:x1876725549170432:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789785405.133763:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:19532:x1876725549170432:12345-0@lo:502:mount.lustre.0 Request processed in 57us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785405.133770:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789785405.133808:0:19532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549170432:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789785405.133838:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1789785405.133919:0:19532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00002000:00010000:3.0:1789785405.135894:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789785405.135906:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7a709d7/0x2f18ee3fd845d6f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.135921:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=513s v=(0 0) 00010000:00010000:3.0:1789785405.135933:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785405.135940:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7a709d7/0x2f18ee3fd845d6f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.135955:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7a709d7/0x2f18ee3fd845d6f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.135965:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7a709d7/0x2f18ee3fd845d6f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.135974:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7a709d7/0x2f18ee3fd845d6f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.135999:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789785405.136024:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789785405.136033:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7a709d7/0x2f18ee3fd845d6f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.136043:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814ba200 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785405.136048:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7a709d7/0x2f18ee3fd845d6f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.136059:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7a709d7/0x2f18ee3fd845d6f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.136077:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7a709d7/0x2f18ee3fd845d6f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.136086:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7a709d7/0x2f18ee3fd845d6f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.136103:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785405.136112:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785405.136114:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789785405.139845:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789785405.139860:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000005646d8/0x2f18ee3fd845d6fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.139877:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=513s v=(0 0) 00010000:00010000:3.0:1789785405.139882:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785405.139890:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000005646d8/0x2f18ee3fd845d6fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.139906:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000005646d8/0x2f18ee3fd845d6fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.139918:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000005646d8/0x2f18ee3fd845d6fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.139938:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000005646d8/0x2f18ee3fd845d6fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.139959:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789785405.139974:0:18743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789785405.139980:0:18743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000005646d8/0x2f18ee3fd845d6fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.139988:0:18743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bbc00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:3.0:1789785405.139992:0:18743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000005646d8/0x2f18ee3fd845d6fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.140001:0:18743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000005646d8/0x2f18ee3fd845d6fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.140017:0:18743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000005646d8/0x2f18ee3fd845d6fd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.140023:0:18743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000005646d8/0x2f18ee3fd845d6fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.140055:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785405.140057:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785405.140059:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789785405.140118:0:19546:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789785405.140147:0:19546:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9dafb11d99b8) 00000020:00000080:2.0:1789785405.140174:0:19546:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1789785405.140263:0:19546:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dae8353e800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789785405.140268:0:19546:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dae8353e800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789785405.140270:0:19546:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dae8353e800 3 00010000:00080000:2.0:1789785405.140300:0:19546:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dae84542800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.146@tcp at head 00010000:00010000:2.0:1789785405.142420:0:19546:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1789785405.142631:0:19546:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789785405.142673:0:19546:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789785405.142686:0:19546:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2f18ee3fd845d70b 00000100:00080000:2.0:1789785405.142696:0:19546:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789785405.142703:0:19546:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dae84542800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:2.0:1789785405.142737:0:19546:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9daf82c82d80 x1876725549170560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789785405.142833:0:19546:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000020:01000004:2.0:1789785405.144825:0:19546:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789785405.144843:0:19546:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9dafac8ccd28) 00000100:00100000:3.0:1789785405.144920:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1876725549170560:0@lo:38:llog_process_th.0 00000020:00000080:2.0:1789785405.144984:0:19546:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000100:00100000:3.0:1789785405.145000:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785405.145038:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549170560 00000100:00100000:1.0:1789785405.145047:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549170560 00000020:01000004:2.0:1789785405.145070:0:19546:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dae8353e800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789785405.145076:0:19546:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dae8353e800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789785405.145080:0:19546:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dae8353e800 3 00000100:00100000:1.0:1789785405.145087:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789785405.145097:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1876725549170560:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789785405.145123:0:17213:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 513 last 0 00010000:00080000:2.0:1789785405.145130:0:19546:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dae82593800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.146@tcp at head 00002000:00010000:3.0:1789785405.145146:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789785405.145156:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456be35e/0x2f18ee3fd845d720 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.145171:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=513s v=(0 0) 00000020:00000080:1.0:1789785405.145172:0:17213:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2f18ee3fd845d719 00010000:00010000:3.0:1789785405.145180:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785405.145188:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000456be35e/0x2f18ee3fd845d720 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00100000:1.0:1789785405.145190:0:17213:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00010000:3.0:1789785405.145209:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000456be35e/0x2f18ee3fd845d720 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.145219:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456be35e/0x2f18ee3fd845d720 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789785405.145223:0:17213:0:(import.c:65:import_set_state_nolock()) ffff9dae84432800 : changing import state from RECOVER to FULL 00010000:00010000:3.0:1789785405.145232:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000456be35e/0x2f18ee3fd845d720 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.145251:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789785405.145287:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1876725549170560:12345-0@lo:38:llog_process_th.0 Request processed in 190us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785405.145296:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789785405.145320:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789785405.145327:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000456be35e/0x2f18ee3fd845d720 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.145689:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814ba600 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785405.145696:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000456be35e/0x2f18ee3fd845d720 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.145707:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000456be35e/0x2f18ee3fd845d720 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.145726:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000456be35e/0x2f18ee3fd845d720 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.145745:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000456be35e/0x2f18ee3fd845d720 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.145767:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785405.145770:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785405.145772:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1789785405.145805:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9daf82c82d80 x1876725549170560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789785415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785405.145815:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789785405.145823:0:3658:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1789785405.145831:0:3658:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789785405.145835:0:3658:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789785405.145837:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dae84542800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789785405.145843:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1876725549170560:0@lo:38:llog_process_th.0 00010000:00010000:2.0:1789785405.147332:0:19546:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1789785405.147525:0:19546:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1789785405.147564:0:19546:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789785405.147587:0:19546:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x2f18ee3fd845d727 00000100:00080000:2.0:1789785405.147595:0:19546:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789785405.147601:0:19546:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9dae82593800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:2.0:1789785405.147632:0:19546:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9daf82c80380 x1876725549170688/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789785405.147664:0:19546:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1789785405.147824:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3658:1876725549170688:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789785405.147884:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785405.148007:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549170688 00000100:00100000:2.0:1789785405.148014:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549170688 00000100:00100000:2.0:1789785405.148047:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789785405.148057:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1876725549170688:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789785405.148082:0:17212:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:2.0:1789785405.148108:0:17212:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x2f18ee3fd845d72e 00000004:00100000:2.0:1789785405.148122:0:17212:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789785405.148283:0:17212:0:(import.c:65:import_set_state_nolock()) ffff9dae82595000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789785405.148331:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1876725549170688:12345-0@lo:38:llog_process_th.0 Request processed in 275us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785405.148364:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789785405.148376:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9daf82c80380 x1876725549170688/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789785415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785405.148384:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789785405.148477:0:3658:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1789785405.148483:0:3658:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789785405.148486:0:3658:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789785405.148488:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dae82593800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789785405.148492:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3658:1876725549170688:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789785405.156517:0:19546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1789785405.156623:0:19532:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789785405.156669:0:19532:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789785405.156692:0:19532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54600/0x2f18ee3fd845d6cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d6d3 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.156703:0:19532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54600/0x2f18ee3fd845d6cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d6d3 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789785405.156744:0:19532:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789785405.156746:0:19532:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789785405.156747:0:19532:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789785405.156747:0:19532:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789785405.156748:0:19532:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789785405.156749:0:19532:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789785405.156750:0:19532:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789785405.156751:0:19532:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789785405.156753:0:19532:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789785405.156756:0:19532:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1789785405.156758:0:19532:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789785405.156759:0:19532:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789785405.156759:0:19532:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789785405.156760:0:19532:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789785405.156760:0:19532:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789785405.156761:0:19532:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789785405.156762:0:19532:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789785405.156762:0:19532:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789785405.156763:0:19532:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789785405.156788:0:19532:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789785405.156808:0:19532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549170816:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789785405.156883:0:19532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785405.156923:0:19532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf987f5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789785405.157821:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549170816 00000100:00100000:2.0:1789785405.157831:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549170816 00000100:00100000:2.0:1789785405.157883:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789785405.157893:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:19532:x1876725549170816:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789785405.157920:0:17205:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789785405.157932:0:17205:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00002000:00010000:2.0:1789785405.161305:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789785405.161319:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d735 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.161335:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=513s v=(0 0) 00010000:00010000:2.0:1789785405.161358:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785405.161365:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.161395:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.161406:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.161413:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d735 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.161432:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789785405.161499:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789785405.161507:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d735 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.161515:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54c00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785405.161519:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d735 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.161528:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d735 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.161545:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d735 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.161552:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d735 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.161581:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785405.161583:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785405.161585:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789785405.161935:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789785405.161942:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092f7378c/0x2f18ee3fd845d73c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.161951:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=513s v=(0 0) 00010000:00010000:2.0:1789785405.161954:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785405.161957:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092f7378c/0x2f18ee3fd845d73c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.161965:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092f7378c/0x2f18ee3fd845d73c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.161972:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092f7378c/0x2f18ee3fd845d73c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.161999:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092f7378c/0x2f18ee3fd845d73c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.162142:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789785405.162607:0:18743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789785405.162614:0:18743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092f7378c/0x2f18ee3fd845d73c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.162623:0:18743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55800 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:0.0:1789785405.162633:0:18743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092f7378c/0x2f18ee3fd845d73c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.162641:0:18743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092f7378c/0x2f18ee3fd845d73c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.162656:0:18743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092f7378c/0x2f18ee3fd845d73c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.162663:0:18743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092f7378c/0x2f18ee3fd845d73c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.162681:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785405.162682:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785405.162684:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789785405.162773:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789785405.162786:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845d743 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.162793:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=513s v=(0 0) 00010000:00010000:2.0:1789785405.162795:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785405.162804:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845d743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.162812:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845d743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.162818:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845d743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.162822:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845d743 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.162840:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789785405.162862:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789785405.162869:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845d743 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.162877:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55400 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785405.162880:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845d743 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.162900:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845d743 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.162911:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845d743 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.162919:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000019f4e4/0x2f18ee3fd845d743 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.162933:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785405.162934:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785405.162936:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789785405.163498:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789785405.163506:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d74a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.163538:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=513s v=(0 0) 00010000:00010000:2.0:1789785405.163542:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785405.163546:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d74a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.163557:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d74a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.163565:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d74a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.163606:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d74a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.163643:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789785405.164254:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789785405.164262:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d74a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.164271:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55200 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:0.0:1789785405.164275:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d74a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.164283:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d74a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.164302:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d74a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.164316:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d74a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.164335:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785405.164363:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785405.164366:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789785405.164416:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789785405.164425:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064be49cb/0x2f18ee3fd845d751 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.164436:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=513s v=(0 0) 00010000:00010000:2.0:1789785405.164440:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785405.164445:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064be49cb/0x2f18ee3fd845d751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.164457:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064be49cb/0x2f18ee3fd845d751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.164479:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064be49cb/0x2f18ee3fd845d751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.164487:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064be49cb/0x2f18ee3fd845d751 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.164505:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789785405.164525:0:18743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789785405.164530:0:18743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064be49cb/0x2f18ee3fd845d751 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.164538:0:18743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55c00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:0.0:1789785405.164542:0:18743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064be49cb/0x2f18ee3fd845d751 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.164549:0:18743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064be49cb/0x2f18ee3fd845d751 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.164559:0:18743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064be49cb/0x2f18ee3fd845d751 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.164565:0:18743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064be49cb/0x2f18ee3fd845d751 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.164593:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785405.164595:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785405.164596:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789785405.166334:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789785405.166359:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001820b72c/0x2f18ee3fd845d758 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.166374:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=513s v=(0 0) 00010000:00010000:2.0:1789785405.166378:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785405.166385:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001820b72c/0x2f18ee3fd845d758 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.166397:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001820b72c/0x2f18ee3fd845d758 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.166407:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001820b72c/0x2f18ee3fd845d758 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.166415:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001820b72c/0x2f18ee3fd845d758 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.166446:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789785405.166455:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789785405.166463:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001820b72c/0x2f18ee3fd845d758 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.166471:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54200 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785405.166473:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001820b72c/0x2f18ee3fd845d758 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.166479:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001820b72c/0x2f18ee3fd845d758 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.166493:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001820b72c/0x2f18ee3fd845d758 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.166509:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001820b72c/0x2f18ee3fd845d758 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.166521:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785405.166524:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785405.166525:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789785405.166969:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789785405.166983:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d75f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.166990:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=513s v=(0 0) 00010000:00010000:2.0:1789785405.166993:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785405.166996:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d75f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.167003:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d75f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.167008:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d75f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.167022:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d75f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.167036:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789785405.167061:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789785405.167068:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d75f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.167076:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54c00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:0.0:1789785405.167080:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d75f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.167088:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d75f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.167099:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d75f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.167105:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b650d63/0x2f18ee3fd845d75f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.167133:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785405.167136:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785405.167138:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789785405.167475:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789785405.167481:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c129ea8/0x2f18ee3fd845d766 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.167501:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=513s v=(0 0) 00010000:00010000:2.0:1789785405.167510:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785405.167514:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c129ea8/0x2f18ee3fd845d766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.167537:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c129ea8/0x2f18ee3fd845d766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.167545:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c129ea8/0x2f18ee3fd845d766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.167551:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c129ea8/0x2f18ee3fd845d766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.167612:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789785405.168648:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789785405.168658:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053a41bf0/0x2f18ee3fd845d76d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.168670:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=513s v=(0 0) 00010000:00010000:2.0:1789785405.168673:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785405.168679:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053a41bf0/0x2f18ee3fd845d76d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.168690:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053a41bf0/0x2f18ee3fd845d76d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.168699:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053a41bf0/0x2f18ee3fd845d76d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.168716:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053a41bf0/0x2f18ee3fd845d76d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.168758:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789785405.168884:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789785405.168892:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c129ea8/0x2f18ee3fd845d766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.168912:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09c00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785405.168917:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c129ea8/0x2f18ee3fd845d766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.168924:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c129ea8/0x2f18ee3fd845d766 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.168951:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c129ea8/0x2f18ee3fd845d766 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.168959:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c129ea8/0x2f18ee3fd845d766 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.168982:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789785405.168985:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053a41bf0/0x2f18ee3fd845d76d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.168994:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09200 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785405.168996:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053a41bf0/0x2f18ee3fd845d76d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.169012:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053a41bf0/0x2f18ee3fd845d76d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.169019:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053a41bf0/0x2f18ee3fd845d76d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.169023:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053a41bf0/0x2f18ee3fd845d76d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.169031:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785405.169032:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785405.169033:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789785405.169151:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789785405.169157:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da157456/0x2f18ee3fd845d774 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.169163:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=513s v=(0 0) 00010000:00010000:2.0:1789785405.169165:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785405.169168:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da157456/0x2f18ee3fd845d774 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.169173:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da157456/0x2f18ee3fd845d774 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.169178:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da157456/0x2f18ee3fd845d774 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.169183:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da157456/0x2f18ee3fd845d774 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.169203:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789785405.169363:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789785405.169370:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da157456/0x2f18ee3fd845d774 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.169378:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b08e00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:0.0:1789785405.169381:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da157456/0x2f18ee3fd845d774 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.169401:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da157456/0x2f18ee3fd845d774 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.169412:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da157456/0x2f18ee3fd845d774 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.169419:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da157456/0x2f18ee3fd845d774 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.169434:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785405.169435:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785405.169437:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789785405.169566:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789785405.169584:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d926593e/0x2f18ee3fd845d77b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.169599:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=513s v=(0 0) 00010000:00010000:2.0:1789785405.169602:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785405.169606:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d926593e/0x2f18ee3fd845d77b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.169615:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d926593e/0x2f18ee3fd845d77b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.169622:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d926593e/0x2f18ee3fd845d77b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.169629:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d926593e/0x2f18ee3fd845d77b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.169650:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789785405.169739:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789785405.169744:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d926593e/0x2f18ee3fd845d77b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.169764:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b08600 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785405.169768:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d926593e/0x2f18ee3fd845d77b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.169794:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d926593e/0x2f18ee3fd845d77b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.169815:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d926593e/0x2f18ee3fd845d77b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.169834:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d926593e/0x2f18ee3fd845d77b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.169851:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785405.169853:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785405.169868:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785405.169870:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789785405.170001:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789785405.170006:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e374ac74/0x2f18ee3fd845d782 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.170015:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=513s v=(0 0) 00010000:00010000:2.0:1789785405.170017:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785405.170020:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e374ac74/0x2f18ee3fd845d782 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.170025:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e374ac74/0x2f18ee3fd845d782 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.170039:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e374ac74/0x2f18ee3fd845d782 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.170044:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e374ac74/0x2f18ee3fd845d782 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.170080:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789785405.170364:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789785405.170371:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e4e0438/0x2f18ee3fd845d789 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.170379:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=513s v=(0 0) 00010000:00010000:2.0:1789785405.170382:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785405.170387:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e4e0438/0x2f18ee3fd845d789 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.170395:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e4e0438/0x2f18ee3fd845d789 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.170403:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e4e0438/0x2f18ee3fd845d789 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.170410:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e4e0438/0x2f18ee3fd845d789 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.170648:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789785405.170654:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e374ac74/0x2f18ee3fd845d782 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.170661:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b08c00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:0.0:1789785405.170665:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e374ac74/0x2f18ee3fd845d782 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.170673:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e374ac74/0x2f18ee3fd845d782 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.170685:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e374ac74/0x2f18ee3fd845d782 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.170701:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e374ac74/0x2f18ee3fd845d782 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.170714:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789785405.170717:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e4e0438/0x2f18ee3fd845d789 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.170724:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09400 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:0.0:1789785405.170727:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e4e0438/0x2f18ee3fd845d789 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.170735:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e4e0438/0x2f18ee3fd845d789 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.170745:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e4e0438/0x2f18ee3fd845d789 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.170752:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785405.170754:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785405.170756:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785405.170841:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789785405.170869:0:18718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e4e0438/0x2f18ee3fd845d789 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.170939:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789785405.171182:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789785405.171188:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2bae5c6/0x2f18ee3fd845d790 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.171195:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=513s v=(0 0) 00010000:00010000:2.0:1789785405.171654:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785405.171663:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2bae5c6/0x2f18ee3fd845d790 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.171687:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2bae5c6/0x2f18ee3fd845d790 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.171695:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2bae5c6/0x2f18ee3fd845d790 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.171718:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2bae5c6/0x2f18ee3fd845d790 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.171748:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 20000000:01000000:3.0:1789785405.172319:0:17205:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789785405.172352:0:17205:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789785405.172371:0:17227:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789785405.172377:0:17227:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789785405.172395:0:17227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d797 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.172411:0:17227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9daf814ba400/0x2f18ee3fd845d64e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d647 expref: 24 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.172426:0:17227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845d65c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d655 expref: 24 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.172433:0:17227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d797 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.172436:0:18743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789785405.172445:0:18743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2bae5c6/0x2f18ee3fd845d790 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.172457:0:18743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b08000 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:3.0:1789785405.172468:0:18743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2bae5c6/0x2f18ee3fd845d790 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.172474:0:17227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845d65c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845d655 expref: 24 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.172480:0:18743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2bae5c6/0x2f18ee3fd845d790 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.172493:0:17227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845d65c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845d655 expref: 24 pid: 17205 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.172500:0:18743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2bae5c6/0x2f18ee3fd845d790 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.172509:0:18743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2bae5c6/0x2f18ee3fd845d790 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.172525:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785405.172527:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785405.172529:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785405.172652:0:17227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d6a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1876725549170944:0@lo:104: 00002000:00010000:2.0:1789785405.172702:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789785405.172707:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6154e20/0x2f18ee3fd845d79e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785405.172719:0:17227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789785405.172720:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=513s v=(0 0) 00010000:00010000:2.0:1789785405.172724:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785405.172728:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6154e20/0x2f18ee3fd845d79e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.172738:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6154e20/0x2f18ee3fd845d79e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.172746:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6154e20/0x2f18ee3fd845d79e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.172752:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6154e20/0x2f18ee3fd845d79e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.172831:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789785405.172851:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549170944 00000100:00100000:1.0:1789785405.172858:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549170944 00002000:00080000:2.0:1789785405.172878:0:18718:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:1.0:1789785405.172903:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789785405.172912:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad642144-cf43-4df2-a5e5-a426cdb5453e+3:17227:x1876725549170944:12345-0@lo:104: 00010000:00010000:1.0:1789785405.172924:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65c00/0x2f18ee3fd845d655 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845d65c expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785405.172933:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17236:x1876725549169024:12345-0@lo:5:osp-pre-0-0.0 Request processed in 166393us (167054us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785405.172944:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789785405.172959:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789785405.172964:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad642144-cf43-4df2-a5e5-a426cdb5453e+3:17227:x1876725549170944:12345-0@lo:104: Request processed in 54us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785405.172969:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1789785405.172987:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1789785405.172988:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c83800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17236:1876725549169024:0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1789785405.172992:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6154e20/0x2f18ee3fd845d79e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.172999:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b08200 already unused, calling callback (ffffffffc0cc5370) 00000004:00080000:2.0:1789785405.173002:0:17236:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00010000:00010000:1.0:1789785405.173007:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6154e20/0x2f18ee3fd845d79e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.173014:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6154e20/0x2f18ee3fd845d79e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.173025:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6154e20/0x2f18ee3fd845d79e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785405.173032:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c83800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17236:1876725549171072:0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1789785405.173032:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6154e20/0x2f18ee3fd845d79e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.173047:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789785405.173051:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65c00/0x2f18ee3fd845d655 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845d65c expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785405.173055:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789785405.173057:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65c00 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:1.0:1789785405.173061:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65c00/0x2f18ee3fd845d655 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845d65c expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.173069:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65c00/0x2f18ee3fd845d655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845d65c expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785405.173072:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafac73e780 going to sleep for 11 seconds 10000000:00010000:1.0:1789785405.173075:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65c00/0x2f18ee3fd845d655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845d65c expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785405.173081:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1789785405.173088:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549171072 00000100:00100000:2.0:1789785405.173092:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549171072 00010000:00010000:1.0:1789785405.173105:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65c00/0x2f18ee3fd845d655 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d65c expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785405.173114:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789785405.173120:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17236:x1876725549171072:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789785405.173154:0:18718:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:0.0:1789785405.173398:0:17227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9daf814ba400/0x2f18ee3fd845d64e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845d647 expref: 24 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785405.173408:0:17227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9daf814ba400/0x2f18ee3fd845d64e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845d647 expref: 24 pid: 17204 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785405.173418:0:17227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1876725549171328:0@lo:104: 00000100:00100000:0.0:1789785405.173442:0:17227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785405.173458:0:17227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf987f5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789785405.173470:0:17227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d6a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1876725549170944:0@lo:104: 00010000:00010000:1.0:1789785405.173658:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789785405.173818:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785405.173849:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:19532:x1876725549170816:12345-0@lo:253:mount.lustre.0 Request processed in 15957us (16964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785405.173858:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789785405.173862:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1789785405.173883:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65c00/0x2f18ee3fd845d655 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d65c expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.173891:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc1a65c00/0x2f18ee3fd845d655 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d65c expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.173902:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785405.173904:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785405.173906:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785405.173931:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549171328 00000100:00100000:1.0:1789785405.173936:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549171328 00000100:00100000:1.0:1789785405.173968:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789785405.173975:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad642144-cf43-4df2-a5e5-a426cdb5453e+3:17227:x1876725549171328:12345-0@lo:104: 00010000:00010000:1.0:1789785405.173983:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55000/0x2f18ee3fd845d647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845d64e expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.174033:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789785405.174034:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad642144-cf43-4df2-a5e5-a426cdb5453e:3660:1876725549171200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789785405.174038:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad642144-cf43-4df2-a5e5-a426cdb5453e+3:17227:x1876725549171328:12345-0@lo:104: Request processed in 64us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785405.174044:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789785405.174057:0:18743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789785405.174059:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789785405.174061:0:18743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55000/0x2f18ee3fd845d647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845d64e expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.174068:0:18743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55000 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:1.0:1789785405.174071:0:18743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55000/0x2f18ee3fd845d647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845d64e expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.174090:0:18743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55000/0x2f18ee3fd845d647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845d64e expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789785405.174096:0:18743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55000/0x2f18ee3fd845d647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845d64e expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785405.174101:0:18743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789785405.174132:0:18743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55000/0x2f18ee3fd845d647 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d64e expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.174137:0:18743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789785405.174146:0:18743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55000/0x2f18ee3fd845d647 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d64e expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.174152:0:18743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55000/0x2f18ee3fd845d647 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d64e expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.174164:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785405.174165:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785405.174167:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785405.174177:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789785405.174186:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad642144-cf43-4df2-a5e5-a426cdb5453e:3659:1876725549171456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789785405.174316:0:19532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad642144-cf43-4df2-a5e5-a426cdb5453e:19532:1876725549170816:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789785405.174324:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1789785405.174331:0:19532:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789785405.174334:0:19532:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000100:00100000:3.0:1789785405.174385:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549171200 00000100:00100000:3.0:1789785405.174391:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549171200 00010000:00010000:3.0:1789785405.174414:0:17198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845d65c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845d655 expref: 24 pid: 17205 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785405.174444:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549171456 00000100:00100000:2.0:1789785405.174447:0:17227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1876725549171328:0@lo:104: 00000100:00100000:3.0:1789785405.174449:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549171456 00010000:00010000:3.0:1789785405.174467:0:17198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9daf814ba400/0x2f18ee3fd845d64e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845d647 expref: 25 pid: 17204 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785405.174469:0:17227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d797 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789785405.174478:0:19532:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789785405.174481:0:19532:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789785405.174483:0:19532:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789785405.174485:0:19532:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789785405.174486:0:19532:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789785405.174487:0:19532:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789785405.174489:0:19532:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789785405.174490:0:19532:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1789785405.174501:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000020:02000000:0.0:1789785405.174505:0:19532:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789785405.174511:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad642144-cf43-4df2-a5e5-a426cdb5453e+25:3660:x1876725549171200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789785405.174524:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789785405.174535:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1789785405.174540:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845d65c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845d655 expref: 25 pid: 17205 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785405.174545:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad642144-cf43-4df2-a5e5-a426cdb5453e+25:3659:x1876725549171456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789785405.174560:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845d65c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845d655 expref: 25 pid: 17205 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.174560:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785405.174569:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9daf814ba400/0x2f18ee3fd845d64e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845d647 expref: 25 pid: 17204 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.174588:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dae81eadc00/0x2f18ee3fd845d65c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845d655 expref: 25 pid: 17205 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.174603:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789785405.174608:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9daf814ba400/0x2f18ee3fd845d64e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845d647 expref: 24 pid: 17204 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.174620:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9daf814ba400/0x2f18ee3fd845d64e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845d647 expref: 24 pid: 17204 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.174633:0:17196:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d797 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.174641:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d797 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789785405.174652:0:17196:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.018193576s 00000100:00100000:3.0:1789785405.174655:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad642144-cf43-4df2-a5e5-a426cdb5453e+23:3660:x1876725549171200:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (593us total) trans 0 rc 0/0 00010000:00010000:1.0:1789785405.174658:0:17196:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d797 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785405.174668:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1789785405.174672:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d797 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.174680:0:17196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d797 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.174687:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d797 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.174693:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54200 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785405.174696:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d797 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.174702:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d797 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785405.174793:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad642144-cf43-4df2-a5e5-a426cdb5453e:3660:1876725549171200:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1789785405.175722:0:19532:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789785405.179030:0:18714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1789785405.179061:0:18714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789785405.179295:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17236:x1876725549171072:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6165us (6230us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789785405.179304:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789785405.179858:0:17236:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1789785405.179867:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c83800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17236:1876725549171072:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789785405.179882:0:17236:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00002000:00080000:2.0:1789785405.180868:0:19532:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789785405.180874:0:19532:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789785405.180907:0:19532:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789785405.180942:0:19532:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.146@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789785405.180956:0:19532:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789785405.180971:0:19532:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1789785405.181756:0:19532:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789785405.181996:0:19532:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789785405.183933:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d797 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785405.183957:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785405.193864:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad642144-cf43-4df2-a5e5-a426cdb5453e+22:3659:x1876725549171456:12345-0@lo:103:ldlm_bl.0 Request processed in 19314us (19531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785405.193879:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1789785405.198831:0:17227:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d797 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.198852:0:17227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d797 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785405.198860:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafb5d54200/0x2f18ee3fd845d797 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789785405.199419:0:17971:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789785405.201616:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad642144-cf43-4df2-a5e5-a426cdb5453e:3659:1876725549171456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789785405.250835:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789785405.250860:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549171584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789785405.250925:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785405.251138:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549171712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789785405.251168:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785405.251202:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549171712 00000100:00100000:1.0:1789785405.251209:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549171712 00000100:00100000:1.0:1789785405.251251:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789785405.251261:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549171712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789785405.251283:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789785405.251323:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549171712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785405.251330:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789785405.251393:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549171712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789785405.252907:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549171584 00000100:00100000:0.0:1789785405.252914:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549171584 00000100:00100000:0.0:1789785405.252953:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789785405.252963:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549171584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789785405.252991:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789785405.254202:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789785405.254227:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549171840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789785405.254288:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785405.255608:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549171840 00000100:00100000:1.0:1789785405.255619:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549171840 00000100:00100000:1.0:1789785405.255660:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789785405.255671:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549171840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789785405.255705:0:17216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789785405.255786:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549171840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (1496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785405.255794:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789785405.255865:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549171840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789785405.256076:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549171584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3114us (5150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785405.256085:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789785405.256373:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549171584:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1789785405.780949:0:19599:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789785405.781182:0:19599:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789785406.156765:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785407.171025:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789785407.171211:0:17209:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789785407.171216:0:17209:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9daf89062000 from 10 10000000:01000000:2.0:1789785407.171221:0:17209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789785407.171266:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09a00/0x2f18ee3fd845d7a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785407.171287:0:17209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09a00/0x2f18ee3fd845d7a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785407.171299:0:17209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09a00/0x2f18ee3fd845d7a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785407.171326:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549171968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789785407.171413:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785407.171455:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8a8a2600 going to sleep for 11 seconds 00000100:00100000:3.0:1789785407.171507:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549171968 00000100:00100000:3.0:1789785407.171514:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549171968 00000100:00100000:3.0:1789785407.171574:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789785407.171584:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+22:17209:x1876725549171968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789785407.171597:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785407.171609:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9daf814bb200/0x2f18ee3fd845d7ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d7a5 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785407.171630:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9daf814bb200/0x2f18ee3fd845d7ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d7a5 expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785407.171640:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9daf814bb200/0x2f18ee3fd845d7ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d7a5 expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785407.171649:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bb200, rc 0) 00000100:00100000:3.0:1789785407.171693:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+23:17209:x1876725549171968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785407.171699:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789785407.171827:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549171968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789785407.171841:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09a00/0x2f18ee3fd845d7a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d7ac expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785407.171849:0:17209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09a00/0x2f18ee3fd845d7a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d7ac expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785407.171903:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549172096:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789785407.171937:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785407.171967:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf8a8a2600 going to sleep for 11 seconds 00000100:00100000:3.0:1789785407.172066:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549172096 00000100:00100000:3.0:1789785407.172070:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549172096 00000100:00100000:3.0:1789785407.172100:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789785407.172107:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+23:17209:x1876725549172096:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789785407.172128:0:17205:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789785407.172146:0:17205:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789785407.172150:0:17205:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1789785407.172226:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+23:17209:x1876725549172096:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785407.172237:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789785407.173582:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549172096:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789785407.173661:0:17209:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789785407.173670:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09a00/0x2f18ee3fd845d7a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d7ac expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785407.173691:0:17209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09a00/0x2f18ee3fd845d7a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d7ac expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785407.173700:0:17209:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789785407.173702:0:17209:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dafb11eb000 from 10 10000000:01000000:0.0:1789785407.173705:0:17209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789785407.173732:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54200/0x2f18ee3fd845d7b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785407.173739:0:17209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54200/0x2f18ee3fd845d7b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785407.173746:0:17209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54200/0x2f18ee3fd845d7b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785407.173762:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549172224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789785407.173804:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785407.173843:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf9017b240 going to sleep for 11 seconds 00000100:00100000:3.0:1789785407.174266:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549172224 00000100:00100000:3.0:1789785407.174273:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549172224 00000100:00100000:3.0:1789785407.174328:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789785407.174374:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+23:17209:x1876725549172224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789785407.174386:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785407.174397:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9daf814bbc00/0x2f18ee3fd845d7ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d7b3 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785407.174417:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9daf814bbc00/0x2f18ee3fd845d7ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d7b3 expref: 24 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785407.174427:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9daf814bbc00/0x2f18ee3fd845d7ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d7b3 expref: 24 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785407.174434:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bbc00, rc 0) 00000100:00100000:3.0:1789785407.174469:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:17209:x1876725549172224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785407.174476:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789785407.174670:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549172224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789785407.174683:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54200/0x2f18ee3fd845d7b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d7ba expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785407.174692:0:17209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54200/0x2f18ee3fd845d7b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d7ba expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785407.174737:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549172352:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789785407.174766:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785407.174802:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf9017b240 going to sleep for 11 seconds 00000100:00100000:2.0:1789785407.174857:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549172352 00000100:00100000:2.0:1789785407.174861:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549172352 00000100:00100000:2.0:1789785407.174889:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789785407.174897:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb425c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:17209:x1876725549172352:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789785407.174926:0:17206:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789785407.174941:0:17206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789785407.174952:0:17206:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1789785407.175026:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb425c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:17209:x1876725549172352:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785407.175033:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789785407.175243:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549172352:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789785407.175299:0:17209:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789785407.175305:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54200/0x2f18ee3fd845d7b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d7ba expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785407.175313:0:17209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafb5d54200/0x2f18ee3fd845d7b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d7ba expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785408.204775:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785409.218797:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785410.256869:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785410.380371:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549172480:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789785410.380486:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785410.385159:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549172480 00000100:00100000:1.0:1789785410.385182:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549172480 00000100:00100000:1.0:1789785410.385280:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789785410.385293:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549172480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789785410.385382:0:17216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789785410.385518:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549172480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 227us (5038us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785410.385525:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789785410.385612:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549172480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789785410.386036:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789785410.386054:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549172608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789785410.386104:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785410.386143:0:18200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549172608 00000100:00100000:0.0:1789785410.386147:0:18200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549172608 00000100:00100000:0.0:1789785410.386179:0:18200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789785410.386187:0:18200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549172608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789785410.386212:0:18200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789785410.386251:0:18200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549172608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785410.386257:0:18200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789785410.386288:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549172608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789785410.386958:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549172736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789785410.387000:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789785410.387135:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789785410.387140:0:15987:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789785410.387144:0:15987:0:(import.c:65:import_set_state_nolock()) ffff9dafa64af800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789785410.387150:0:15987:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 513 00000100:00080000:1.0:1789785410.387154:0:15987:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789785410.387159:0:15987:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dafa64af800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:1.0:1789785410.387183:0:15987:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafb113df80 x1876725549172992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789785410.387223:0:15987:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789785410.387226:0:15987:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789785410.387229:0:15987:0:(import.c:65:import_set_state_nolock()) ffff9daf862fe800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789785410.387232:0:15987:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 513 00000100:00080000:1.0:1789785410.387235:0:15987:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789785410.387239:0:15987:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9daf862fe800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:1.0:1789785410.387269:0:15987:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dafbf4e8380 x1876725549173376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789785410.387369:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549172736 00000100:00100000:1.0:1789785410.387375:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549172736 00000100:00100000:1.0:1789785410.387421:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789785410.387428:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549172736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789785410.387454:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789785410.388041:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549172736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 611us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785410.388050:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789785410.388082:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad642144-cf43-4df2-a5e5-a426cdb5453e:3659:1876725549172864:0@lo:400:kworker.0 00000100:00100000:1.0:1789785410.388120:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785410.388163:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549173632:0@lo:400:kworker.0 00000100:00100000:1.0:1789785410.388191:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785410.388215:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789785410.388223:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549173120:0@lo:400:kworker.0 00000100:00100000:1.0:1789785410.388244:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785410.388261:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549173760:0@lo:400:kworker.0 00000100:00100000:1.0:1789785410.388283:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785410.388310:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549172992:0@lo:8:kworker.0 00000100:00100000:1.0:1789785410.388361:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785410.388378:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549173376:0@lo:8:kworker.0 00000100:00100000:1.0:1789785410.388400:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789785410.388426:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789785410.388446:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549173632 00000100:00100000:1.0:1789785410.388465:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549173632 00000100:00100000:2.0:1789785410.388672:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf82c82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549174144:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789785410.388703:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785410.388739:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549174144 00000100:00100000:2.0:1789785410.388742:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549174144 00000100:00100000:0.0:1789785410.388964:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549172864 00000100:00100000:0.0:1789785410.388969:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549172864 00000100:00100000:0.0:1789785410.389010:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789785410.389026:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:3659:x1876725549172864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785410.389085:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:3659:x1876725549172864:12345-0@lo:400:kworker.0 Request processed in 60us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785410.389092:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789785410.389128:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549172992 00000100:00100000:0.0:1789785410.389132:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549172992 00000100:00100000:1.0:1789785410.389193:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549173120 00000100:00100000:1.0:1789785410.389197:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549173120 00000100:00100000:1.0:1789785410.389212:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549173760 00000100:00100000:1.0:1789785410.389215:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549173760 00000100:00100000:2.0:1789785410.397428:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789785410.397692:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549174144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789785410.397733:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789785410.397840:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549174144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 398us (9135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785410.397847:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789785410.397898:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789785410.397909:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549173632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785410.397952:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549173632:12345-0@lo:400:kworker.0 Request processed in 46us (9759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785410.397958:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789785410.397977:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789785410.397984:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549173120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785410.398013:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876725549173120:12345-0@lo:400:kworker.0 Request processed in 30us (9768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785410.398020:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789785410.398117:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf82c82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549174144:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1789785410.398136:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb113d500 x1876725549173120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785410.398149:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876725549173120:0@lo:400:kworker.0 00000100:00100000:2.0:1789785410.398162:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad642144-cf43-4df2-a5e5-a426cdb5453e:3659:1876725549172864:0@lo:400:kworker.0 00010000:00080000:2.0:1789785410.398174:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf4e8700 x1876725549173632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785410.398182:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549173632:0@lo:400:kworker.0 00000100:00100000:0.0:1789785410.398453:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549173376 00000100:00100000:0.0:1789785410.398462:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549173376 00000100:00100000:0.0:1789785410.398508:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789785410.398515:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3658:x1876725549172992:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789785410.398555:0:18717:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:0.0:1789785410.398592:0:18717:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f18ee3fd845d7c1 00002000:00100000:0.0:1789785410.398609:0:18717:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9dae827a7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396e ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789785410.398614:0:18717:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789785410.398618:0:18717:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789785410.398834:0:18717:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789785410.398862:0:18717:0:(import.c:65:import_set_state_nolock()) ffff9dae827a3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789785410.398926:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3658:x1876725549172992:12345-0@lo:8:kworker.0 Request processed in 410us (10588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785410.398934:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789785410.398948:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789785410.398953:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3658:x1876725549173376:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789785410.398969:0:18717:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:0.0:1789785410.398987:0:18717:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f18ee3fd845d7c8 00002000:00100000:0.0:1789785410.398993:0:18717:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9dae827a1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396e ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1789785410.398997:0:18717:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1789785410.399008:0:18717:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789785410.399035:0:18717:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1789785410.399050:0:18717:0:(import.c:65:import_set_state_nolock()) ffff9dae827a4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789785410.399081:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3658:x1876725549173376:12345-0@lo:8:kworker.0 Request processed in 127us (10680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785410.399088:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789785410.403278:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789785410.403301:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549173760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785410.403718:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549173760:12345-0@lo:400:kworker.0 Request processed in 145us (15152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785410.403729:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789785410.403795:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549173248:0@lo:400:kworker.0 00000100:00100000:1.0:1789785410.403844:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785410.403917:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1876725549173888:0@lo:400:kworker.0 00000100:00100000:1.0:1789785410.403947:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785410.403973:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789785410.403981:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549173504:0@lo:400:kworker.0 00000100:00100000:1.0:1789785410.404005:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785410.404023:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549174016:0@lo:400:kworker.0 00000100:00100000:1.0:1789785410.404046:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785410.404071:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549173888 00000100:00100000:1.0:1789785410.404081:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549173888 00000100:00100000:1.0:1789785410.404108:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549173504 00000100:00100000:1.0:1789785410.404112:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549173504 00000100:00100000:1.0:1789785410.404123:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549174016 00000100:00100000:1.0:1789785410.404126:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549174016 00000100:00100000:1.0:1789785410.404140:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789785410.404147:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1876725549173888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785410.404188:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1876725549173888:12345-0@lo:400:kworker.0 Request processed in 41us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785410.404208:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789785410.404222:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789785410.404229:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549173504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785410.404260:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549173504:12345-0@lo:400:kworker.0 Request processed in 32us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785410.404267:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789785410.404279:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789785410.404284:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549174016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785410.404310:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549174016:12345-0@lo:400:kworker.0 Request processed in 26us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785410.404316:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1789785410.404384:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf4e9500 x1876725549173504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785410.404401:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549173504:0@lo:400:kworker.0 00010000:00080000:1.0:1789785410.404411:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf4eb480 x1876725549174016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785410.404419:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549174016:0@lo:400:kworker.0 00010000:00080000:1.0:1789785410.404428:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf4e9f80 x1876725549173888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785410.404436:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1876725549173888:0@lo:400:kworker.0 00000100:00080000:1.0:1789785410.405623:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789785410.405634:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789785410.405637:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789785410.406103:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549172736:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1789785410.406162:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafb113df80 x1876725549172992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789785435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785410.406173:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789785410.406182:0:3658:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789785410.406200:0:3658:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789785410.406207:0:3658:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789785410.406212:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9dafa64af800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789785410.406288:0:3658:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789785410.406296:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1876725549172992:0@lo:8:kworker.0 00010000:00080000:3.0:1789785410.406314:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf4e8380 x1876725549173376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789785435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785410.406321:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789785410.406326:0:3658:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789785410.406332:0:3658:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789785410.406335:0:3658:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789785410.406359:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9daf862fe800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789785410.406371:0:3658:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789785410.406375:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1876725549173376:0@lo:8:kworker.0 00000004:00080000:3.0:1789785410.406403:0:17954:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789785410.406754:0:17954:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 518660414942ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789785410.406761:0:17954:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:3.0:1789785410.407024:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf4e9c00 x1876725549173760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785410.407036:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549173760:0@lo:400:kworker.0 00000100:00100000:0.0:1789785410.407375:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549173248 00000100:00100000:0.0:1789785410.407384:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549173248 00000100:00100000:0.0:1789785410.407452:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789785410.407464:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549173248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785410.407595:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549173248:12345-0@lo:400:kworker.0 Request processed in 132us (3749us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785410.407604:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:3.0:1789785410.408866:0:17944:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1789785410.410636:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549174272:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1789785410.410653:0:17238:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1789785410.410687:0:17238:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4eb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17238:1876725549174400:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789785410.417013:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789785410.417804:0:17955:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789785410.417831:0:17955:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84605f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17955:1876725549174656:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1789785410.417893:0:17955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785410.417913:0:17955:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae82a3e0c0 going to sleep for 11 seconds 00000004:00080000:3.0:1789785410.417930:0:17237:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789785410.418020:0:17237:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 518671681365ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789785410.418027:0:17237:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1789785410.418049:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789785410.418059:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549174528:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789785410.418085:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785410.418113:0:19259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549174656 00000100:00100000:3.0:1789785410.418120:0:19259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549174656 00000100:00100000:3.0:1789785410.418188:0:19259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789785410.418198:0:19259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17955:x1876725549174656:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1789785410.420932:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549174272 00000100:00100000:3.0:1789785410.420944:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549174272 00000100:00100000:3.0:1789785410.420985:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549174528 00000100:00100000:3.0:1789785410.420988:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549174528 00000100:00100000:3.0:1789785410.421009:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789785410.421017:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1876725549174272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789785410.421045:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789785410.421123:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1876725549174272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (4117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785410.421131:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789785410.421160:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789785410.421167:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3662:x1876725549174528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789785410.421177:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789785410.421204:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3662:x1876725549174528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (3119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785410.421221:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789785410.421237:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789785410.421275:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae84606a00 x1876725549174528/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785410.421295:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549174528:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789785410.421328:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf4e9f80 x1876725549174272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789785426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785410.421371:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549174272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789785410.423218:0:17238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785410.423280:0:17238:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf88110d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789785410.423377:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549174400 00000100:00100000:1.0:1789785410.423380:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafb113ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549173248:0@lo:400:kworker.0 00000100:00100000:3.0:1789785410.423386:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549174400 00000100:00100000:3.0:1789785410.423442:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789785410.423452:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17238:x1876725549174400:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789785410.423546:0:17191:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1789785410.424597:0:19259:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1789785410.424604:0:19259:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789785410.424693:0:19259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17955:x1876725549174656:12345-0@lo:7:osp-pre-1-1.0 Request processed in 6493us (6796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785410.424703:0:19259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789785410.424831:0:17955:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae84605f80 x1876725549174656/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789785426 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785410.424847:0:17955:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84605f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17955:1876725549174656:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1789785410.424860:0:17955:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789785410.424901:0:17955:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4eaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17955:1876725549174784:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789785410.424941:0:17955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785410.424964:0:17955:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf88110600 going to sleep for 11 seconds 00002000:00080000:0.0:1789785410.425564:0:18720:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1789785410.425571:0:18720:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1789785410.425576:0:18720:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000100:00100000:3.0:1789785410.426435:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549174784 00000100:00100000:3.0:1789785410.426442:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549174784 00000100:00100000:3.0:1789785410.426483:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789785410.426491:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17955:x1876725549174784:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1789785410.426519:0:18717:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1789785410.426579:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17955:x1876725549174784:12345-0@lo:5:osp-pre-1-1.0 Request processed in 89us (1638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785410.426586:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789785410.426631:0:17955:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf4eaa00 x1876725549174784/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789785426 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785410.426644:0:17955:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4eaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17955:1876725549174784:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789785410.426655:0:17955:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789785410.426709:0:17955:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84606a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17955:1876725549174912:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789785410.426738:0:17955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785410.426759:0:17955:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1b4e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785410.426770:0:19259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549174912 00000100:00100000:3.0:1789785410.426773:0:19259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549174912 00000100:00100000:3.0:1789785410.426794:0:19259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789785410.426800:0:19259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17955:x1876725549174912:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1789785410.426822:0:19259:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:0.0:1789785410.434699:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789785410.434711:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d7cf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.436375:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1789785410.436385:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789785410.436393:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d7cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.436415:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d7cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.436439:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d7cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.436447:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d7cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.436470:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789785410.436485:0:18743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789785410.436491:0:18743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d7cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.436499:0:18743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55000 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:0.0:1789785410.436503:0:18743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d7cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.436513:0:18743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d7cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.436542:0:18743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d7cf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.436550:0:18743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d7cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.436571:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785410.436579:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785410.436582:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789785410.440718:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789785410.441707:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b650d63/0x2f18ee3fd845d7d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.441727:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1789785410.441876:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789785410.441883:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b650d63/0x2f18ee3fd845d7d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.441900:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b650d63/0x2f18ee3fd845d7d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.441911:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b650d63/0x2f18ee3fd845d7d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.441919:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b650d63/0x2f18ee3fd845d7d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.441947:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789785410.442981:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789785410.442988:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064be49cb/0x2f18ee3fd845d7dd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.442999:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1789785410.443002:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789785410.443007:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064be49cb/0x2f18ee3fd845d7dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.443027:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064be49cb/0x2f18ee3fd845d7dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.443036:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064be49cb/0x2f18ee3fd845d7dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.443041:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789785410.443045:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064be49cb/0x2f18ee3fd845d7dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.443058:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b650d63/0x2f18ee3fd845d7d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.443073:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789785410.443075:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d54c00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:2.0:1789785410.443084:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b650d63/0x2f18ee3fd845d7d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.443098:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b650d63/0x2f18ee3fd845d7d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.443131:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b650d63/0x2f18ee3fd845d7d6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.443141:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b650d63/0x2f18ee3fd845d7d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.443193:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789785410.443198:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064be49cb/0x2f18ee3fd845d7dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.443205:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55c00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:2.0:1789785410.443208:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064be49cb/0x2f18ee3fd845d7dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.443217:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064be49cb/0x2f18ee3fd845d7dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.443228:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064be49cb/0x2f18ee3fd845d7dd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.443249:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064be49cb/0x2f18ee3fd845d7dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.443264:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785410.443266:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785410.443268:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785410.443689:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789785410.445848:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789785410.445864:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d7e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.445881:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1789785410.445885:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789785410.445892:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d7e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.445906:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d7e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.445916:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d7e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.445937:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d7e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.445961:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789785410.445975:0:18743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789785410.445982:0:18743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d7e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.445989:0:18743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55200 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:0.0:1789785410.445994:0:18743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d7e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.446003:0:18743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d7e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.446021:0:18743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d7e4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.446028:0:18743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d7e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.446050:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785410.446051:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785410.446053:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789785410.448569:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789785410.448589:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d7eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.448606:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1789785410.448611:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789785410.448617:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d7eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.448630:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d7eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.448639:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d7eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.448646:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d7eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.448666:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789785410.449379:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789785410.449386:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d7eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.449396:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55000 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:3.0:1789785410.449400:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d7eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.449410:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d7eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.449429:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d7eb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.449449:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed7c3ce4/0x2f18ee3fd845d7eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.449470:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785410.449472:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785410.449474:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789785410.451064:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789785410.451075:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845d7f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.451090:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1789785410.451095:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789785410.451101:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845d7f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.451113:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845d7f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.451130:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845d7f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.451138:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845d7f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.451165:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789785410.451392:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789785410.451399:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845d7f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.451408:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55400 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:3.0:1789785410.451412:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845d7f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.451421:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845d7f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.451436:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845d7f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.451444:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000019f4e4/0x2f18ee3fd845d7f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.451462:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785410.451464:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785410.451466:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789785410.453837:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789785410.453853:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005de788ae/0x2f18ee3fd845d7f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.453875:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=518s v=(0 0) 00010000:00010000:2.0:1789785410.453894:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785410.453901:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005de788ae/0x2f18ee3fd845d7f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.453919:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005de788ae/0x2f18ee3fd845d7f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.453932:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005de788ae/0x2f18ee3fd845d7f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.453940:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005de788ae/0x2f18ee3fd845d7f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.453963:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789785410.453977:0:18743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789785410.453985:0:18743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005de788ae/0x2f18ee3fd845d7f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.453993:0:18743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09000 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:2.0:1789785410.453999:0:18743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005de788ae/0x2f18ee3fd845d7f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.454009:0:18743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005de788ae/0x2f18ee3fd845d7f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.454028:0:18743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005de788ae/0x2f18ee3fd845d7f9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.454049:0:18743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005de788ae/0x2f18ee3fd845d7f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.454074:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785410.454077:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785410.454079:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789785410.454919:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789785410.454928:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031c8ce79/0x2f18ee3fd845d800 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.454942:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=518s v=(0 0) 00010000:00010000:2.0:1789785410.454946:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785410.454951:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031c8ce79/0x2f18ee3fd845d800 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.454962:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031c8ce79/0x2f18ee3fd845d800 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.454971:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031c8ce79/0x2f18ee3fd845d800 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.454978:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031c8ce79/0x2f18ee3fd845d800 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.455002:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789785410.457099:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789785410.457113:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031c8ce79/0x2f18ee3fd845d800 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.457127:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09600 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:3.0:1789785410.457133:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031c8ce79/0x2f18ee3fd845d800 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.457144:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031c8ce79/0x2f18ee3fd845d800 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.457169:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031c8ce79/0x2f18ee3fd845d800 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.457177:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031c8ce79/0x2f18ee3fd845d800 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.457203:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785410.457205:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785410.457207:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789785410.461977:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789785410.461992:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daef5c74/0x2f18ee3fd845d807 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.462010:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1789785410.462014:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785410.462020:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daef5c74/0x2f18ee3fd845d807 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.462047:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000daef5c74/0x2f18ee3fd845d807 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.462059:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daef5c74/0x2f18ee3fd845d807 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.462067:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000daef5c74/0x2f18ee3fd845d807 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.462093:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789785410.462884:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789785410.462892:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845d80e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.462904:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1789785410.462908:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785410.462913:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845d80e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.462924:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845d80e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.462933:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845d80e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.462954:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845d80e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.462955:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789785410.462975:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000daef5c74/0x2f18ee3fd845d807 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.462988:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789785410.463024:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bac00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785410.463032:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000daef5c74/0x2f18ee3fd845d807 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.463046:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000daef5c74/0x2f18ee3fd845d807 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.463078:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000daef5c74/0x2f18ee3fd845d807 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.463104:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000daef5c74/0x2f18ee3fd845d807 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.463135:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789785410.463139:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845d80e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.463146:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bb000 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785410.463149:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845d80e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.463157:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845d80e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.463168:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845d80e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.463175:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845d80e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.463193:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785410.463198:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785410.463200:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785410.463206:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789785410.467098:0:19533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1789785410.467140:0:19533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789785410.467174:0:19533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789785410.469761:0:19259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17955:x1876725549174912:12345-0@lo:5:osp-pre-1-1.0 Request processed in 42951us (43013us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789785410.469775:0:19259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00002000:00010000:2.0:1789785410.470058:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789785410.470067:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c8a0b35/0x2f18ee3fd845d815 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.470084:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=518s v=(0 0) 00010000:00010000:2.0:1789785410.470089:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785410.470095:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c8a0b35/0x2f18ee3fd845d815 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.470121:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c8a0b35/0x2f18ee3fd845d815 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.470132:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c8a0b35/0x2f18ee3fd845d815 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.470140:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c8a0b35/0x2f18ee3fd845d815 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.470162:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789785410.472958:0:17955:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789785410.472980:0:17955:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84606a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17955:1876725549174912:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1789785410.473004:0:17955:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1789785410.473088:0:17955:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17955:1876725549175040:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1789785410.473170:0:17955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785410.473209:0:17955:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf88110000 going to sleep for 11 seconds 00000100:00100000:3.0:1789785410.474021:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549175040 00000100:00100000:3.0:1789785410.474035:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549175040 00000100:00100000:3.0:1789785410.474091:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789785410.474108:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17955:x1876725549175040:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1789785410.474197:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17955:x1876725549175040:12345-0@lo:900:osp-pre-1-1.0 Request processed in 98us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785410.474206:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789785410.474235:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00080000:1.0:1789785410.474247:0:17955:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbf4e9180 x1876725549175040/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789785426 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1789785410.474254:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c8a0b35/0x2f18ee3fd845d815 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.474296:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09e00 already unused, calling callback (ffffffffc0cc5370) 00000100:00100000:1.0:1789785410.474300:0:17955:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17955:1876725549175040:0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1789785410.474305:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c8a0b35/0x2f18ee3fd845d815 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.474319:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c8a0b35/0x2f18ee3fd845d815 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.474378:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c8a0b35/0x2f18ee3fd845d815 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.474386:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c8a0b35/0x2f18ee3fd845d815 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.474407:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785410.474409:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785410.474411:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789785410.474851:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789785410.474860:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ffa467f/0x2f18ee3fd845d81c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.474888:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1789785410.474894:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789785410.474901:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ffa467f/0x2f18ee3fd845d81c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.474916:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ffa467f/0x2f18ee3fd845d81c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.474928:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ffa467f/0x2f18ee3fd845d81c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.474956:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ffa467f/0x2f18ee3fd845d81c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.474981:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789785410.475870:0:18743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789785410.475881:0:18743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ffa467f/0x2f18ee3fd845d81c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.475892:0:18743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65800 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:2.0:1789785410.475896:0:18743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ffa467f/0x2f18ee3fd845d81c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.475920:0:18743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ffa467f/0x2f18ee3fd845d81c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.475937:0:18743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ffa467f/0x2f18ee3fd845d81c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.475944:0:18743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ffa467f/0x2f18ee3fd845d81c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.475961:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785410.475962:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785410.475964:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789785410.481821:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789785410.481839:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052a025d3/0x2f18ee3fd845d823 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.481860:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1789785410.481866:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785410.481873:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052a025d3/0x2f18ee3fd845d823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.481890:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052a025d3/0x2f18ee3fd845d823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.481902:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052a025d3/0x2f18ee3fd845d823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.481911:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052a025d3/0x2f18ee3fd845d823 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.481948:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789785410.482377:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789785410.482391:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052a025d3/0x2f18ee3fd845d823 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.482406:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814ba800 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:2.0:1789785410.482411:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052a025d3/0x2f18ee3fd845d823 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.482423:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052a025d3/0x2f18ee3fd845d823 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.482444:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052a025d3/0x2f18ee3fd845d823 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.482465:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052a025d3/0x2f18ee3fd845d823 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.482487:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785410.482489:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785410.482490:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789785410.482667:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789785410.482675:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845d82a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.482685:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1789785410.482689:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785410.482693:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845d82a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.482703:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845d82a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.482712:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845d82a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.482720:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845d82a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.482744:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789785410.482813:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789785410.482822:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845d82a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.482832:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bbe00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:2.0:1789785410.482836:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845d82a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.482846:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845d82a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.482859:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845d82a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.482865:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845d82a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.482881:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785410.482882:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785410.482884:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789785410.483183:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789785410.483191:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845d831 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.483201:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1789785410.483212:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785410.483218:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845d831 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.483228:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845d831 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.483238:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845d831 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.483245:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845d831 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.483322:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789785410.483912:0:18743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789785410.483921:0:18743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845d831 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.483932:0:18743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bb400 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:2.0:1789785410.483936:0:18743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845d831 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.483944:0:18743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845d831 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.483962:0:18743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845d831 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.483968:0:18743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845d831 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.483987:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785410.483989:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785410.483991:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789785410.487787:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789785410.487802:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005de788ae/0x2f18ee3fd845d838 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.487824:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=518s v=(0 0) 00010000:00010000:2.0:1789785410.487828:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785410.487836:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005de788ae/0x2f18ee3fd845d838 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.487868:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005de788ae/0x2f18ee3fd845d838 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.487891:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005de788ae/0x2f18ee3fd845d838 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.487899:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005de788ae/0x2f18ee3fd845d838 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785410.487964:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789785410.490130:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789785410.490146:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845d83f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.490176:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1789785410.490191:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785410.490198:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845d83f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.490213:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845d83f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.490224:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845d83f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.490242:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845d83f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.493275:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789785410.493293:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005de788ae/0x2f18ee3fd845d838 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.493309:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b09000 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785410.493315:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005de788ae/0x2f18ee3fd845d838 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.493328:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005de788ae/0x2f18ee3fd845d838 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.493564:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005de788ae/0x2f18ee3fd845d838 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.493574:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005de788ae/0x2f18ee3fd845d838 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.493595:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789785410.493599:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845d83f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.493620:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bb000 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785410.493623:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845d83f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.493631:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845d83f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.493642:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845d83f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.493650:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785410.493651:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785410.493653:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785410.500692:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789785410.500715:0:18720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0030293/0x2f18ee3fd845d83f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789785410.502940:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789785410.502960:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daef5c74/0x2f18ee3fd845d846 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.502985:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1789785410.502991:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785410.502998:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daef5c74/0x2f18ee3fd845d846 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.503018:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000daef5c74/0x2f18ee3fd845d846 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.503031:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daef5c74/0x2f18ee3fd845d846 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.503040:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000daef5c74/0x2f18ee3fd845d846 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.503089:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789785410.503108:0:18743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789785410.503117:0:18743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000daef5c74/0x2f18ee3fd845d846 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.503126:0:18743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bac00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:3.0:1789785410.503132:0:18743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000daef5c74/0x2f18ee3fd845d846 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.503142:0:18743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000daef5c74/0x2f18ee3fd845d846 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.503166:0:18743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000daef5c74/0x2f18ee3fd845d846 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.503174:0:18743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000daef5c74/0x2f18ee3fd845d846 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.503197:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785410.503199:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785410.503201:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785410.503501:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789785410.513955:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789785410.513976:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000625a2439/0x2f18ee3fd845d84d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.513998:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1789785410.514022:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785410.514031:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000625a2439/0x2f18ee3fd845d84d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.514052:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000625a2439/0x2f18ee3fd845d84d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.514064:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000625a2439/0x2f18ee3fd845d84d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.514072:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000625a2439/0x2f18ee3fd845d84d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.514102:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789785410.515065:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789785410.515084:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000625a2439/0x2f18ee3fd845d84d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.515099:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814ba400 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785410.515106:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000625a2439/0x2f18ee3fd845d84d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.515170:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000625a2439/0x2f18ee3fd845d84d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.515264:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000625a2439/0x2f18ee3fd845d84d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.515290:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000625a2439/0x2f18ee3fd845d84d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.515321:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785410.515323:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785410.515325:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789785410.528872:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789785410.528890:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d854 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.528913:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1789785410.528918:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789785410.528925:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.528943:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.528956:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.528965:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.529005:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789785410.530127:0:18743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789785410.530139:0:18743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.530152:0:18743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55200 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:3.0:1789785410.530158:0:18743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.530168:0:18743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d854 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.530192:0:18743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d854 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.530217:0:18743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c46f3dc0/0x2f18ee3fd845d854 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.530243:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785410.530245:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785410.530247:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789785410.530592:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789785410.530607:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f10123fd/0x2f18ee3fd845d85b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.530624:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1789785410.530628:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789785410.530635:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f10123fd/0x2f18ee3fd845d85b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.530876:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f10123fd/0x2f18ee3fd845d85b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.530889:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f10123fd/0x2f18ee3fd845d85b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.530897:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f10123fd/0x2f18ee3fd845d85b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.530927:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789785410.531514:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789785410.531526:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000752b0cce/0x2f18ee3fd845d862 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.531547:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1789785410.531551:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789785410.531555:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000752b0cce/0x2f18ee3fd845d862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.531564:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000752b0cce/0x2f18ee3fd845d862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.531573:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000752b0cce/0x2f18ee3fd845d862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.531580:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000752b0cce/0x2f18ee3fd845d862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.531601:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789785410.531639:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789785410.531653:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f10123fd/0x2f18ee3fd845d85b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.531665:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65000 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:0.0:1789785410.531669:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f10123fd/0x2f18ee3fd845d85b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.531679:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f10123fd/0x2f18ee3fd845d85b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.531700:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f10123fd/0x2f18ee3fd845d85b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.531708:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f10123fd/0x2f18ee3fd845d85b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.531733:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789785410.531737:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000752b0cce/0x2f18ee3fd845d862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.531744:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a64200 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:0.0:1789785410.531747:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000752b0cce/0x2f18ee3fd845d862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.531772:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000752b0cce/0x2f18ee3fd845d862 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.531782:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000752b0cce/0x2f18ee3fd845d862 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.531799:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000752b0cce/0x2f18ee3fd845d862 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.531814:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785410.531816:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785410.531817:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789785410.532081:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789785410.532086:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ffa467f/0x2f18ee3fd845d869 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.532092:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1789785410.532094:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789785410.532097:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ffa467f/0x2f18ee3fd845d869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.532103:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ffa467f/0x2f18ee3fd845d869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.532200:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ffa467f/0x2f18ee3fd845d869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.532207:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ffa467f/0x2f18ee3fd845d869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.532222:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789785410.533674:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789785410.533681:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8fb2210/0x2f18ee3fd845d870 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.533693:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1789785410.533696:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789785410.533701:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8fb2210/0x2f18ee3fd845d870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.533724:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8fb2210/0x2f18ee3fd845d870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.533732:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8fb2210/0x2f18ee3fd845d870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.533739:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8fb2210/0x2f18ee3fd845d870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.533768:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789785410.534220:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789785410.534226:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff27134a/0x2f18ee3fd845d877 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.534234:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1789785410.534238:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789785410.534242:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff27134a/0x2f18ee3fd845d877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.534307:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff27134a/0x2f18ee3fd845d877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.534316:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff27134a/0x2f18ee3fd845d877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.534324:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff27134a/0x2f18ee3fd845d877 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.534333:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1789785410.534699:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789785410.534761:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ef93fb0/0x2f18ee3fd845d87e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.534772:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1789785410.534782:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789785410.534846:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ef93fb0/0x2f18ee3fd845d87e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.534858:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ef93fb0/0x2f18ee3fd845d87e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.534867:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ef93fb0/0x2f18ee3fd845d87e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.534874:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ef93fb0/0x2f18ee3fd845d87e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.534883:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1789785410.535322:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789785410.535328:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000817994b2/0x2f18ee3fd845d885 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.535448:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1789785410.535453:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789785410.535458:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000817994b2/0x2f18ee3fd845d885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.535471:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000817994b2/0x2f18ee3fd845d885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.535480:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000817994b2/0x2f18ee3fd845d885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.535490:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789785410.535498:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000817994b2/0x2f18ee3fd845d885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.535505:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ffa467f/0x2f18ee3fd845d869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.535520:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65800 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:3.0:1789785410.535525:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ffa467f/0x2f18ee3fd845d869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.535528:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1789785410.535557:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ffa467f/0x2f18ee3fd845d869 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.535582:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ffa467f/0x2f18ee3fd845d869 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.535590:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ffa467f/0x2f18ee3fd845d869 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.535620:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789785410.535624:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8fb2210/0x2f18ee3fd845d870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.535640:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65400 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:3.0:1789785410.535643:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8fb2210/0x2f18ee3fd845d870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.535651:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8fb2210/0x2f18ee3fd845d870 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.535662:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8fb2210/0x2f18ee3fd845d870 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.535670:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8fb2210/0x2f18ee3fd845d870 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.535684:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789785410.535687:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff27134a/0x2f18ee3fd845d877 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.535693:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a64e00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:3.0:1789785410.535697:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff27134a/0x2f18ee3fd845d877 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.535704:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff27134a/0x2f18ee3fd845d877 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.535713:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff27134a/0x2f18ee3fd845d877 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.535726:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff27134a/0x2f18ee3fd845d877 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.535740:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789785410.535744:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ef93fb0/0x2f18ee3fd845d87e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.535885:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a65c00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:3.0:1789785410.535892:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ef93fb0/0x2f18ee3fd845d87e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.535900:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ef93fb0/0x2f18ee3fd845d87e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.535914:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ef93fb0/0x2f18ee3fd845d87e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.535922:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ef93fb0/0x2f18ee3fd845d87e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.535939:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789785410.535943:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000817994b2/0x2f18ee3fd845d885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.535949:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a64400 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:3.0:1789785410.535961:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000817994b2/0x2f18ee3fd845d885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.535970:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000817994b2/0x2f18ee3fd845d885 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.535982:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000817994b2/0x2f18ee3fd845d885 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789785410.535983:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789785410.536004:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000817994b2/0x2f18ee3fd845d885 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.536006:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000317b68d6/0x2f18ee3fd845d88c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.536039:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785410.536041:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785410.536043:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785410.536087:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1789785410.536091:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789785410.536096:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000317b68d6/0x2f18ee3fd845d88c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.536108:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000317b68d6/0x2f18ee3fd845d88c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.536117:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000317b68d6/0x2f18ee3fd845d88c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785410.536123:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000317b68d6/0x2f18ee3fd845d88c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785410.536130:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785410.536201:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1789785410.536247:0:18720:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:1.0:1789785410.536398:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17238:x1876725549174400:12345-0@lo:5:osp-pre-1-0.0 Request processed in 112941us (113180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785410.536418:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789785410.536466:0:17238:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4eb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17238:1876725549174400:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789785410.536479:0:17238:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1789785410.536521:0:17238:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4eb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17238:1876725549175168:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789785410.536569:0:17238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785410.536592:0:17238:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc19c4240 going to sleep for 11 seconds 00000100:00100000:1.0:1789785410.536607:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549175168 00000100:00100000:1.0:1789785410.536613:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549175168 00000100:00100000:1.0:1789785410.536654:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789785410.536664:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17238:x1876725549175168:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789785410.536696:0:18717:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:3.0:1789785410.541454:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789785410.541456:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785410.541467:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000317b68d6/0x2f18ee3fd845d88c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.541483:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc21cb200 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:3.0:1789785410.541488:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000317b68d6/0x2f18ee3fd845d88c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.541500:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000317b68d6/0x2f18ee3fd845d88c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.541521:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000317b68d6/0x2f18ee3fd845d88c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.541551:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000317b68d6/0x2f18ee3fd845d88c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785410.541577:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785410.541579:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789785410.541581:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785410.543676:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17238:x1876725549175168:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7008us (7101us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789785410.543689:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789785410.544759:0:17238:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4eb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17238:1876725549175168:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789785410.544783:0:17238:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:0.0:1789785411.266817:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789785411.598023:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789785412.291007:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789785412.896769:0:19889:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789785413.316546:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789785413.833315:0:19941:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789785413.833572:0:19941:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789785414.339551:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789785414.718938:0:19991:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789785414.719261:0:19991:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789785415.132269:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785415.132414:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530218496 00000100:00100000:2.0:1789785415.132425:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530218496 00000100:00100000:2.0:1789785415.132470:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 113 00000100:00100000:2.0:1789785415.132810:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2396:x1876725530218496:12345-192.168.203.46@tcp:250:mount.lustre.0 00010000:00080000:2.0:1789785415.132840:0:17205:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 49f881b2-94cc-4d23-9aec-10664f83ddca@192.168.203.46@tcp t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:2.0:1789785415.132868:0:17205:0:(genops.c:1385:class_connect()) connect: client 49f881b2-94cc-4d23-9aec-10664f83ddca, cookie 0x2f18ee3fd845d893 00000100:00080000:2.0:1789785415.132999:0:17205:0:(import.c:65:import_set_state_nolock()) ffff9dae82591000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789785415.133374:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49f881b2-94cc-4d23-9aec-10664f83ddca+5:2396:x1876725530218496:12345-192.168.203.46@tcp:250:mount.lustre.0 Request processed in 893us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785415.133382:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 113 00000100:00100000:3.0:1789785415.138488:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785415.138711:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530218624 00000100:00100000:2.0:1789785415.138721:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530218624 00000100:00100000:2.0:1789785415.138780:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 114 00000100:00100000:2.0:1789785415.138800:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+5:14905:x1876725530218624:12345-192.168.203.46@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789785415.138822:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785415.138839:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1b09400/0x2f18ee3fd845d89a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8a14 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785415.138864:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1b09400/0x2f18ee3fd845d89a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8a14 expref: 6 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785415.138877:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1b09400/0x2f18ee3fd845d89a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8a14 expref: 6 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785415.138885:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b09400, rc 0) 00000100:00100000:2.0:1789785415.138940:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+6:14905:x1876725530218624:12345-192.168.203.46@tcp:101:mount.lustre.0 Request processed in 141us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785415.138946:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 114 00000100:00100000:1.0:1789785415.157173:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785415.158983:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530218752 00000100:00100000:2.0:1789785415.158996:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530218752 00000100:00100000:2.0:1789785415.159070:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 115 00000100:00100000:2.0:1789785415.159079:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49f881b2-94cc-4d23-9aec-10664f83ddca+6:14905:x1876725530218752:12345-192.168.203.46@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789785415.159316:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49f881b2-94cc-4d23-9aec-10664f83ddca+6:14905:x1876725530218752:12345-192.168.203.46@tcp:501:mount.lustre.0 Request processed in 135us (2050us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789785415.159327:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 115 00000100:00100000:3.0:1789785415.162991:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785415.165707:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530218880 00000100:00100000:0.0:1789785415.165721:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530218880 00000100:00100000:0.0:1789785415.165796:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 116 00000100:00100000:0.0:1789785415.165807:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf459850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49f881b2-94cc-4d23-9aec-10664f83ddca+6:14905:x1876725530218880:12345-192.168.203.46@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789785415.165978:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785415.165997:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafb5d54c00/0x2f18ee3fd845d8a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8a1b expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785415.166045:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafb5d54c00/0x2f18ee3fd845d8a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8a1b expref: 7 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785415.166057:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafb5d54c00/0x2f18ee3fd845d8a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8a1b expref: 7 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785415.166066:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d54c00, rc 0) 00000100:00100000:0.0:1789785415.166130:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf459850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49f881b2-94cc-4d23-9aec-10664f83ddca+7:14905:x1876725530218880:12345-192.168.203.46@tcp:101:mount.lustre.0 Request processed in 325us (3147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785415.166138:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 116 00000100:00100000:3.0:1789785415.177726:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785415.177786:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530219008 00000100:00100000:0.0:1789785415.177797:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530219008 00000100:00100000:0.0:1789785415.177861:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 117 00000100:00100000:0.0:1789785415.177872:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf45b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+7:14905:x1876725530219008:12345-192.168.203.46@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789785415.178070:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf45b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+8:14905:x1876725530219008:12345-192.168.203.46@tcp:501:mount.lustre.0 Request processed in 199us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785415.178078:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 117 00000100:00100000:3.0:1789785415.193036:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785415.193141:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530219136 00000100:00100000:2.0:1789785415.193151:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530219136 00000100:00100000:2.0:1789785415.193214:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 118 00000100:00100000:2.0:1789785415.193223:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf45a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49f881b2-94cc-4d23-9aec-10664f83ddca+8:14905:x1876725530219136:12345-192.168.203.46@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789785415.193373:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf45a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49f881b2-94cc-4d23-9aec-10664f83ddca+8:14905:x1876725530219136:12345-192.168.203.46@tcp:503:mount.lustre.0 Request processed in 150us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785415.193380:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 118 00000100:00100000:3.0:1789785415.199183:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785415.200616:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530219264 00000100:00100000:1.0:1789785415.200632:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530219264 00000100:00100000:1.0:1789785415.200792:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 119 00000100:00100000:1.0:1789785415.200804:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf458850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49f881b2-94cc-4d23-9aec-10664f83ddca+8:14923:x1876725530219264:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789785415.200965:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf458850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49f881b2-94cc-4d23-9aec-10664f83ddca+8:14923:x1876725530219264:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 162us (1797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785415.200973:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 119 00000100:00100000:3.0:1789785415.258062:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785415.258236:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530219392 00000100:00100000:0.0:1789785415.258249:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530219392 00000100:00100000:0.0:1789785415.258330:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 120 00000100:00100000:0.0:1789785415.258388:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf45a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+8:14923:x1876725530219392:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789785415.258606:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf45a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+8:14923:x1876725530219392:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 220us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785415.258616:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 120 00000100:00100000:2.0:1789785415.268012:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785415.268253:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530219520 00000100:00100000:1.0:1789785415.268281:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530219520 00000100:00100000:1.0:1789785415.268397:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 121 00000100:00100000:1.0:1789785415.268409:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49f881b2-94cc-4d23-9aec-10664f83ddca+8:14923:x1876725530219520:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789785415.268615:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49f881b2-94cc-4d23-9aec-10664f83ddca+8:14923:x1876725530219520:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 207us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785415.268624:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 121 00000100:00100000:3.0:1789785415.280786:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785415.281333:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530219648 00000100:00100000:2.0:1789785415.281391:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530219648 00000100:00100000:2.0:1789785415.281464:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 122 00000100:00100000:2.0:1789785415.281476:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf45a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49f881b2-94cc-4d23-9aec-10664f83ddca+8:14905:x1876725530219648:12345-192.168.203.46@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789785415.281507:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785415.281537:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1b08c00/0x2f18ee3fd845d8a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8a4c expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785415.281571:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1b08c00/0x2f18ee3fd845d8a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8a4c expref: 9 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785415.281584:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1b08c00/0x2f18ee3fd845d8a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8a4c expref: 9 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785415.281595:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b08c00, rc 0) 00000100:00100000:2.0:1789785415.281678:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf45a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49f881b2-94cc-4d23-9aec-10664f83ddca+9:14905:x1876725530219648:12345-192.168.203.46@tcp:101:mount.lustre.0 Request processed in 203us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785415.281685:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 122 00000100:00100000:3.0:1789785415.291433:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785415.291749:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530219776 00000100:00100000:0.0:1789785415.291778:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530219776 00000100:00100000:0.0:1789785415.291852:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 123 00000100:00100000:0.0:1789785415.291864:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf459450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+9:14905:x1876725530219776:12345-192.168.203.46@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789785415.291901:0:17206:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789785415.291923:0:17206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789785415.291929:0:17206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789785415.291932:0:17206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789785415.291935:0:17206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789785415.291938:0:17206:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1789785415.299284:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf459450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+9:14905:x1876725530219776:12345-192.168.203.46@tcp:256:mount.lustre.0 Request processed in 7404us (7848us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785415.299302:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 123 00000100:00100000:3.0:1789785415.307803:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785415.308681:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530219904 00000100:00100000:1.0:1789785415.308694:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530219904 00000100:00100000:0.0:1789785415.308907:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 124 00000100:00100000:0.0:1789785415.308920:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf458c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49f881b2-94cc-4d23-9aec-10664f83ddca+9:14905:x1876725530219904:12345-192.168.203.46@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789785415.308942:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785415.308979:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafb5d55c00/0x2f18ee3fd845d8af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8a53 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785415.309017:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafb5d55c00/0x2f18ee3fd845d8af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8a53 expref: 10 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785415.309031:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafb5d55c00/0x2f18ee3fd845d8af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8a53 expref: 10 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785415.309041:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d55c00, rc 0) 00000100:00100000:0.0:1789785415.309127:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf458c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49f881b2-94cc-4d23-9aec-10664f83ddca+10:14905:x1876725530219904:12345-192.168.203.46@tcp:101:mount.lustre.0 Request processed in 209us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785415.309136:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 124 00000100:00100000:3.0:1789785415.313449:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785415.313624:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530220032 00000100:00100000:0.0:1789785415.313637:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530220032 00000100:00100000:0.0:1789785415.313708:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 125 00000100:00100000:0.0:1789785415.313719:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf45b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+10:14905:x1876725530220032:12345-192.168.203.46@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789785415.314075:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf45b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+10:14905:x1876725530220032:12345-192.168.203.46@tcp:501:mount.lustre.0 Request processed in 356us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785415.314084:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 125 00000100:00100000:3.0:1789785415.327545:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785415.328079:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530220160 00000100:00100000:0.0:1789785415.328091:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530220160 00000100:00100000:0.0:1789785415.328160:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 126 00000100:00100000:0.0:1789785415.328170:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf458450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49f881b2-94cc-4d23-9aec-10664f83ddca+10:14905:x1876725530220160:12345-192.168.203.46@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789785415.328424:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf458450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49f881b2-94cc-4d23-9aec-10664f83ddca+10:14905:x1876725530220160:12345-192.168.203.46@tcp:503:mount.lustre.0 Request processed in 253us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785415.328433:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 126 00000100:00100000:2.0:1789785415.342719:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785415.343381:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530220288 00000100:00100000:3.0:1789785415.343395:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530220288 00000100:00100000:3.0:1789785415.343484:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 127 00000100:00100000:3.0:1789785415.343504:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf45b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49f881b2-94cc-4d23-9aec-10664f83ddca+10:14928:x1876725530220288:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789785415.343724:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf45b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49f881b2-94cc-4d23-9aec-10664f83ddca+10:14928:x1876725530220288:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 228us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785415.343733:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 127 00000100:00100000:3.0:1789785415.352924:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785415.354801:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530220416 00000100:00100000:2.0:1789785415.354821:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530220416 00000100:00100000:2.0:1789785415.354941:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 128 00000100:00100000:2.0:1789785415.354964:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+10:14928:x1876725530220416:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789785415.357258:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+10:14928:x1876725530220416:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 2300us (4342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785415.357270:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 128 00010000:00010000:0.0:1789785415.366395:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785415.375851:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785415.376006:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785415.376783:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785415.376890:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530221184 00000100:00100000:0.0:1789785415.376902:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530221184 00000100:00100000:0.0:1789785415.377039:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 129 00000100:00100000:0.0:1789785415.377052:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49f881b2-94cc-4d23-9aec-10664f83ddca+10:2400:x1876725530221184:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785415.377544:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530220544 00000100:00100000:1.0:1789785415.377571:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530220544 00000100:00100000:1.0:1789785415.377650:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530220800 00000100:00100000:1.0:1789785415.377653:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530220800 00000100:00100000:1.0:1789785415.377681:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:1.0:1789785415.377689:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf82c82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1876725530220544:12345-192.168.203.46@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789785415.377713:0:19042:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 251bae80-9c0c-4669-a294-80064a3e231a@192.168.203.46@tcp t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:1.0:1789785415.377792:0:19042:0:(genops.c:1385:class_connect()) connect: client 251bae80-9c0c-4669-a294-80064a3e231a, cookie 0x2f18ee3fd845d8b6 00000004:00100000:1.0:1789785415.377825:0:19042:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789785415.377836:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49f881b2-94cc-4d23-9aec-10664f83ddca+10:2400:x1876725530221184:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 782us (1823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785415.377850:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 129 00000100:00100000:0.0:1789785415.377932:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 8 00000100:00100000:0.0:1789785415.377942:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1876725530220800:12345-192.168.203.46@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789785415.377995:0:17212:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 251bae80-9c0c-4669-a294-80064a3e231a@192.168.203.46@tcp t0 exp 0000000000000000 cur 523 last 0 00000100:00080000:1.0:1789785415.378046:0:19042:0:(import.c:65:import_set_state_nolock()) ffff9dae84430800 : changing import state from RECOVER to FULL 00000020:00000080:0.0:1789785415.378069:0:17212:0:(genops.c:1385:class_connect()) connect: client 251bae80-9c0c-4669-a294-80064a3e231a, cookie 0x2f18ee3fd845d8bd 00000100:00100000:1.0:1789785415.378115:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf82c82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+6:2396:x1876725530220544:12345-192.168.203.46@tcp:38:mount.lustre.0 Request processed in 423us (2277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785415.378123:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 7 00000004:00100000:0.0:1789785415.380188:0:17212:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789785415.380540:0:17212:0:(import.c:65:import_set_state_nolock()) ffff9dae827a5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789785415.380648:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251bae80-9c0c-4669-a294-80064a3e231a+6:2396:x1876725530220800:12345-192.168.203.46@tcp:38:mount.lustre.0 Request processed in 2704us (3866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785415.380661:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 8 00000100:00100000:3.0:1789785415.399047:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785415.399094:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785415.399145:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785415.399290:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530221056 00000100:00100000:1.0:1789785415.399307:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530221056 00000100:00080000:3.0:1789785415.399561:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789785415.404617:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530220928 00000100:00100000:2.0:1789785415.404631:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530220928 00000100:00100000:2.0:1789785415.404779:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530220672 00000100:00100000:2.0:1789785415.404783:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530220672 00000100:00100000:2.0:1789785415.404808:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00100000:2.0:1789785415.404818:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251bae80-9c0c-4669-a294-80064a3e231a+7:14905:x1876725530221056:12345-192.168.203.46@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789785415.404855:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00080000:3.0:1789785415.404947:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789785415.404957:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251bae80-9c0c-4669-a294-80064a3e231a+7:14905:x1876725530221056:12345-192.168.203.46@tcp:41:mount.lustre.0 Request processed in 138us (5924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785415.404966:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00100000:2.0:1789785415.404986:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:2.0:1789785415.404993:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251bae80-9c0c-4669-a294-80064a3e231a+6:0:x1876725530220928:12345-192.168.203.46@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789785415.405010:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789785415.405047:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251bae80-9c0c-4669-a294-80064a3e231a+6:0:x1876725530220928:12345-192.168.203.46@tcp:41:mount.lustre.0 Request processed in 54us (5952us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785415.405053:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:2.0:1789785415.405068:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:2.0:1789785415.405075:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251bae80-9c0c-4669-a294-80064a3e231a+6:0:x1876725530220672:12345-192.168.203.46@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789785415.405101:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789785415.405126:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251bae80-9c0c-4669-a294-80064a3e231a+6:0:x1876725530220672:12345-192.168.203.46@tcp:41:mount.lustre.0 Request processed in 52us (5983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785415.405205:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:3.0:1789785415.408894:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785415.410148:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530221312 00000100:00100000:2.0:1789785415.410164:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530221312 00000100:00100000:2.0:1789785415.410246:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00100000:2.0:1789785415.410259:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251bae80-9c0c-4669-a294-80064a3e231a+6:14905:x1876725530221312:12345-192.168.203.46@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789785415.410408:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251bae80-9c0c-4669-a294-80064a3e231a+6:14905:x1876725530221312:12345-192.168.203.46@tcp:40:mount.lustre.0 Request processed in 151us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785415.410417:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00100000:2.0:1789785415.426676:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785415.426733:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785415.426769:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785415.426857:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530221696 00000100:00100000:0.0:1789785415.426869:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530221696 00000100:00100000:0.0:1789785415.426929:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 3 00000100:00100000:0.0:1789785415.426940:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:251bae80-9c0c-4669-a294-80064a3e231a+6:14905:x1876725530221696:12345-192.168.203.46@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789785415.427043:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:251bae80-9c0c-4669-a294-80064a3e231a+6:14905:x1876725530221696:12345-192.168.203.46@tcp:900:mount.lustre.0 Request processed in 104us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785415.427051:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 3 00000040:00080000:3.0:1789785415.427177:0:17971:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789785415.427281:0:19259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530221440 00000100:00100000:1.0:1789785415.427286:0:19259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530221440 00000100:00100000:1.0:1789785415.427315:0:19259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530221568 00000100:00100000:1.0:1789785415.427318:0:19259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530221568 00000100:00100000:1.0:1789785415.427358:0:19259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:1.0:1789785415.427381:0:19259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2396:x1876725530221440:12345-192.168.203.46@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789785415.427414:0:19259:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 251bae80-9c0c-4669-a294-80064a3e231a@192.168.203.46@tcp t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:1.0:1789785415.427467:0:19259:0:(genops.c:1385:class_connect()) connect: client 251bae80-9c0c-4669-a294-80064a3e231a, cookie 0x2f18ee3fd845d8c4 00002000:00100000:1.0:1789785415.427483:0:19259:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 251bae80-9c0c-4669-a294-80064a3e231a/ffff9dae84436000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789785415.427514:0:19259:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789785415.427760:0:19259:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789785415.427795:0:19259:0:(import.c:65:import_set_state_nolock()) ffff9dae84431800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789785415.427840:0:19259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251bae80-9c0c-4669-a294-80064a3e231a+6:2396:x1876725530221440:12345-192.168.203.46@tcp:8:mount.lustre.0 Request processed in 458us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785415.427847:0:19259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:1.0:1789785415.427864:0:19259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 18 00000100:00100000:1.0:1789785415.427868:0:19259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2396:x1876725530221568:12345-192.168.203.46@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789785415.427884:0:19259:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 251bae80-9c0c-4669-a294-80064a3e231a@192.168.203.46@tcp t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:1.0:1789785415.427902:0:19259:0:(genops.c:1385:class_connect()) connect: client 251bae80-9c0c-4669-a294-80064a3e231a, cookie 0x2f18ee3fd845d8cb 00002000:00100000:1.0:1789785415.427908:0:19259:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 251bae80-9c0c-4669-a294-80064a3e231a/ffff9dae84434000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789785415.427921:0:19259:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789785415.428282:0:19259:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789785415.428301:0:19259:0:(import.c:65:import_set_state_nolock()) ffff9dae84435800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789785415.428325:0:19259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251bae80-9c0c-4669-a294-80064a3e231a+6:2396:x1876725530221568:12345-192.168.203.46@tcp:8:mount.lustre.0 Request processed in 456us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785415.428333:0:19259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 18 00000100:00100000:2.0:1789785415.441158:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785415.441612:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530221824 00000100:00100000:3.0:1789785415.441624:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530221824 00000100:00100000:3.0:1789785415.441689:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 0 00000100:00100000:3.0:1789785415.441702:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafb113d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251bae80-9c0c-4669-a294-80064a3e231a+6:14905:x1876725530221824:12345-192.168.203.46@tcp:33:mount.lustre.0 00000004:00080000:3.0:1789785415.445409:0:17214:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3436us 00000100:00100000:1.0:1789785415.490631:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549175680:0@lo:400:kworker.0 00000100:00100000:1.0:1789785415.490723:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785415.490797:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549176192:0@lo:400:kworker.0 00000100:00100000:1.0:1789785415.490950:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785415.491048:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1876725549176704:0@lo:400:kworker.0 00000100:00100000:1.0:1789785415.491080:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785415.491113:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1789785415.491120:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad642144-cf43-4df2-a5e5-a426cdb5453e:3661:1876725549175296:0@lo:400:kworker.0 00000100:00100000:1.0:1789785415.491152:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785415.491174:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725549175808:0@lo:400:kworker.0 00000100:00100000:1.0:1789785415.491198:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785415.491214:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549176320:0@lo:400:kworker.0 00000100:00100000:1.0:1789785415.491452:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785415.491532:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549176832:0@lo:400:kworker.0 00000100:00100000:1.0:1789785415.491570:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785415.491620:0:19259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549175680 00000100:00100000:1.0:1789785415.491628:0:19259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549175680 00000100:00100000:1.0:1789785415.491682:0:19259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549176192 00000100:00100000:1.0:1789785415.491685:0:19259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549176192 00000100:00100000:1.0:1789785415.491851:0:19259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789785415.491861:0:19259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3661:x1876725549175680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785415.491915:0:19259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3661:x1876725549175680:12345-0@lo:400:kworker.0 Request processed in 55us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785415.491922:0:19259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789785415.491939:0:19259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789785415.491945:0:19259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549176192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785415.491971:0:19259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549176192:12345-0@lo:400:kworker.0 Request processed in 27us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785415.492002:0:19259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789785415.492026:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549176704 00000100:00100000:1.0:1789785415.492030:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549176704 00000100:00100000:1.0:1789785415.492046:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549175808 00000100:00100000:1.0:1789785415.492049:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549175808 00000100:00100000:1.0:1789785415.492057:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549176320 00000100:00100000:1.0:1789785415.492059:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549176320 00000100:00100000:1.0:1789785415.492068:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549176832 00000100:00100000:1.0:1789785415.492070:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549176832 00000100:00100000:1.0:1789785415.492085:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789785415.492093:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1876725549176704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785415.492133:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1876725549176704:12345-0@lo:400:kworker.0 Request processed in 40us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785415.492140:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789785415.492155:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789785415.492166:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725549175808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785415.492182:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549175424:0@lo:400:kworker.0 00000100:00100000:1.0:1789785415.492199:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725549175808:12345-0@lo:400:kworker.0 Request processed in 35us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785415.492206:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789785415.492217:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789785415.492222:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549176320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785415.492246:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549176320:12345-0@lo:400:kworker.0 Request processed in 24us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785415.492251:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789785415.492261:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789785415.492267:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549176832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785415.492306:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549176832:12345-0@lo:400:kworker.0 Request processed in 39us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785415.492312:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789785415.492335:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785415.492411:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549175936:0@lo:400:kworker.0 00010000:00080000:1.0:1789785415.492427:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafaca26300 x1876725549175808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785415.492444:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785415.492444:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725549175808:0@lo:400:kworker.0 00010000:00080000:1.0:1789785415.492465:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafaca26a00 x1876725549176320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785415.492475:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549176320:0@lo:400:kworker.0 00000100:00100000:2.0:1789785415.492478:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549176448:0@lo:400:kworker.0 00010000:00080000:1.0:1789785415.492492:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafaca26d80 x1876725549176832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789785415.492515:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785415.492538:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549176960:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789785415.492557:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785415.492576:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1789785415.492582:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf4e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549175552:0@lo:400:kworker.0 00000100:00100000:2.0:1789785415.492634:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785415.492636:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549175424 00000100:00100000:0.0:1789785415.492646:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549175424 00000100:00100000:2.0:1789785415.492664:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549176064:0@lo:400:kworker.0 00000100:00100000:0.0:1789785415.492690:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549175936 00000100:00100000:2.0:1789785415.492696:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785415.492696:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549175936 00000100:00100000:0.0:1789785415.492722:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549176960 00000100:00100000:0.0:1789785415.492728:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549176960 00000100:00100000:2.0:1789785415.492732:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549176576:0@lo:400:kworker.0 00000100:00100000:0.0:1789785415.492748:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789785415.492760:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549175424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785415.492769:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785415.492792:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549177088:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789785415.492811:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785415.492877:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549177088 00000100:00100000:0.0:1789785415.492879:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549175424:12345-0@lo:400:kworker.0 Request processed in 120us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785415.492883:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549177088 00000100:00100000:0.0:1789785415.492896:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789785415.492926:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789785415.493076:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789785415.493092:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549177216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789785415.493129:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785415.493195:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549177216 00000100:00100000:3.0:1789785415.493199:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549177216 00000100:00100000:3.0:1789785415.493242:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789785415.493251:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549177216:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789785415.493281:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549176832:0@lo:400:kworker.0 00002000:00000024:3.0:1789785415.493282:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789785415.493361:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549177216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785415.493370:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789785415.493411:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae846a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549177344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789785415.493451:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785415.493506:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549177216:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789785415.493545:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789785415.493550:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789785415.493553:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789785415.493556:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789785415.493564:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549177344 00000100:00100000:3.0:1789785415.493568:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549177344 00000100:00100000:1.0:1789785415.493596:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549175680:0@lo:400:kworker.0 00000100:00100000:3.0:1789785415.493602:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789785415.493615:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549177344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789785415.493628:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789785415.493629:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549176192:0@lo:400:kworker.0 00010000:00080000:1.0:1789785415.493652:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafaca24a80 x1876725549176704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785415.493664:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1876725549176704:0@lo:400:kworker.0 00000100:00100000:3.0:1789785415.493674:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549177344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785415.493682:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789785415.493710:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789785415.493744:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae846a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549177344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789785415.493813:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549176448 00000100:00100000:1.0:1789785415.493819:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549176448 00000100:00100000:1.0:1789785415.493862:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549176576 00000100:00100000:1.0:1789785415.493866:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549176576 00000100:00100000:1.0:1789785415.493885:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789785415.493893:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549176448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785415.493955:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876725549176448:12345-0@lo:400:kworker.0 Request processed in 63us (1439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785415.493962:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789785415.493976:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789785415.493982:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549176576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785415.494290:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549176576:12345-0@lo:400:kworker.0 Request processed in 307us (1521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785415.494297:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789785415.494382:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3659:x1876725549175936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785415.494460:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3659:x1876725549175936:12345-0@lo:400:kworker.0 Request processed in 1527us (2019us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785415.495718:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549177600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789785415.495780:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785415.495876:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789785415.495885:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549177472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789785415.495914:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785415.495958:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549177600 00000100:00100000:3.0:1789785415.496209:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549177600 00000100:00100000:3.0:1789785415.496250:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549177472 00000100:00100000:3.0:1789785415.496253:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549177472 00000100:00100000:3.0:1789785415.496266:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789785415.496393:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1876725549177600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789785415.496717:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789785415.496790:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1876725549177600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 401us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785415.496797:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789785415.496901:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789785415.496908:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549177472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789785415.496921:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789785415.497071:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549177472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785415.497084:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789785415.497108:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789785415.497114:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789785415.497170:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549177472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789785415.497189:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549177600:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789785415.497722:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafaca25500 x1876725549176576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785415.497737:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549176576:0@lo:400:kworker.0 00000100:00100000:3.0:1789785415.497755:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549175424:0@lo:400:kworker.0 00000100:00100000:3.0:1789785415.497770:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549175936:0@lo:400:kworker.0 00010000:00080000:3.0:1789785415.497784:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafaca24700 x1876725549176448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785415.497792:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1876725549176448:0@lo:400:kworker.0 00000100:00100000:2.0:1789785415.498415:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789785415.498444:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3659:x1876725549176960:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789785415.498462:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549175552 00000100:00100000:1.0:1789785415.498472:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549175552 00000004:00000024:2.0:1789785415.498476:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789785415.498529:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549176064 00000100:00100000:1.0:1789785415.498533:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549176064 00000100:00100000:1.0:1789785415.498565:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789785415.498570:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3659:x1876725549176960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (6010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785415.498576:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549175552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785415.498583:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789785415.498620:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549175552:12345-0@lo:400:kworker.0 Request processed in 47us (5986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785415.498626:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789785415.498640:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789785415.498646:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549176064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785415.498672:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549176064:12345-0@lo:400:kworker.0 Request processed in 26us (5979us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785415.498677:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789785415.498721:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549175296 00000100:00100000:1.0:1789785415.498726:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549175296 00000100:00100000:1.0:1789785415.498754:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789785415.498761:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:3661:x1876725549175296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785415.498838:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:3661:x1876725549175296:12345-0@lo:400:kworker.0 Request processed in 77us (7685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785415.498844:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789785415.498892:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad642144-cf43-4df2-a5e5-a426cdb5453e:3661:1876725549175296:0@lo:400:kworker.0 00000100:00100000:2.0:1789785415.499096:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789785415.499106:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549177088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789785415.499123:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789785415.499165:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549177088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (6351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785415.499172:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789785415.499200:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf4e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549175552:0@lo:400:kworker.0 00000100:00100000:3.0:1789785415.499225:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549176064:0@lo:400:kworker.0 00000100:00100000:3.0:1789785415.499265:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549177088:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789785415.499280:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549176960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789785415.504572:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00200000:3.0:1789785415.505262:0:17214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789785415.505462:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafb113d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251bae80-9c0c-4669-a294-80064a3e231a+6:14905:x1876725530221824:12345-192.168.203.46@tcp:33:mount.lustre.0 Request processed in 63756us (64312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785415.505472:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 0 00000100:00100000:3.0:1789785415.725951:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785415.726110:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530221952 00000100:00100000:1.0:1789785415.726127:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530221952 00000100:00100000:1.0:1789785415.726239:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 13 00000100:00100000:1.0:1789785415.726254:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+6:14951:x1876725530221952:12345-192.168.203.46@tcp:101:mkdir.0 00010000:00010000:1.0:1789785415.726282:0:19042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785415.726316:0:19042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca200/0x2f18ee3fd845d8d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8a84 expref: -99 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785415.726471:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845d8d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785415.726489:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845d8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785415.726515:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845d8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789785415.726592:0:19042:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789785415.726596:0:19042:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789785415.726640:0:19042:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845d8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785415.726673:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca200/0x2f18ee3fd845d8d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8a84 expref: 8 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785415.726715:0:19042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845d8d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8a84 expref: 7 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785415.726724:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dae827bf900) 00010000:00010000:1.0:1789785415.726728:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789785415.726732:0:19042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc21cb800, rc 0) 00000100:00100000:1.0:1789785415.726835:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+7:14951:x1876725530221952:12345-192.168.203.46@tcp:101:mkdir.0 Request processed in 584us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785415.726844:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 13 00010000:00010000:3.0:1789785416.386760:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789785416.524443:0:19533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 251bae80-9c0c-4669-a294-80064a3e231a 00000001:00080000:1.0:1789785416.524458:0:19533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:1.0:1789785417.411219:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785417.912272:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785417.912328:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530222080 00000100:00100000:3.0:1789785417.912370:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530222080 00000100:00080000:0.0:1789785417.912428:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789785417.912453:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 14 00000100:00100000:3.0:1789785417.912466:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251bae80-9c0c-4669-a294-80064a3e231a+7:15004:x1876725530222080:12345-192.168.203.46@tcp:41:lfs.0 00000004:00000024:3.0:1789785417.912514:0:17212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789785417.912712:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251bae80-9c0c-4669-a294-80064a3e231a+7:15004:x1876725530222080:12345-192.168.203.46@tcp:41:lfs.0 Request processed in 249us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785417.912720:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 14 00000100:00100000:3.0:1789785417.920517:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785417.920693:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530222208 00000100:00100000:1.0:1789785417.920709:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530222208 00000100:00100000:1.0:1789785417.920802:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 15 00000100:00100000:1.0:1789785417.920817:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+6:15004:x1876725530222208:12345-192.168.203.46@tcp:41:lfs.0 00000004:00000024:1.0:1789785417.920855:0:19042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789785417.921210:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+6:15004:x1876725530222208:12345-192.168.203.46@tcp:41:lfs.0 Request processed in 395us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785417.921218:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 15 00000100:00080000:0.0:1789785417.921318:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789785417.932530:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785417.933662:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530222336 00000100:00100000:3.0:1789785417.933673:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530222336 00000100:00100000:3.0:1789785417.933812:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:3.0:1789785417.933824:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:251bae80-9c0c-4669-a294-80064a3e231a+6:15004:x1876725530222336:12345-192.168.203.46@tcp:13:lfs.0 00002000:00000024:3.0:1789785417.933853:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789785417.933949:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:251bae80-9c0c-4669-a294-80064a3e231a+6:15004:x1876725530222336:12345-192.168.203.46@tcp:13:lfs.0 Request processed in 127us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785417.933956:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00080000:0.0:1789785417.935226:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789785417.947128:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785417.947918:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530222464 00000100:00100000:0.0:1789785417.947931:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530222464 00000100:00100000:0.0:1789785417.949158:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00100000:0.0:1789785417.949173:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae846a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:251bae80-9c0c-4669-a294-80064a3e231a+5:15004:x1876725530222464:12345-192.168.203.46@tcp:13:lfs.0 00002000:00000024:0.0:1789785417.949206:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789785417.949756:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae846a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:251bae80-9c0c-4669-a294-80064a3e231a+5:15004:x1876725530222464:12345-192.168.203.46@tcp:13:lfs.0 Request processed in 584us (2633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785417.949766:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00080000:3.0:1789785417.950200:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789785418.116308:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785418.116468:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530222592 00000100:00100000:0.0:1789785418.116490:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530222592 00000100:00100000:0.0:1789785418.116580:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 131 00000100:00100000:0.0:1789785418.116591:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49f881b2-94cc-4d23-9aec-10664f83ddca+10:15032:x1876725530222592:12345-192.168.203.46@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789785418.116618:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785418.116643:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafb5d55400/0x2f18ee3fd845d8e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8a8b expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785418.116684:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafb5d55400/0x2f18ee3fd845d8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8a8b expref: 11 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785418.116706:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafb5d55400/0x2f18ee3fd845d8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8a8b expref: 11 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785418.116744:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d55400, rc 0) 00000100:00100000:0.0:1789785418.116823:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49f881b2-94cc-4d23-9aec-10664f83ddca+11:15032:x1876725530222592:12345-192.168.203.46@tcp:101:mount.lustre.0 Request processed in 233us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785418.116831:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 131 00000100:00100000:2.0:1789785418.119551:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785418.119760:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530222720 00000100:00100000:3.0:1789785418.119772:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530222720 00000100:00100000:3.0:1789785418.119841:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 132 00000100:00100000:3.0:1789785418.119853:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49f881b2-94cc-4d23-9aec-10664f83ddca+11:15032:x1876725530222720:12345-192.168.203.46@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789785418.120067:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49f881b2-94cc-4d23-9aec-10664f83ddca+11:15032:x1876725530222720:12345-192.168.203.46@tcp:501:mount.lustre.0 Request processed in 215us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785418.120076:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 132 00000100:00100000:3.0:1789785418.123032:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785418.123110:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530222848 00000100:00100000:1.0:1789785418.123122:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530222848 00000100:00100000:1.0:1789785418.123187:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 133 00000100:00100000:1.0:1789785418.123199:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+11:15032:x1876725530222848:12345-192.168.203.46@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789785418.123429:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+11:15032:x1876725530222848:12345-192.168.203.46@tcp:503:mount.lustre.0 Request processed in 223us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785418.123445:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 133 00000100:00100000:2.0:1789785418.129023:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785418.129151:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530222976 00000100:00100000:0.0:1789785418.129163:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530222976 00000100:00100000:0.0:1789785418.129239:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 134 00000100:00100000:0.0:1789785418.129252:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49f881b2-94cc-4d23-9aec-10664f83ddca+11:15039:x1876725530222976:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789785418.129507:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49f881b2-94cc-4d23-9aec-10664f83ddca+11:15039:x1876725530222976:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 257us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785418.129516:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 134 00000100:00100000:2.0:1789785418.176094:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785418.176298:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530223104 00000100:00100000:3.0:1789785418.176311:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530223104 00000100:00100000:3.0:1789785418.176415:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 135 00000100:00100000:3.0:1789785418.176428:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49f881b2-94cc-4d23-9aec-10664f83ddca+11:15039:x1876725530223104:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789785418.176651:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49f881b2-94cc-4d23-9aec-10664f83ddca+11:15039:x1876725530223104:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 224us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785418.176778:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 135 00000100:00100000:3.0:1789785418.182003:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785418.182378:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530223232 00000100:00100000:1.0:1789785418.182391:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530223232 00000100:00100000:1.0:1789785418.182457:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 136 00000100:00100000:1.0:1789785418.182469:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+11:15039:x1876725530223232:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789785418.182857:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+11:15039:x1876725530223232:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 389us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785418.182867:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 136 00000100:00100000:2.0:1789785418.191117:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785418.191230:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530223360 00000100:00100000:0.0:1789785418.191242:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530223360 00000100:00100000:0.0:1789785418.191311:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 137 00000100:00100000:0.0:1789785418.191323:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49f881b2-94cc-4d23-9aec-10664f83ddca+11:15032:x1876725530223360:12345-192.168.203.46@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789785418.191372:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785418.191395:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafb5d55200/0x2f18ee3fd845d8e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8abc expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785418.191432:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafb5d55200/0x2f18ee3fd845d8e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8abc expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785418.191446:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafb5d55200/0x2f18ee3fd845d8e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8abc expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785418.191456:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d55200, rc 0) 00000100:00100000:0.0:1789785418.192373:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49f881b2-94cc-4d23-9aec-10664f83ddca+12:15032:x1876725530223360:12345-192.168.203.46@tcp:101:mount.lustre.0 Request processed in 1044us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785418.192385:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 137 00000100:00100000:2.0:1789785418.205642:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785418.205855:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530223488 00000100:00100000:1.0:1789785418.205934:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530223488 00000100:00100000:1.0:1789785418.206006:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 138 00000100:00100000:1.0:1789785418.206019:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+12:15032:x1876725530223488:12345-192.168.203.46@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789785418.206053:0:17206:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789785418.206086:0:17206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789785418.206091:0:17206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789785418.206094:0:17206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789785418.206097:0:17206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789785418.206099:0:17206:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1789785418.213971:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+12:15032:x1876725530223488:12345-192.168.203.46@tcp:256:mount.lustre.0 Request processed in 7937us (8327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785418.213989:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 138 00000100:00100000:2.0:1789785418.220087:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785418.220208:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530223616 00000100:00100000:0.0:1789785418.220221:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530223616 00000100:00100000:0.0:1789785418.220286:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 139 00000100:00100000:0.0:1789785418.220298:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49f881b2-94cc-4d23-9aec-10664f83ddca+12:15032:x1876725530223616:12345-192.168.203.46@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789785418.220320:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785418.220372:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafb5d55800/0x2f18ee3fd845d8ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8ac3 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785418.220408:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafb5d55800/0x2f18ee3fd845d8ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8ac3 expref: 13 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785418.220421:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafb5d55800/0x2f18ee3fd845d8ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8ac3 expref: 13 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785418.220432:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb5d55800, rc 0) 00000100:00100000:0.0:1789785418.220764:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49f881b2-94cc-4d23-9aec-10664f83ddca+13:15032:x1876725530223616:12345-192.168.203.46@tcp:101:mount.lustre.0 Request processed in 467us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785418.220773:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 139 00000100:00100000:2.0:1789785418.232423:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785418.232687:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530223744 00000100:00100000:1.0:1789785418.232702:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530223744 00000100:00100000:1.0:1789785418.232783:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 140 00000100:00100000:1.0:1789785418.232796:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+13:15032:x1876725530223744:12345-192.168.203.46@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789785418.233159:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+13:15032:x1876725530223744:12345-192.168.203.46@tcp:501:mount.lustre.0 Request processed in 365us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785418.233168:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 140 00000100:00100000:1.0:1789785418.241890:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785418.242031:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530223872 00000100:00100000:3.0:1789785418.242044:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530223872 00000100:00100000:3.0:1789785418.242112:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 141 00000100:00100000:3.0:1789785418.242124:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49f881b2-94cc-4d23-9aec-10664f83ddca+13:15032:x1876725530223872:12345-192.168.203.46@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789785418.242323:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49f881b2-94cc-4d23-9aec-10664f83ddca+13:15032:x1876725530223872:12345-192.168.203.46@tcp:503:mount.lustre.0 Request processed in 201us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785418.242331:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 141 00000100:00100000:2.0:1789785418.268283:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785418.269850:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530224000 00000100:00100000:0.0:1789785418.269876:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530224000 00000100:00100000:0.0:1789785418.269951:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 142 00000100:00100000:0.0:1789785418.269962:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49f881b2-94cc-4d23-9aec-10664f83ddca+13:15047:x1876725530224000:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789785418.270176:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49f881b2-94cc-4d23-9aec-10664f83ddca+13:15047:x1876725530224000:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 215us (1906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785418.270204:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 142 00000100:00100000:2.0:1789785418.286316:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785418.286667:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530224128 00000100:00100000:1.0:1789785418.286681:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530224128 00000100:00100000:1.0:1789785418.286741:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 143 00000100:00100000:1.0:1789785418.286752:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+13:15047:x1876725530224128:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789785418.286963:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+13:15047:x1876725530224128:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 212us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785418.286972:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 143 00000100:00100000:1.0:1789785418.329330:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785418.329760:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785418.349133:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530224256 00000100:00100000:2.0:1789785418.349153:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530224256 00000100:00100000:2.0:1789785418.349224:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530224512 00000100:00100000:2.0:1789785418.349228:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530224512 00000100:00100000:2.0:1789785418.349266:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:2.0:1789785418.349277:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1876725530224256:12345-192.168.203.46@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789785418.349317:0:17211:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6563e207-f568-458d-9d37-e81c107e6f83@192.168.203.46@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:2.0:1789785418.349378:0:17211:0:(genops.c:1385:class_connect()) connect: client 6563e207-f568-458d-9d37-e81c107e6f83, cookie 0x2f18ee3fd845d8f5 00000004:00100000:2.0:1789785418.349412:0:17211:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789785418.349566:0:17211:0:(import.c:65:import_set_state_nolock()) ffff9dae82596800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789785418.351786:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6563e207-f568-458d-9d37-e81c107e6f83+6:2396:x1876725530224256:12345-192.168.203.46@tcp:38:mount.lustre.0 Request processed in 384us (20347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785418.351802:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:2.0:1789785418.351848:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:2.0:1789785418.351857:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1876725530224512:12345-192.168.203.46@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789785418.351967:0:17211:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 6563e207-f568-458d-9d37-e81c107e6f83@192.168.203.46@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:2.0:1789785418.352015:0:17211:0:(genops.c:1385:class_connect()) connect: client 6563e207-f568-458d-9d37-e81c107e6f83, cookie 0x2f18ee3fd845d8fc 00000004:00100000:2.0:1789785418.352048:0:17211:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789785418.352155:0:17211:0:(import.c:65:import_set_state_nolock()) ffff9dae82590800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789785418.352242:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6563e207-f568-458d-9d37-e81c107e6f83+6:2396:x1876725530224512:12345-192.168.203.46@tcp:38:mount.lustre.0 Request processed in 384us (22483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785418.352250:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:2.0:1789785418.362402:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785418.362527:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785418.366956:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785418.371237:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530224640 00000100:00100000:1.0:1789785418.371261:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530224640 00000100:00080000:3.0:1789785418.371392:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789785418.371399:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530224384 00000100:00100000:1.0:1789785418.371405:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530224384 00000100:00080000:3.0:1789785418.371423:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789785418.371464:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 18 00000100:00100000:3.0:1789785418.371493:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6563e207-f568-458d-9d37-e81c107e6f83+6:0:x1876725530224640:12345-192.168.203.46@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789785418.371528:0:17212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789785418.371626:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6563e207-f568-458d-9d37-e81c107e6f83+6:0:x1876725530224640:12345-192.168.203.46@tcp:41:mount.lustre.0 Request processed in 151us (9240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785418.371634:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 18 00000100:00100000:1.0:1789785418.371722:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:1.0:1789785418.371736:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6563e207-f568-458d-9d37-e81c107e6f83+6:0:x1876725530224384:12345-192.168.203.46@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789785418.371766:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789785418.371829:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6563e207-f568-458d-9d37-e81c107e6f83+6:0:x1876725530224384:12345-192.168.203.46@tcp:41:mount.lustre.0 Request processed in 96us (9301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785418.372151:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:1.0:1789785418.372557:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530224768 00000100:00100000:1.0:1789785418.372564:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530224768 00000100:00100000:1.0:1789785418.372598:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 20 00000100:00100000:1.0:1789785418.372621:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6563e207-f568-458d-9d37-e81c107e6f83+6:15032:x1876725530224768:12345-192.168.203.46@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789785418.372640:0:19042:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789785418.372697:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6563e207-f568-458d-9d37-e81c107e6f83+6:15032:x1876725530224768:12345-192.168.203.46@tcp:41:mount.lustre.0 Request processed in 77us (5756us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785418.372704:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 20 00000100:00100000:1.0:1789785418.375712:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785418.378103:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530224896 00000100:00100000:3.0:1789785418.378127:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530224896 00000100:00100000:3.0:1789785418.378409:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 21 00000100:00100000:3.0:1789785418.378424:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6563e207-f568-458d-9d37-e81c107e6f83+6:15032:x1876725530224896:12345-192.168.203.46@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789785418.378531:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6563e207-f568-458d-9d37-e81c107e6f83+6:15032:x1876725530224896:12345-192.168.203.46@tcp:40:mount.lustre.0 Request processed in 111us (2829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785418.378538:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 21 00000100:00100000:1.0:1789785418.381681:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785418.381723:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785418.381746:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785418.381817:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785418.381845:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530225536 00000100:00100000:1.0:1789785418.381853:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530225536 00000100:00100000:1.0:1789785418.381903:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 32 00000100:00100000:1.0:1789785418.381911:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+7:2400:x1876725530225536:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785418.381973:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+7:2400:x1876725530225536:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 63us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785418.381981:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 32 00000100:00100000:2.0:1789785418.382372:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530225024 00000100:00100000:2.0:1789785418.382382:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530225024 00000100:00100000:2.0:1789785418.382410:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530225152 00000100:00100000:2.0:1789785418.382413:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530225152 00000100:00100000:2.0:1789785418.382428:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:2.0:1789785418.382433:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2396:x1876725530225024:12345-192.168.203.46@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789785418.382460:0:18720:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6563e207-f568-458d-9d37-e81c107e6f83@192.168.203.46@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:2.0:1789785418.382500:0:18720:0:(genops.c:1385:class_connect()) connect: client 6563e207-f568-458d-9d37-e81c107e6f83, cookie 0x2f18ee3fd845d903 00002000:00100000:2.0:1789785418.382511:0:18720:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6563e207-f568-458d-9d37-e81c107e6f83/ffff9dae82597800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789785418.382523:0:18720:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789785418.382599:0:18720:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789785418.382627:0:18720:0:(import.c:65:import_set_state_nolock()) ffff9dae83734000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789785418.382666:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6563e207-f568-458d-9d37-e81c107e6f83+6:2396:x1876725530225024:12345-192.168.203.46@tcp:8:mount.lustre.0 Request processed in 231us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785418.382673:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:2.0:1789785418.382688:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 20 00000100:00100000:2.0:1789785418.382692:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2396:x1876725530225152:12345-192.168.203.46@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789785418.382708:0:18720:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6563e207-f568-458d-9d37-e81c107e6f83@192.168.203.46@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:2.0:1789785418.382724:0:18720:0:(genops.c:1385:class_connect()) connect: client 6563e207-f568-458d-9d37-e81c107e6f83, cookie 0x2f18ee3fd845d90a 00002000:00100000:2.0:1789785418.382741:0:18720:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6563e207-f568-458d-9d37-e81c107e6f83/ffff9dae83733800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789785418.382748:0:18720:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789785418.382792:0:18720:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789785418.382806:0:18720:0:(import.c:65:import_set_state_nolock()) ffff9dae84545000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789785418.382827:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6563e207-f568-458d-9d37-e81c107e6f83+6:2396:x1876725530225152:12345-192.168.203.46@tcp:8:mount.lustre.0 Request processed in 133us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785418.382833:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 20 00000100:00100000:2.0:1789785418.383964:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785418.384043:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785418.384080:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785418.384080:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530225280 00000100:00100000:0.0:1789785418.384095:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530225280 00000100:00100000:2.0:1789785418.384118:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785418.384176:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530225408 00000100:00100000:3.0:1789785418.384185:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530225408 00000100:00100000:0.0:1789785418.384201:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 4 00000100:00100000:0.0:1789785418.384218:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6563e207-f568-458d-9d37-e81c107e6f83+6:15032:x1876725530225280:12345-192.168.203.46@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789785418.384238:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 144 00000100:00100000:3.0:1789785418.384252:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49f881b2-94cc-4d23-9aec-10664f83ddca+13:2400:x1876725530225408:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785418.384321:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6563e207-f568-458d-9d37-e81c107e6f83+6:15032:x1876725530225280:12345-192.168.203.46@tcp:900:mount.lustre.0 Request processed in 105us (2593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785418.384330:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 4 00000100:00100000:3.0:1789785418.386506:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49f881b2-94cc-4d23-9aec-10664f83ddca+13:2400:x1876725530225408:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 2246us (2450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785418.386520:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 144 00000100:00100000:1.0:1789785418.387348:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530225792 00000100:00100000:1.0:1789785418.387359:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530225792 00000100:00100000:1.0:1789785418.387400:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530225920 00000100:00100000:1.0:1789785418.387402:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530225920 00000100:00100000:1.0:1789785418.387418:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00100000:1.0:1789785418.387424:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251bae80-9c0c-4669-a294-80064a3e231a+6:2400:x1876725530225792:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785418.387498:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251bae80-9c0c-4669-a294-80064a3e231a+6:2400:x1876725530225792:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 73us (3538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785418.387505:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00100000:1.0:1789785418.387532:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:1.0:1789785418.387538:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251bae80-9c0c-4669-a294-80064a3e231a+5:2400:x1876725530225920:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785418.387563:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251bae80-9c0c-4669-a294-80064a3e231a+5:2400:x1876725530225920:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 25us (3446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785418.387569:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:1.0:1789785418.387592:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530225664 00000100:00100000:1.0:1789785418.387595:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530225664 00000100:00100000:1.0:1789785418.387620:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 33 00000100:00100000:1.0:1789785418.387626:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+6:2400:x1876725530225664:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785418.387646:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+6:2400:x1876725530225664:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 21us (3568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785418.387649:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 33 00000100:00100000:2.0:1789785418.390590:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785418.392025:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530226048 00000100:00100000:3.0:1789785418.392036:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530226048 00000100:00100000:3.0:1789785418.392155:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 1 00000100:00100000:3.0:1789785418.392166:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6563e207-f568-458d-9d37-e81c107e6f83+6:15032:x1876725530226048:12345-192.168.203.46@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789785418.392275:0:17215:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789785418.392388:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6563e207-f568-458d-9d37-e81c107e6f83+6:15032:x1876725530226048:12345-192.168.203.46@tcp:33:mount.lustre.0 Request processed in 216us (1797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785418.392397:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 1 00010000:00010000:0.0:1789785418.441710:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785418.670094:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785418.671723:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530226176 00000100:00100000:1.0:1789785418.671737:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530226176 00000100:00100000:1.0:1789785418.671812:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 22 00000100:00100000:1.0:1789785418.671823:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6563e207-f568-458d-9d37-e81c107e6f83+6:15070:x1876725530226176:12345-192.168.203.46@tcp:101:mkdir.0 00010000:00010000:1.0:1789785418.671842:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785418.671863:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845d911 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8af4 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785418.671926:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845d918 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785418.671941:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845d918 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785418.671952:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845d918 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789785418.672010:0:17213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789785418.672014:0:17213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789785418.672033:0:17213:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845d918 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785418.672059:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845d911 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8af4 expref: 8 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785418.672080:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845d918 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8af4 expref: 7 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785418.672089:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dae827bf900) 00010000:00010000:1.0:1789785418.672092:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789785418.672095:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc21cbc00, rc 0) 00000100:00100000:1.0:1789785418.672171:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6563e207-f568-458d-9d37-e81c107e6f83+7:15070:x1876725530226176:12345-192.168.203.46@tcp:101:mkdir.0 Request processed in 349us (2092us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785418.672178:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 22 00010000:00010000:2.0:1789785419.460260:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785420.483749:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785420.610595:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549177856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789785420.610671:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785420.610744:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789785420.610751:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549177728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789785420.610787:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785420.611117:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549177856 00000100:00100000:3.0:1789785420.611126:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549177856 00000100:00100000:3.0:1789785420.611221:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789785420.611231:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549177856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789785420.611260:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789785420.611318:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549177856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785420.611325:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1789785420.611365:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789785420.611766:0:18200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549177728 00000100:00100000:1.0:1789785420.611770:0:18200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549177728 00000100:00100000:1.0:1789785420.611812:0:18200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789785420.611820:0:18200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549177728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789785420.611843:0:18200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789785420.611882:0:18200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549177728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785420.611888:0:18200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789785420.612560:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549177728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789785420.612576:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549177856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789785420.613129:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549177984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789785420.613185:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785420.613226:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789785420.613233:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549178112:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789785420.613254:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785420.613911:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549178624:0@lo:400:kworker.0 00000100:00100000:3.0:1789785420.613944:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785420.613964:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1876725549179136:0@lo:400:kworker.0 00000100:00100000:1.0:1789785420.613977:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad642144-cf43-4df2-a5e5-a426cdb5453e:3661:1876725549178240:0@lo:400:kworker.0 00000100:00100000:3.0:1789785420.613987:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785420.614017:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785420.614019:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789785420.614025:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876725549178496:0@lo:400:kworker.0 00000100:00100000:2.0:1789785420.614164:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549178624 00000100:00100000:2.0:1789785420.614171:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549178624 00000100:00100000:2.0:1789785420.614236:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789785420.614245:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549178624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785420.614897:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785420.614933:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549179008:0@lo:400:kworker.0 00000100:00100000:3.0:1789785420.614958:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785420.614976:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789785420.614985:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549179520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789785420.615021:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785420.615060:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549179136 00000100:00100000:3.0:1789785420.615064:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549179136 00000100:00100000:0.0:1789785420.615251:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549178240 00000100:00100000:0.0:1789785420.615256:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549178240 00000100:00100000:0.0:1789785420.615300:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789785420.615307:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:3661:x1876725549178240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785420.615366:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:3661:x1876725549178240:12345-0@lo:400:kworker.0 Request processed in 60us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785420.615374:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789785420.615463:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549177984 00000100:00100000:0.0:1789785420.615474:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549177984 00000100:00100000:0.0:1789785420.615494:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549178112 00000100:00100000:0.0:1789785420.615497:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549178112 00000100:00100000:0.0:1789785420.615510:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549179520 00000100:00100000:0.0:1789785420.615512:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549179520 00000100:00100000:0.0:1789785420.615523:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789785420.615528:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549177984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789785420.615550:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789785420.615585:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549177984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (2400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785420.615592:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789785420.615604:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789785420.615610:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549178112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789785420.615619:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789785420.615643:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549178112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (2387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785420.615648:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789785420.615870:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549178496 00000100:00100000:3.0:1789785420.615874:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549178496 00000100:00100000:3.0:1789785420.615888:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549179008 00000100:00100000:3.0:1789785420.615891:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549179008 00000100:00100000:3.0:1789785420.615905:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789785420.615911:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1876725549179136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785420.615952:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1876725549179136:12345-0@lo:400:kworker.0 Request processed in 41us (1964us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785420.615959:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789785420.615973:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789785420.615979:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876725549178496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785420.616005:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876725549178496:12345-0@lo:400:kworker.0 Request processed in 27us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785420.616010:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789785420.616022:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789785420.616028:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1876725549179008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785420.616054:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1876725549179008:12345-0@lo:400:kworker.0 Request processed in 26us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785420.616059:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789785420.616111:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876725549178496:0@lo:400:kworker.0 00010000:00080000:3.0:1789785420.616135:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83b59180 x1876725549179008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785420.616145:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549179008:0@lo:400:kworker.0 00000100:00100000:3.0:1789785420.616158:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1876725549179136:0@lo:400:kworker.0 00000100:00080000:3.0:1789785420.616195:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789785420.616199:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789785420.616201:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789785420.616203:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789785420.616225:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549178112:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789785420.616235:0:3659:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1789785420.616248:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549177984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789785420.616295:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789785420.616303:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3660:x1876725549179520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789785420.616313:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789785420.616368:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3660:x1876725549179520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785420.616374:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789785420.617041:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549178368:0@lo:400:kworker.0 00000100:00100000:0.0:1789785420.617092:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785420.617134:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1876725549178880:0@lo:400:kworker.0 00000100:00100000:0.0:1789785420.617157:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785420.617175:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549179392:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789785420.617194:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785420.617238:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549178368 00000100:00100000:0.0:1789785420.617243:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549178368 00000100:00100000:0.0:1789785420.617272:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549179392 00000100:00100000:0.0:1789785420.617274:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549179392 00000100:00100000:0.0:1789785420.617316:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789785420.617321:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3662:x1876725549178368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785420.617382:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3662:x1876725549178368:12345-0@lo:400:kworker.0 Request processed in 60us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785420.617389:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789785420.617400:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789785420.617406:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549179392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789785420.617426:0:17216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789785420.618258:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549178880 00000100:00100000:3.0:1789785420.618265:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549178880 00000100:00100000:3.0:1789785420.618303:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789785420.618309:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1876725549178880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785420.618366:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1876725549178880:12345-0@lo:400:kworker.0 Request processed in 57us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785420.618374:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1789785420.618402:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789785420.618744:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549179392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1336us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785420.618753:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789785420.618950:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549178368:0@lo:400:kworker.0 00000100:00100000:0.0:1789785420.618963:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1876725549178880:0@lo:400:kworker.0 00000100:00100000:0.0:1789785420.618976:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549179392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789785420.619564:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549179520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789785420.619969:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad642144-cf43-4df2-a5e5-a426cdb5453e:3661:1876725549178240:0@lo:400:kworker.0 00000100:00100000:1.0:1789785420.619993:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549178752:0@lo:400:kworker.0 00000100:00100000:1.0:1789785420.620229:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785420.620252:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549179264:0@lo:400:kworker.0 00000100:00100000:1.0:1789785420.620276:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785420.620299:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549178752 00000100:00100000:1.0:1789785420.620304:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549178752 00000100:00100000:1.0:1789785420.620335:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549179264 00000100:00100000:1.0:1789785420.620353:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549179264 00000100:00100000:1.0:1789785420.620385:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789785420.620392:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549178752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785420.620431:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549178752:12345-0@lo:400:kworker.0 Request processed in 39us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785420.620437:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789785420.621118:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789785420.621129:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549179264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789785420.621168:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549179264:12345-0@lo:400:kworker.0 Request processed in 43us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785420.621174:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1789785420.621203:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789785420.621229:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae83b5a680 x1876725549179264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789785420.621241:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549179264:0@lo:400:kworker.0 00000100:00100000:1.0:1789785420.621268:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549178752:0@lo:400:kworker.0 00000001:00100000:0.0:1789785420.625684:0:17944:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6563e207-f568-458d-9d37-e81c107e6f83 00000001:00100000:0.0:1789785420.625698:0:17944:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 251bae80-9c0c-4669-a294-80064a3e231a 00000100:00100000:2.0:1789785420.625877:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549178624:12345-0@lo:400:kworker.0 Request processed in 11628us (11927us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785420.625890:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789785420.626058:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549178624:0@lo:400:kworker.0 00000001:00100000:1.0:1789785420.626227:0:18714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6563e207-f568-458d-9d37-e81c107e6f83 00000001:00100000:1.0:1789785420.626234:0:18714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 251bae80-9c0c-4669-a294-80064a3e231a 00000001:00100000:0.0:1789785420.626372:0:17191:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6563e207-f568-458d-9d37-e81c107e6f83 00000001:00100000:0.0:1789785420.626384:0:17191:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 251bae80-9c0c-4669-a294-80064a3e231a 00010000:00010000:1.0:1789785421.512615:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789785421.833828:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1789785421.943302:0:20089:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789785422.530535:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785423.556867:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789785423.685476:0:19533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6563e207-f568-458d-9d37-e81c107e6f83 00000100:00100000:3.0:1789785423.854576:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785423.854620:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785423.854647:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785423.854666:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785423.854685:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785423.854706:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785423.854735:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785423.854764:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785423.854781:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530226304 00000100:00100000:0.0:1789785423.854793:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530226304 00000100:00100000:3.0:1789785423.854801:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785423.854845:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 146 00000100:00100000:0.0:1789785423.854856:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+13:2398:x1876725530226304:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785423.857141:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+13:2398:x1876725530226304:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 2275us (2561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785423.857211:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530226560 00000100:00100000:0.0:1789785423.857226:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 146 00000100:00100000:3.0:1789785423.857286:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530226560 00000100:00100000:3.0:1789785423.857498:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530227072 00000100:00100000:3.0:1789785423.857503:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530227072 00000100:00100000:3.0:1789785423.857525:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530226432 00000100:00100000:3.0:1789785423.857528:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530226432 00000100:00100000:3.0:1789785423.857545:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530226944 00000100:00100000:3.0:1789785423.857548:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530226944 00000100:00100000:2.0:1789785423.857553:0:19259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530226816 00000100:00100000:3.0:1789785423.857568:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 40 00000100:00100000:3.0:1789785423.857578:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+5:2398:x1876725530226560:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785423.857629:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+5:2398:x1876725530226560:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 52us (3008us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785423.857636:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 40 00000100:00100000:3.0:1789785423.857653:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 41 00000100:00100000:3.0:1789785423.857659:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6563e207-f568-458d-9d37-e81c107e6f83+5:2398:x1876725530227072:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785423.857693:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6563e207-f568-458d-9d37-e81c107e6f83+5:2398:x1876725530227072:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 34us (3026us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785423.857699:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 41 00000100:00100000:3.0:1789785423.857712:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 42 00000100:00100000:3.0:1789785423.857718:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+6:2398:x1876725530226432:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785423.857743:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+6:2398:x1876725530226432:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 25us (3037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785423.857749:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 42 00000100:00100000:3.0:1789785423.857763:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 43 00000100:00100000:3.0:1789785423.857771:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6563e207-f568-458d-9d37-e81c107e6f83+6:2398:x1876725530226944:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785423.857799:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6563e207-f568-458d-9d37-e81c107e6f83+6:2398:x1876725530226944:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 29us (3035us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785423.857806:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 43 00000100:00100000:3.0:1789785423.857836:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530227328 00000100:00100000:3.0:1789785423.857840:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530227328 00000100:00100000:3.0:1789785423.857863:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530226688 00000100:00100000:3.0:1789785423.857866:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530226688 00000100:00100000:3.0:1789785423.857876:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530227200 00000100:00100000:3.0:1789785423.857879:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530227200 00000100:00100000:3.0:1789785423.857891:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00100000:3.0:1789785423.857897:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6563e207-f568-458d-9d37-e81c107e6f83+5:2398:x1876725530227328:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785423.857990:0:19259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530226816 00000100:00100000:2.0:1789785423.858020:0:19259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:2.0:1789785423.858027:0:19259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251bae80-9c0c-4669-a294-80064a3e231a+5:2398:x1876725530226688:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785423.858524:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6563e207-f568-458d-9d37-e81c107e6f83+5:2398:x1876725530227328:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 625us (3836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785423.858531:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00100000:3.0:1789785423.858546:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:3.0:1789785423.858561:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6563e207-f568-458d-9d37-e81c107e6f83+5:2398:x1876725530227200:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785423.860525:0:19259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251bae80-9c0c-4669-a294-80064a3e231a+5:2398:x1876725530226688:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 2488us (5781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785423.860539:0:19259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:2.0:1789785423.860678:0:19259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00100000:2.0:1789785423.860691:0:19259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251bae80-9c0c-4669-a294-80064a3e231a+5:2398:x1876725530226816:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789785423.860747:0:19259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251bae80-9c0c-4669-a294-80064a3e231a+5:2398:x1876725530226816:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 61us (6099us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785423.860753:0:19259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00080000:0.0:1789785423.865502:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789785423.865512:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789785423.865516:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789785423.865520:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789785423.868914:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6563e207-f568-458d-9d37-e81c107e6f83+5:2398:x1876725530227200:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 10339us (14100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785423.868932:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 11 00010000:00010000:1.0:1789785424.580665:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785425.602866:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789785425.667187:0:17971:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789785425.733945:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549179648:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789785425.734019:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785425.734079:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549180160:0@lo:400:kworker.0 00000100:00100000:3.0:1789785425.734106:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785425.734132:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789785425.734137:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549180032:0@lo:400:kworker.0 00000100:00100000:3.0:1789785425.734163:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785425.734204:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549179648 00000100:00100000:3.0:1789785425.734211:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549179648 00000100:00100000:3.0:1789785425.734271:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789785425.734284:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549179776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789785425.734285:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549179648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789785425.734322:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789785425.734322:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785425.734365:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549180288:0@lo:400:kworker.0 00000100:00100000:3.0:1789785425.734398:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549179648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785425.734399:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785425.734409:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789785425.734432:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549180800:0@lo:400:kworker.0 00000100:00100000:3.0:1789785425.734438:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549179776 00000100:00100000:3.0:1789785425.734443:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549179776 00000100:00100000:2.0:1789785425.734463:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785425.734468:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789785425.734477:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549179776:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789785425.734486:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549181312:0@lo:400:kworker.0 00002000:00000024:3.0:1789785425.734496:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789785425.734522:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785425.734537:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549179776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785425.734559:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789785425.734573:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549179776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789785425.734583:0:19259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549180160 00000100:00100000:3.0:1789785425.734588:0:19259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549180160 00000100:00100000:2.0:1789785425.734591:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789785425.734601:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad642144-cf43-4df2-a5e5-a426cdb5453e:3661:1876725549179904:0@lo:400:kworker.0 00000100:00100000:3.0:1789785425.734615:0:19259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549180288 00000100:00100000:3.0:1789785425.734619:0:19259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549180288 00000100:00100000:2.0:1789785425.734635:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785425.734645:0:19259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789785425.734662:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725549180416:0@lo:400:kworker.0 00000100:00100000:3.0:1789785425.734670:0:19259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549180160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785425.734688:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785425.734721:0:19259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549180160:12345-0@lo:400:kworker.0 Request processed in 68us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785425.734723:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1876725549180928:0@lo:400:kworker.0 00000100:00100000:3.0:1789785425.734745:0:19259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789785425.734761:0:19259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789785425.734768:0:19259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549180288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785425.734798:0:19259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1876725549180288:12345-0@lo:400:kworker.0 Request processed in 30us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785425.734803:0:19259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789785425.734821:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549180800 00000100:00100000:3.0:1789785425.734825:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549180800 00000100:00100000:3.0:1789785425.734848:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549181312 00000100:00100000:3.0:1789785425.734851:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549181312 00000100:00100000:3.0:1789785425.734863:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549180416 00000100:00100000:3.0:1789785425.734866:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549180416 00000100:00100000:3.0:1789785425.734878:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789785425.734886:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785425.734887:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549180800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789785425.734916:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1876725549180288:0@lo:400:kworker.0 00000100:00100000:3.0:1789785425.734933:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1876725549180800:12345-0@lo:400:kworker.0 Request processed in 47us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785425.734937:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1876725549180800:0@lo:400:kworker.0 00000100:00100000:3.0:1789785425.734944:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789785425.734962:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549180928 00000100:00100000:3.0:1789785425.734972:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549180928 00000100:00100000:3.0:1789785425.734990:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789785425.734995:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549181312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785425.735032:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1876725549181312:12345-0@lo:400:kworker.0 Request processed in 35us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785425.735037:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789785425.735048:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789785425.735054:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725549180416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785425.735079:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1876725549180416:12345-0@lo:400:kworker.0 Request processed in 25us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785425.735084:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789785425.735093:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789785425.735098:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1876725549180928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785425.735120:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1876725549180928:12345-0@lo:400:kworker.0 Request processed in 22us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785425.735126:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789785425.735153:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549180544:0@lo:400:kworker.0 00000100:00100000:3.0:1789785425.735180:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785425.735197:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549181056:0@lo:400:kworker.0 00000100:00100000:3.0:1789785425.735217:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785425.735233:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789785425.735239:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549180672:0@lo:400:kworker.0 00000100:00100000:3.0:1789785425.735258:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785425.735273:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549181184:0@lo:400:kworker.0 00000100:00100000:3.0:1789785425.735291:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785425.735322:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549181056 00000100:00100000:3.0:1789785425.735326:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549181056 00000100:00100000:3.0:1789785425.735369:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549181184 00000100:00100000:3.0:1789785425.735372:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549181184 00000100:00100000:3.0:1789785425.735387:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789785425.735392:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549181056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785425.735437:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876725549181056:12345-0@lo:400:kworker.0 Request processed in 44us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785425.735443:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789785425.735456:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789785425.735462:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549181184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785425.735489:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876725549181184:12345-0@lo:400:kworker.0 Request processed in 27us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785425.735494:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789785425.735525:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1876725549181184:0@lo:400:kworker.0 00010000:00080000:3.0:1789785425.735537:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae84524700 x1876725549181056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785425.735546:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1876725549181056:0@lo:400:kworker.0 00000100:00100000:3.0:1789785425.735565:0:19259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549180672 00000100:00100000:3.0:1789785425.735568:0:19259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549180672 00000100:00100000:3.0:1789785425.735590:0:19259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789785425.735595:0:19259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549180672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785425.735627:0:19259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549180672:12345-0@lo:400:kworker.0 Request processed in 32us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785425.735633:0:19259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789785425.735657:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549180672:0@lo:400:kworker.0 00000100:00100000:3.0:1789785425.735691:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549180160:0@lo:400:kworker.0 00000100:00100000:3.0:1789785425.735707:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549179648:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789785425.735739:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1876725549180416:0@lo:400:kworker.0 00000100:00100000:3.0:1789785425.735749:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1876725549180928:0@lo:400:kworker.0 00010000:00080000:3.0:1789785425.735763:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dae84527b80 x1876725549181312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785425.735772:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1876725549181312:0@lo:400:kworker.0 00000100:00100000:0.0:1789785425.736581:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549181440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789785425.736622:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785425.736672:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549180032 00000100:00100000:0.0:1789785425.736676:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549180032 00000100:00100000:0.0:1789785425.736703:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549180544 00000100:00100000:0.0:1789785425.736706:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549180544 00000100:00100000:0.0:1789785425.736718:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789785425.736724:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacaea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549180032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785425.736763:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacaea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549180032:12345-0@lo:400:kworker.0 Request processed in 39us (2599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785425.736770:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789785425.736781:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789785425.736786:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacaeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549180544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785425.736811:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacaeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1876725549180544:12345-0@lo:400:kworker.0 Request processed in 25us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785425.736816:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1789785425.736829:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789785425.736833:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789785425.736836:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789785425.736838:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789785425.736846:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549181440 00000100:00100000:0.0:1789785425.736849:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549181440 00000100:00100000:0.0:1789785425.736875:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789785425.736880:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549181440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789785425.736892:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789785425.736928:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549181440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785425.736935:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789785425.736953:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549179904 00000100:00100000:0.0:1789785425.736956:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549179904 00000100:00100000:0.0:1789785425.736984:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789785425.736989:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:3661:x1876725549179904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785425.737018:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:3661:x1876725549179904:12345-0@lo:400:kworker.0 Request processed in 29us (2385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785425.737024:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789785425.737104:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549181440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789785425.737326:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789785425.737362:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549181824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789785425.737393:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785425.737463:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549181568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789785425.737535:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785425.737575:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549181824 00000100:00100000:2.0:1789785425.737581:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549181824 00000100:00100000:2.0:1789785425.737606:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549181568 00000100:00100000:2.0:1789785425.737609:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549181568 00000100:00100000:2.0:1789785425.737622:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789785425.737629:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549181824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789785425.737653:0:17216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789785425.738963:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549181824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1328us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785425.738985:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789785425.739207:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789785425.739219:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549181568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789785425.739249:0:17216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789785425.739293:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549181568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (1758us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785425.739300:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789785425.742374:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549181824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789785425.747818:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549181568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789785425.747844:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1876725549180544:0@lo:400:kworker.0 00000100:00100000:0.0:1789785425.747892:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789785425.747903:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae847d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549181696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789785425.747961:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785425.748038:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549181696 00000100:00100000:0.0:1789785425.748453:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549181696 00000100:00100000:0.0:1789785425.748497:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789785425.748507:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf451180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549181696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789785425.748528:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789785425.748582:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf451180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549181696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785425.748590:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789785425.748631:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549180032:0@lo:400:kworker.0 00000100:00100000:0.0:1789785425.748671:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae847d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549181696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789785425.748696:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad642144-cf43-4df2-a5e5-a426cdb5453e:3661:1876725549179904:0@lo:400:kworker.0 00000020:00000080:2.0:1789785425.754364:0:20236:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2bc34b90 20000000:00000080:2.0:1789785425.754381:0:20236:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dafa58d9400 uarg=0000000000000000 20000000:01000000:2.0:1789785425.754868:0:20236:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789785425.754874:0:20236:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789785425.754879:0:20236:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789785425.755496:0:20237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1789785425.755874:0:20236:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789785425.762665:0:20236:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789785425.762696:0:20236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9daf814bb000/0x2f18ee3fd845d91f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785425.762776:0:20236:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dae81eacc00/0x2f18ee3fd845d5b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d5ad expref: 23 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785425.762785:0:20236:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dae81eac000/0x2f18ee3fd845d5c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d5bb expref: 23 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785425.762794:0:20236:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dae81eaca00/0x2f18ee3fd845d601 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d5fa expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785425.762801:0:20236:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9daf814baa00/0x2f18ee3fd845d6a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d69b expref: 23 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785425.762810:0:20236:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafb5d55c00/0x2f18ee3fd845d8af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8a53 expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785425.762951:0:20236:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dafb5d55800/0x2f18ee3fd845d8ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8ac3 expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785425.762961:0:20236:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9daf814bb000/0x2f18ee3fd845d91f lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785425.763003:0:20236:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafb5d55800/0x2f18ee3fd845d8ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8ac3 expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785425.763018:0:20236:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dafb5d55800/0x2f18ee3fd845d8ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8ac3 expref: 12 pid: 17204 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785425.763032:0:20236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20236:1876725549181952:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785425.763134:0:20236:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dafb5d55c00/0x2f18ee3fd845d8af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8a53 expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785425.763506:0:20236:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dafb5d55c00/0x2f18ee3fd845d8af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8a53 expref: 12 pid: 17204 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785425.763517:0:20236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacaea680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20236:1876725549182080:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785425.763575:0:20236:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9daf814baa00/0x2f18ee3fd845d6a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845d69b expref: 23 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785425.763584:0:20236:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9daf814baa00/0x2f18ee3fd845d6a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845d69b expref: 23 pid: 17205 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785425.763595:0:20236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20236:1876725549182208:0@lo:104: 00000100:00100000:3.0:1789785425.763634:0:20236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789785425.763673:0:20236:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dae81eaca00/0x2f18ee3fd845d601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845d5fa expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785425.763681:0:20236:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dae81eaca00/0x2f18ee3fd845d601 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845d5fa expref: 23 pid: 17206 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785425.763691:0:20236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacae8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20236:1876725549182336:0@lo:104: 00000100:00100000:1.0:1789785425.763701:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549182208 00000100:00100000:1.0:1789785425.763711:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549182208 00000100:00100000:3.0:1789785425.763785:0:20236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789785425.764150:0:20236:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dae81eac000/0x2f18ee3fd845d5c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845d5bb expref: 23 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785425.764159:0:20236:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dae81eac000/0x2f18ee3fd845d5c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845d5bb expref: 23 pid: 17205 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785425.764168:0:20236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacaead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20236:1876725549182464:0@lo:104: 00000100:00100000:3.0:1789785425.764191:0:20236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785425.765246:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549182336 00000100:00100000:1.0:1789785425.765255:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549182336 00000100:00100000:1.0:1789785425.765298:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789785425.765308:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad642144-cf43-4df2-a5e5-a426cdb5453e+4:20236:x1876725549182208:12345-0@lo:104: 00010000:00010000:1.0:1789785425.765323:0:17194:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d69b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845d6a2 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785425.765430:0:17194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789785425.765437:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad642144-cf43-4df2-a5e5-a426cdb5453e+4:20236:x1876725549182208:12345-0@lo:104: Request processed in 131us (1803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785425.765445:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789785425.765462:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789785425.765469:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad642144-cf43-4df2-a5e5-a426cdb5453e+3:20236:x1876725549182336:12345-0@lo:104: 00010000:00010000:1.0:1789785425.765478:0:17194:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d5fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845d601 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785425.765538:0:20236:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dae81eacc00/0x2f18ee3fd845d5b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f18ee3fd845d5ad expref: 23 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785425.765551:0:20236:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dae81eacc00/0x2f18ee3fd845d5b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f18ee3fd845d5ad expref: 23 pid: 17205 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785425.765562:0:20236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacaeb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20236:1876725549182592:0@lo:104: 00000100:00100000:2.0:1789785425.765590:0:17195:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1789785425.765596:0:20236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785425.765602:0:17195:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1789785425.765610:0:20236:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf85440000 going to sleep for 11 seconds 00000100:00100000:3.0:1789785425.765633:0:20236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20236:1876725549182208:0@lo:104: 00010000:00010000:0.0:1789785425.765684:0:18743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789785425.765693:0:18743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d69b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845d6a2 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785425.765700:0:18743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dae81eac800 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:0.0:1789785425.765704:0:18743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d69b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845d6a2 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785425.765711:0:18743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d69b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845d6a2 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789785425.765719:0:18743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d69b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845d6a2 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785425.765724:0:18743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789785425.765756:0:18743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d69b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d6a2 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785425.765773:0:18743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789785425.765795:0:18743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d69b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d6a2 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785425.765864:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad642144-cf43-4df2-a5e5-a426cdb5453e:3662:1876725549182720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789785425.765907:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785425.765948:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549182720 00000100:00100000:2.0:1789785425.765952:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549182720 00010000:00010000:1.0:1789785425.765990:0:17194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789785425.765996:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad642144-cf43-4df2-a5e5-a426cdb5453e+3:20236:x1876725549182336:12345-0@lo:104: Request processed in 528us (2211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785425.766012:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789785425.766025:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549182464 00000100:00100000:1.0:1789785425.766115:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549182464 00000100:00100000:1.0:1789785425.766134:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549182592 00000100:00100000:1.0:1789785425.766136:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549182592 00000100:00100000:1.0:1789785425.766147:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789785425.766152:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad642144-cf43-4df2-a5e5-a426cdb5453e+4:20236:x1876725549182464:12345-0@lo:104: 00010000:00010000:1.0:1789785425.766160:0:17194:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55a00/0x2f18ee3fd845d5bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845d5c2 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785425.766197:0:17194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789785425.766202:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad642144-cf43-4df2-a5e5-a426cdb5453e+4:20236:x1876725549182464:12345-0@lo:104: Request processed in 51us (2011us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785425.766208:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789785425.766221:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789785425.766226:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad642144-cf43-4df2-a5e5-a426cdb5453e+3:20236:x1876725549182592:12345-0@lo:104: 00010000:00010000:1.0:1789785425.766234:0:17194:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64600/0x2f18ee3fd845d5ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845d5b4 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785425.766260:0:17194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789785425.766265:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad642144-cf43-4df2-a5e5-a426cdb5453e+3:20236:x1876725549182592:12345-0@lo:104: Request processed in 40us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785425.766270:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789785425.766286:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789785425.766290:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d5fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845d601 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785425.766296:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bb800 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:1.0:1789785425.766305:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d5fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845d601 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785425.766312:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d5fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845d601 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789785425.766319:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d5fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845d601 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785425.766325:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789785425.766370:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d5fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d601 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785425.766376:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789785425.766392:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d5fa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d601 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785425.766398:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9daf814bb800/0x2f18ee3fd845d5fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d601 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785425.766413:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789785425.766416:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55a00/0x2f18ee3fd845d5bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845d5c2 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785425.766432:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb5d55a00 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:1.0:1789785425.766435:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55a00/0x2f18ee3fd845d5bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845d5c2 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785425.766442:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55a00/0x2f18ee3fd845d5bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845d5c2 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789785425.766457:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55a00/0x2f18ee3fd845d5bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845d5c2 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785425.766462:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789785425.766478:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55a00/0x2f18ee3fd845d5bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d5c2 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785425.766484:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789785425.766492:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55a00/0x2f18ee3fd845d5bb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d5c2 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785425.766499:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafb5d55a00/0x2f18ee3fd845d5bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d5c2 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785425.766510:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789785425.766513:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64600/0x2f18ee3fd845d5ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f18ee3fd845d5b4 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785425.766519:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1a64600 already unused, calling callback (ffffffffc12b7c20) 10000000:00010000:1.0:1789785425.766522:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64600/0x2f18ee3fd845d5ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f18ee3fd845d5b4 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.766530:0:17963:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9daf814baa00/0x2f18ee3fd845d6a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845d69b expref: 24 pid: 17205 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785425.766530:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64600/0x2f18ee3fd845d5ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f18ee3fd845d5b4 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789785425.766538:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64600/0x2f18ee3fd845d5ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f18ee3fd845d5b4 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785425.766543:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1789785425.766560:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1789785425.766563:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64600/0x2f18ee3fd845d5ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d5b4 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785425.766570:0:20236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20236:1876725549182336:0@lo:104: 00000100:00100000:2.0:1789785425.766571:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84526d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:3662:x1876725549182720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789785425.766571:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789785425.766584:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64600/0x2f18ee3fd845d5ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d5b4 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.766587:0:17963:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789785425.766591:0:20236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacaead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20236:1876725549182464:0@lo:104: 00010000:00010000:2.0:1789785425.766593:0:17963:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9daf814baa00/0x2f18ee3fd845d6a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845d69b expref: 24 pid: 17205 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785425.766593:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dafc1a64600/0x2f18ee3fd845d5ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d5b4 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.766606:0:17963:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9daf814baa00/0x2f18ee3fd845d6a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845d69b expref: 24 pid: 17205 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785425.766607:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785425.766608:0:20236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacaeb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20236:1876725549182592:0@lo:104: 00010000:00010000:1.0:1789785425.766610:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785425.766612:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789785425.766623:0:17963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9daf814baa00/0x2f18ee3fd845d6a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845d69b expref: 24 pid: 17205 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.766636:0:17963:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785425.766663:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84526d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad642144-cf43-4df2-a5e5-a426cdb5453e+23:3662:x1876725549182720:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785425.766669:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1789785425.766714:0:18743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff9dae81eac800/0x2f18ee3fd845d69b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f18ee3fd845d6a2 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785425.766728:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785425.766729:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785425.766731:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785425.766877:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad642144-cf43-4df2-a5e5-a426cdb5453e:3661:1876725549183104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789785425.766961:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785425.767023:0:20236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacae9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20236:1876725549181952:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789785425.767033:0:20236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacaea680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20236:1876725549182080:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785425.767066:0:20236:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9daf814bb000/0x2f18ee3fd845d91f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785425.767483:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549183104 00000100:00100000:2.0:1789785425.767490:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549183104 00010000:00010000:2.0:1789785425.767516:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dae81eacc00/0x2f18ee3fd845d5b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845d5ad expref: 23 pid: 17205 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785425.767547:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789785425.767556:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf452300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad642144-cf43-4df2-a5e5-a426cdb5453e+23:3661:x1876725549183104:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789785425.767564:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00010000:00010000:2.0:1789785425.767579:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785425.767586:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dae81eacc00/0x2f18ee3fd845d5b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845d5ad expref: 23 pid: 17205 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.767607:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dae81eacc00/0x2f18ee3fd845d5b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845d5ad expref: 23 pid: 17205 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.767623:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dae81eacc00/0x2f18ee3fd845d5b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845d5ad expref: 23 pid: 17205 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.767634:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785425.767670:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf452300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad642144-cf43-4df2-a5e5-a426cdb5453e+22:3661:x1876725549183104:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785425.767676:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789785425.767690:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530227584 00000100:00100000:2.0:1789785425.767694:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530227584 00010000:00010000:2.0:1789785425.767707:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafb5d55c00/0x2f18ee3fd845d8af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8a53 expref: 13 pid: 17204 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785425.767726:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:2.0:1789785425.767733:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacaea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49f881b2-94cc-4d23-9aec-10664f83ddca+13:2398:x1876725530227584:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789785425.767741:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785425.767745:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafb5d55c00/0x2f18ee3fd845d8af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8a53 expref: 13 pid: 17204 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.767754:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafb5d55c00/0x2f18ee3fd845d8af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8a53 expref: 13 pid: 17204 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.767766:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafb5d55c00/0x2f18ee3fd845d8af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8a53 expref: 13 pid: 17204 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.767781:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785425.768051:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785425.768569:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacaea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49f881b2-94cc-4d23-9aec-10664f83ddca+12:2398:x1876725530227584:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 833us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785425.768578:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:2.0:1789785425.768597:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530227456 00000100:00100000:2.0:1789785425.768602:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530227456 00010000:00010000:2.0:1789785425.768619:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dafb5d55800/0x2f18ee3fd845d8ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8ac3 expref: 12 pid: 17204 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785425.768636:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00100000:2.0:1789785425.768643:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49f881b2-94cc-4d23-9aec-10664f83ddca+12:2397:x1876725530227456:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789785425.768652:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785425.768657:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dafb5d55800/0x2f18ee3fd845d8ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8ac3 expref: 12 pid: 17204 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.768666:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dafb5d55800/0x2f18ee3fd845d8ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8ac3 expref: 12 pid: 17204 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.768679:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dafb5d55800/0x2f18ee3fd845d8ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8ac3 expref: 12 pid: 17204 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.768688:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785425.768713:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49f881b2-94cc-4d23-9aec-10664f83ddca+11:2397:x1876725530227456:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 70us (663us total) trans 0 rc 0/0 00010000:00010000:1.0:1789785425.768713:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789785425.768719:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00100000:1.0:1789785425.768756:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad642144-cf43-4df2-a5e5-a426cdb5453e:3662:1876725549182720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789785425.768759:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad642144-cf43-4df2-a5e5-a426cdb5453e:3661:1876725549183104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789785425.768782:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad642144-cf43-4df2-a5e5-a426cdb5453e:3660:1876725549182976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789785425.769398:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad642144-cf43-4df2-a5e5-a426cdb5453e:3659:1876725549182848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789785425.771826:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785425.773832:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549182976 00000100:00100000:2.0:1789785425.773845:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549182976 00010000:00010000:2.0:1789785425.773911:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dae81eac000/0x2f18ee3fd845d5c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845d5bb expref: 22 pid: 17205 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785425.773957:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789785425.773966:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad642144-cf43-4df2-a5e5-a426cdb5453e+22:3660:x1876725549182976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789785425.774004:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785425.774011:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dae81eac000/0x2f18ee3fd845d5c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845d5bb expref: 22 pid: 17205 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.774021:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dae81eac000/0x2f18ee3fd845d5c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845d5bb expref: 22 pid: 17205 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.774050:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dae81eac000/0x2f18ee3fd845d5c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845d5bb expref: 22 pid: 17205 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.774067:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785425.774138:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:3660:x1876725549182976:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (2319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785425.774145:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789785425.777233:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785425.777433:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549182848 00000100:00100000:2.0:1789785425.777443:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549182848 00010000:00010000:2.0:1789785425.777480:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dae81eaca00/0x2f18ee3fd845d601 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845d5fa expref: 21 pid: 17206 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785425.777525:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789785425.777535:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf452d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:3659:x1876725549182848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789785425.777549:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785425.777569:0:17197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dae81eaca00/0x2f18ee3fd845d601 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f18ee3fd845d5fa expref: 21 pid: 17206 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.777581:0:17197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dae81eaca00/0x2f18ee3fd845d601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f18ee3fd845d5fa expref: 21 pid: 17206 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.777597:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dae81eaca00/0x2f18ee3fd845d601 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f18ee3fd845d5fa expref: 21 pid: 17206 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.777615:0:17197:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9daf814bb000/0x2f18ee3fd845d91f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.777623:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9daf814bb000/0x2f18ee3fd845d91f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.777638:0:17197:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9daf814bb000/0x2f18ee3fd845d91f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.777646:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9daf814bb000/0x2f18ee3fd845d91f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.777651:0:17197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9daf814bb000/0x2f18ee3fd845d91f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.777657:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9daf814bb000/0x2f18ee3fd845d91f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.777663:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bb000 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:2.0:1789785425.777667:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9daf814bb000/0x2f18ee3fd845d91f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.777674:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9daf814bb000/0x2f18ee3fd845d91f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.777700:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9daf814bb000/0x2f18ee3fd845d91f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785425.777710:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785425.777752:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf452d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad642144-cf43-4df2-a5e5-a426cdb5453e+20:3659:x1876725549182848:12345-0@lo:103:ldlm_bl.0 Request processed in 218us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785425.777759:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789785425.777798:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad642144-cf43-4df2-a5e5-a426cdb5453e:3659:1876725549182848:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789785425.777992:0:20236:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9daf814bb000/0x2f18ee3fd845d91f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785425.778001:0:20236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9daf814bb000/0x2f18ee3fd845d91f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785425.778007:0:20236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9daf814bb000/0x2f18ee3fd845d91f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785425.780185:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad642144-cf43-4df2-a5e5-a426cdb5453e:3660:1876725549182976:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789785426.631353:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785427.499214:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785427.500869:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530227712 00000100:00100000:2.0:1789785427.500879:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530227712 00000100:00100000:2.0:1789785427.501021:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 148 00000100:00100000:2.0:1789785427.501033:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49f881b2-94cc-4d23-9aec-10664f83ddca+11:14919:x1876725530227712:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789785427.501048:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785427.501068:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1b08200/0x2f18ee3fd845d926 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8afb expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785427.501095:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1b08200/0x2f18ee3fd845d926 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8afb expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785427.501107:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1b08200/0x2f18ee3fd845d926 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8afb expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785427.501116:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b08200, rc 0) 00000100:00100000:2.0:1789785427.501173:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49f881b2-94cc-4d23-9aec-10664f83ddca+12:14919:x1876725530227712:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 Request processed in 143us (1967us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785427.501181:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 148 00000100:00100000:2.0:1789785427.520028:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785427.520236:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530227840 00000100:00100000:3.0:1789785427.520246:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530227840 00000100:00100000:3.0:1789785427.520366:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 149 00000100:00100000:3.0:1789785427.520378:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+12:14919:x1876725530227840:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789785427.520540:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+12:14919:x1876725530227840:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 Request processed in 165us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785427.520547:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 149 00000100:00100000:2.0:1789785427.529162:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785427.529834:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530227968 00000100:00100000:3.0:1789785427.529844:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530227968 00000100:00100000:3.0:1789785427.529896:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 150 00000100:00100000:3.0:1789785427.529905:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49f881b2-94cc-4d23-9aec-10664f83ddca+12:14919:x1876725530227968:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789785427.531457:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49f881b2-94cc-4d23-9aec-10664f83ddca+12:14919:x1876725530227968:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 Request processed in 1543us (2296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785427.531479:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 150 00000100:00100000:3.0:1789785427.554837:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785427.555043:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530228096 00000100:00100000:0.0:1789785427.555059:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530228096 00000100:00100000:0.0:1789785427.555115:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 151 00000100:00100000:0.0:1789785427.555126:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49f881b2-94cc-4d23-9aec-10664f83ddca+12:14919:x1876725530228096:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789785427.555143:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785427.555160:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9daf80031200/0x2f18ee3fd845d92d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8b02 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785427.555187:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9daf80031200/0x2f18ee3fd845d92d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b02 expref: 13 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785427.555198:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9daf80031200/0x2f18ee3fd845d92d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b02 expref: 13 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785427.555207:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf80031200, rc 0) 00000100:00100000:0.0:1789785427.555265:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:49f881b2-94cc-4d23-9aec-10664f83ddca+13:14919:x1876725530228096:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 Request processed in 141us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785427.555272:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 151 00000100:00100000:3.0:1789785427.580646:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785427.580744:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530228224 00000100:00100000:1.0:1789785427.580754:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530228224 00000100:00100000:1.0:1789785427.580814:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 152 00000100:00100000:1.0:1789785427.580824:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+13:14919:x1876725530228224:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789785427.580961:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+13:14919:x1876725530228224:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 Request processed in 138us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785427.580969:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 152 00000100:00100000:0.0:1789785427.583997:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785427.584381:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530228352 00000100:00100000:3.0:1789785427.584390:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530228352 00000100:00100000:3.0:1789785427.584447:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 153 00000100:00100000:3.0:1789785427.584461:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49f881b2-94cc-4d23-9aec-10664f83ddca+13:14919:x1876725530228352:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789785427.584587:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49f881b2-94cc-4d23-9aec-10664f83ddca+13:14919:x1876725530228352:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 Request processed in 126us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785427.584594:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 153 10000000:01000000:1.0:1789785427.652092:0:17209:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789785427.652100:0:17209:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dae8353e800 from 13 10000000:01000000:1.0:1789785427.652106:0:17209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789785427.652149:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca000/0x2f18ee3fd845d934 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785427.652172:0:17209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca000/0x2f18ee3fd845d934 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785427.652196:0:17209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca000/0x2f18ee3fd845d934 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785427.652222:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549183232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789785427.652287:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785427.652329:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84422300 going to sleep for 11 seconds 00000100:00100000:1.0:1789785427.652367:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549183232 00000100:00100000:1.0:1789785427.652374:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549183232 00000100:00100000:1.0:1789785427.652436:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789785427.652446:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+20:17209:x1876725549183232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789785427.652460:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785427.652472:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc21cac00/0x2f18ee3fd845d93b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d934 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785427.654869:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc21cac00/0x2f18ee3fd845d93b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d934 expref: 21 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785427.654891:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc21cac00/0x2f18ee3fd845d93b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d934 expref: 21 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785427.654902:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc21cac00, rc 0) 00000100:00100000:1.0:1789785427.655434:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:17209:x1876725549183232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2987us (3144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785427.655444:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789785427.656094:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549183232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789785427.656115:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca000/0x2f18ee3fd845d934 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d93b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785427.656126:0:17209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca000/0x2f18ee3fd845d934 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d93b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785427.656863:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785427.658223:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafacaeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549183360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789785427.658290:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785427.658334:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf849e5480 going to sleep for 11 seconds 00000100:00100000:1.0:1789785427.659726:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549183360 00000100:00100000:1.0:1789785427.659745:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549183360 00000100:00100000:1.0:1789785427.659802:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789785427.659811:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:17209:x1876725549183360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789785427.660448:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:17209:x1876725549183360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 636us (2156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785427.660456:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789785427.660813:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafacaeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549183360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789785427.660869:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca24a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549183488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789785427.660927:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785427.661075:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf844223c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789785427.662819:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549183488 00000100:00100000:3.0:1789785427.662831:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549183488 00000100:00100000:3.0:1789785427.662930:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789785427.662941:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:17209:x1876725549183488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789785427.663146:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:17209:x1876725549183488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (2218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785427.663154:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789785427.663630:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca24a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549183488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789785427.667468:0:20336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789785427.667917:0:17209:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789785427.668013:0:17209:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789785427.668026:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca000/0x2f18ee3fd845d934 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d93b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785427.668127:0:17209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc21ca000/0x2f18ee3fd845d934 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d93b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789785427.668164:0:17209:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789785427.668167:0:17209:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9daf84978000 from 13 10000000:01000000:0.0:1789785427.668170:0:17209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789785427.673129:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf80031600/0x2f18ee3fd845d942 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785427.673153:0:17209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9daf80031600/0x2f18ee3fd845d942 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785427.673166:0:17209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9daf80031600/0x2f18ee3fd845d942 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785427.673199:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf451f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549183616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789785427.673272:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785427.673330:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafa58d2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789785427.673417:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549183616 00000100:00100000:2.0:1789785427.673425:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549183616 00000100:00100000:2.0:1789785427.673484:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789785427.673494:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+21:17209:x1876725549183616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789785427.673508:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785427.673524:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc1b08e00/0x2f18ee3fd845d949 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d942 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785427.673549:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc1b08e00/0x2f18ee3fd845d949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d942 expref: 22 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785427.673569:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc1b08e00/0x2f18ee3fd845d949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d942 expref: 22 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785427.673579:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b08e00, rc 0) 00000100:00100000:2.0:1789785427.673694:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+22:17209:x1876725549183616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785427.673701:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789785427.673767:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf451f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549183616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789785427.673785:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9daf80031600/0x2f18ee3fd845d942 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d949 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785427.673798:0:17209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9daf80031600/0x2f18ee3fd845d942 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d949 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785427.673894:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549183744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789785427.673927:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785427.673958:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf844226c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789785427.674118:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549183744 00000100:00100000:2.0:1789785427.674123:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549183744 00000100:00100000:2.0:1789785427.674160:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789785427.674246:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+22:17209:x1876725549183744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789785427.674398:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+22:17209:x1876725549183744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785427.674419:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789785427.674879:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549183744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789785427.674928:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549183872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789785427.674996:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785427.675021:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf844226c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789785427.675135:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549183872 00000100:00100000:0.0:1789785427.675140:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549183872 00000100:00100000:0.0:1789785427.675177:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789785427.675191:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+22:17209:x1876725549183872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789785427.675289:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+22:17209:x1876725549183872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785427.675297:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789785427.676152:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549183872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789785427.685294:0:20337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789785427.687140:0:17209:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789785427.687173:0:17209:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789785427.687192:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9daf80031600/0x2f18ee3fd845d942 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d949 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785427.687205:0:17209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9daf80031600/0x2f18ee3fd845d942 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d949 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789785427.687215:0:17209:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789785427.687218:0:17209:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9daf89062000 from 13 10000000:01000000:2.0:1789785427.687221:0:17209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789785427.687260:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845d950 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785427.687268:0:17209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845d950 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785427.687278:0:17209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845d950 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785427.687302:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84526d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549184000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789785427.688126:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785427.688180:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1ae3480 going to sleep for 11 seconds 00000100:00100000:0.0:1789785427.688484:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549184000 00000100:00100000:0.0:1789785427.688733:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549184000 00000100:00100000:0.0:1789785427.688859:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789785427.688869:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+22:17209:x1876725549184000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789785427.688884:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785427.688914:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9daf80030e00/0x2f18ee3fd845d957 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d950 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785427.688939:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9daf80030e00/0x2f18ee3fd845d957 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d950 expref: 23 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785427.689060:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9daf80030e00/0x2f18ee3fd845d957 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d950 expref: 23 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785427.689069:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf80030e00, rc 0) 00000100:00100000:0.0:1789785427.689130:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+23:17209:x1876725549184000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 263us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785427.689136:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789785427.689219:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84526d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549184000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789785427.689234:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845d950 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d957 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785427.689243:0:17209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845d950 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d957 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785427.689515:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84526d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549184128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789785427.689585:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785427.689609:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1ae3480 going to sleep for 11 seconds 00000100:00100000:1.0:1789785427.689823:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549184128 00000100:00100000:1.0:1789785427.689829:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549184128 00000100:00100000:1.0:1789785427.689863:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789785427.689870:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+23:17209:x1876725549184128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789785427.689998:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+23:17209:x1876725549184128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785427.690004:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789785427.690127:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84526d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549184128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789785427.690157:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84526d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549184256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789785427.690264:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785427.690335:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1ae3480 going to sleep for 11 seconds 00000100:00100000:0.0:1789785427.691815:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549184256 00000100:00100000:0.0:1789785427.691823:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549184256 00000100:00100000:0.0:1789785427.692032:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789785427.692042:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+23:17209:x1876725549184256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789785427.692180:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+23:17209:x1876725549184256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (1913us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785427.692195:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789785427.693050:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84526d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549184256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789785427.696826:0:20339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789785427.699060:0:17209:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789785427.699099:0:17209:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789785427.699111:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845d950 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d957 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785427.699124:0:17209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc1b09c00/0x2f18ee3fd845d950 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d957 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789785427.699135:0:17209:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789785427.699138:0:17209:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dafb11eb000 from 13 10000000:01000000:1.0:1789785427.699141:0:17209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789785427.699179:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb200/0x2f18ee3fd845d95e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785427.699195:0:17209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb200/0x2f18ee3fd845d95e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785427.699205:0:17209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb200/0x2f18ee3fd845d95e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785427.699232:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549184384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789785427.699298:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785427.699376:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84422480 going to sleep for 11 seconds 00000100:00100000:1.0:1789785427.699426:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549184384 00000100:00100000:1.0:1789785427.699434:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549184384 00000100:00100000:1.0:1789785427.699477:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789785427.699486:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+23:17209:x1876725549184384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789785427.700248:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785427.700267:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dafc21caa00/0x2f18ee3fd845d965 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f18ee3fd845d95e expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785427.700293:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dafc21caa00/0x2f18ee3fd845d965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f18ee3fd845d95e expref: 24 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785427.700304:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dafc21caa00/0x2f18ee3fd845d965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f18ee3fd845d95e expref: 24 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785427.700322:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc21caa00, rc 0) 00000100:00100000:1.0:1789785427.700396:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:17209:x1876725549184384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 910us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785427.700411:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789785427.700472:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549184384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789785427.700486:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb200/0x2f18ee3fd845d95e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d965 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785427.700608:0:17209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb200/0x2f18ee3fd845d95e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f18ee3fd845d965 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785427.700688:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549184512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789785427.705053:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785427.705132:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84422480 going to sleep for 11 seconds 00000100:00100000:3.0:1789785427.705243:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549184512 00000100:00100000:3.0:1789785427.705263:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549184512 00000100:00100000:3.0:1789785427.705384:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789785427.705400:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:17209:x1876725549184512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789785427.705661:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:17209:x1876725549184512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785427.705670:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789785427.705852:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549184512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789785427.705910:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafaca25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549184640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789785427.706089:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785427.706124:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84422480 going to sleep for 11 seconds 00000100:00100000:3.0:1789785427.706153:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549184640 00000100:00100000:3.0:1789785427.706160:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549184640 00000100:00100000:3.0:1789785427.706208:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789785427.706216:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:17209:x1876725549184640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789785427.706324:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:17209:x1876725549184640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785427.706331:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789785427.706439:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafaca25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad642144-cf43-4df2-a5e5-a426cdb5453e:17209:1876725549184640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789785427.708421:0:20340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789785427.709370:0:17209:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789785427.709421:0:17209:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789785427.709435:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb200/0x2f18ee3fd845d95e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d965 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785427.709449:0:17209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff9dafc21cb200/0x2f18ee3fd845d95e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f18ee3fd845d965 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785428.679301:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785428.988477:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785428.988571:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785428.988604:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785428.988630:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785428.988656:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785428.988675:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785428.988693:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785428.988710:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785428.988731:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785428.988760:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530228608 00000100:00100000:3.0:1789785428.988769:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530228608 00000100:00100000:3.0:1789785428.988834:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530229120 00000100:00100000:3.0:1789785428.988837:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530229120 00000100:00100000:3.0:1789785428.988851:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530228736 00000100:00100000:3.0:1789785428.988853:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530228736 00000100:00100000:3.0:1789785428.988864:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530229248 00000100:00100000:3.0:1789785428.988866:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530229248 00000100:00100000:3.0:1789785428.988904:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 50 00000100:00100000:3.0:1789785428.988914:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacaead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251bae80-9c0c-4669-a294-80064a3e231a+6:2398:x1876725530228608:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785428.988990:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacaead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251bae80-9c0c-4669-a294-80064a3e231a+6:2398:x1876725530228608:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 77us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785428.988998:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 50 00000100:00100000:1.0:1789785428.989230:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530228864 00000100:00100000:1.0:1789785428.989235:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530228864 00000100:00100000:1.0:1789785428.989257:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530229376 00000100:00100000:1.0:1789785428.989260:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530229376 00000100:00100000:1.0:1789785428.989273:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530228992 00000100:00100000:1.0:1789785428.989275:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530228992 00000100:00100000:1.0:1789785428.989285:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530229504 00000100:00100000:1.0:1789785428.989287:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530229504 00000100:00100000:1.0:1789785428.989299:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:1.0:1789785428.989307:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251bae80-9c0c-4669-a294-80064a3e231a+5:2398:x1876725530228864:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785428.989367:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251bae80-9c0c-4669-a294-80064a3e231a+5:2398:x1876725530228864:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 30us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785428.989375:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:1.0:1789785428.989410:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:1.0:1789785428.989418:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacaebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6563e207-f568-458d-9d37-e81c107e6f83+5:2398:x1876725530229376:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785428.989443:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacaebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6563e207-f568-458d-9d37-e81c107e6f83+5:2398:x1876725530229376:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 27us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785428.989449:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:1.0:1789785428.989461:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 18 00000100:00100000:1.0:1789785428.989467:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacaeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251bae80-9c0c-4669-a294-80064a3e231a+5:2398:x1876725530228992:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785428.989489:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacaeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251bae80-9c0c-4669-a294-80064a3e231a+5:2398:x1876725530228992:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 22us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785428.989494:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 18 00000100:00100000:1.0:1789785428.989504:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:1.0:1789785428.989510:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacaea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6563e207-f568-458d-9d37-e81c107e6f83+5:2398:x1876725530229504:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785428.989529:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacaea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6563e207-f568-458d-9d37-e81c107e6f83+5:2398:x1876725530229504:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 20us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785428.989535:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:1.0:1789785428.989554:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530228480 00000100:00100000:1.0:1789785428.989557:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530228480 00000100:00100000:1.0:1789785428.989582:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 166 00000100:00100000:1.0:1789785428.989588:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf877ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+13:2398:x1876725530228480:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785428.989612:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf877ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:49f881b2-94cc-4d23-9aec-10664f83ddca+13:2398:x1876725530228480:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 24us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785428.989619:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 166 00000100:00100000:1.0:1789785428.989731:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 51 00000100:00100000:1.0:1789785428.989739:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6563e207-f568-458d-9d37-e81c107e6f83+6:2398:x1876725530229120:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785428.989771:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6563e207-f568-458d-9d37-e81c107e6f83+6:2398:x1876725530229120:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 32us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785428.989777:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 51 00000100:00100000:1.0:1789785428.989818:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 52 00000100:00100000:1.0:1789785428.989825:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacaeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+5:2398:x1876725530228736:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785428.989848:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacaeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+5:2398:x1876725530228736:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 24us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785428.989854:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 52 00000100:00100000:1.0:1789785428.989864:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 53 00000100:00100000:1.0:1789785428.989869:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacaeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6563e207-f568-458d-9d37-e81c107e6f83+5:2398:x1876725530229248:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785428.989886:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacaeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6563e207-f568-458d-9d37-e81c107e6f83+5:2398:x1876725530229248:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 17us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785428.989891:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 53 00000100:00080000:0.0:1789785428.990579:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789785428.990586:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789785428.990589:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789785428.990591:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789785429.236754:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785429.236927:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530229632 00000100:00100000:1.0:1789785429.236937:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530229632 00000100:00100000:1.0:1789785429.237004:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 23 00000100:00100000:1.0:1789785429.237015:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+6:15586:x1876725530229632:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789785429.237035:0:19042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785429.237056:0:19042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb400/0x2f18ee3fd845d96c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8b09 expref: -99 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.237136:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cba00/0x2f18ee3fd845d973 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.237150:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cba00/0x2f18ee3fd845d973 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.237177:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cba00/0x2f18ee3fd845d973 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.237193:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845d97a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.237200:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845d97a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.237206:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845d97a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.237293:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca200/0x2f18ee3fd845d981 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.237301:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca200/0x2f18ee3fd845d981 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.237308:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca200/0x2f18ee3fd845d981 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789785429.237371:0:19042:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789785429.237375:0:19042:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789785429.237425:0:19042:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca200/0x2f18ee3fd845d981 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.237435:0:19042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cba00/0x2f18ee3fd845d973 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.237440:0:19042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cba00/0x2f18ee3fd845d973 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.237455:0:19042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cba00/0x2f18ee3fd845d973 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.237460:0:19042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc21cba00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785429.237463:0:19042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cba00/0x2f18ee3fd845d973 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.237470:0:19042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cba00/0x2f18ee3fd845d973 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.237480:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dae827bf900) 00010000:00010000:1.0:1789785429.237483:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785429.237487:0:19042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cba00/0x2f18ee3fd845d973 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.237492:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cba00/0x2f18ee3fd845d973 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.237506:0:19042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845d97a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.237512:0:19042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845d97a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.237516:0:19042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845d97a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.237520:0:19042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc21cb000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785429.237523:0:19042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845d97a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.237539:0:19042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845d97a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.237547:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9dae827c1e00) 00010000:00010000:1.0:1789785429.237550:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785429.237553:0:19042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845d97a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.237558:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845d97a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.237591:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb400/0x2f18ee3fd845d96c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b09 expref: 8 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.237604:0:19042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca200/0x2f18ee3fd845d981 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b09 expref: 7 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.237610:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dae827c1500) 00010000:00010000:1.0:1789785429.237613:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789785429.237615:0:19042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc21ca200, rc 0) 00000100:00100000:1.0:1789785429.237674:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+7:15586:x1876725530229632:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 661us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785429.237682:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 23 00000100:00100000:0.0:1789785429.248123:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785429.252446:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530229760 00000100:00100000:2.0:1789785429.252463:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530229760 00000100:00100000:2.0:1789785429.252546:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:2.0:1789785429.252558:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf450380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:251bae80-9c0c-4669-a294-80064a3e231a+7:15586:x1876725530229760:12345-192.168.203.46@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789785429.253039:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf450380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:251bae80-9c0c-4669-a294-80064a3e231a+7:15586:x1876725530229760:12345-192.168.203.46@tcp:900:lhsmtool_posix.0 Request processed in 481us (4924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785429.253048:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:3.0:1789785429.262050:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785429.262521:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530230016 00000100:00100000:0.0:1789785429.262553:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530230016 00000100:00100000:0.0:1789785429.263951:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 24 00000100:00100000:0.0:1789785429.263981:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafacae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+7:15586:x1876725530230016:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789785429.264012:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785429.264045:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d988 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8b10 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.264162:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d98f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.264181:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d98f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.264197:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d98f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.270660:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d996 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.270689:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d996 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.270704:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d996 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.271046:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845d99d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.271056:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845d99d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.271066:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845d99d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785429.271093:0:17213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789785429.271263:0:17213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d98f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.271271:0:17213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d98f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.271278:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d98f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.271284:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf80030c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785429.271289:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d98f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.271297:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d98f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.271309:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dae827c1500) 00010000:00010000:0.0:1789785429.271312:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785429.271316:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d98f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.271322:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d98f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.271335:0:17213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d996 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.271410:0:17213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d996 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.271427:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d996 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.271432:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf80030a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785429.271434:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d996 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.271440:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d996 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.271448:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9dae8266e100) 00010000:00010000:0.0:1789785429.271450:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785429.271453:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d996 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.271459:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d996 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.277838:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d988 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b10 expref: 10 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.277867:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80031a00/0x2f18ee3fd845d99d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b10 expref: 9 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.277877:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dae8266ed00) 00010000:00010000:0.0:1789785429.277880:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785429.277883:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf80031a00, rc 0) 00000100:00100000:0.0:1789785429.277966:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafacae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+9:15586:x1876725530230016:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 13998us (15931us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789785429.277993:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 24 00000100:00100000:0.0:1789785429.285746:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785429.286546:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530230144 00000100:00100000:1.0:1789785429.286558:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530230144 00000100:00100000:1.0:1789785429.286626:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 25 00000100:00100000:1.0:1789785429.286637:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+9:15586:x1876725530230144:12345-192.168.203.46@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789785429.286771:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+9:15586:x1876725530230144:12345-192.168.203.46@tcp:59:lhsmtool_posix.0 Request processed in 135us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785429.286779:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 25 00000100:00100000:1.0:1789785429.291565:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785429.292401:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530230272 00000100:00100000:3.0:1789785429.292412:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530230272 00000100:00100000:3.0:1789785429.292470:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 26 00000100:00100000:3.0:1789785429.292481:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251bae80-9c0c-4669-a294-80064a3e231a+5:15586:x1876725530230272:12345-192.168.203.46@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1789785429.302808:0:17212:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 10284us 00000100:00100000:3.0:1789785429.334966:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251bae80-9c0c-4669-a294-80064a3e231a+5:15586:x1876725530230272:12345-192.168.203.46@tcp:59:lhsmtool_posix.0 Request processed in 42475us (43399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785429.334980:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 26 00000100:00100000:0.0:1789785429.355238:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785429.355388:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530230400 00000100:00100000:1.0:1789785429.355407:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530230400 00000100:00100000:1.0:1789785429.355469:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 27 00000100:00100000:1.0:1789785429.355479:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+9:15592:x1876725530230400:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789785429.355499:0:19042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785429.355520:0:19042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845d9ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8b17 expref: -99 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.355584:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cba00/0x2f18ee3fd845d9b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.355598:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cba00/0x2f18ee3fd845d9b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.355610:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cba00/0x2f18ee3fd845d9b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.355627:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845d9b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.355635:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845d9b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.355642:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845d9b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.355697:0:19042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cba00/0x2f18ee3fd845d9b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.355703:0:19042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cba00/0x2f18ee3fd845d9b2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.355720:0:19042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cba00/0x2f18ee3fd845d9b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.355727:0:19042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc21cba00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785429.355731:0:19042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cba00/0x2f18ee3fd845d9b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.355739:0:19042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cba00/0x2f18ee3fd845d9b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.355751:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dae827bf900) 00010000:00010000:1.0:1789785429.355753:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785429.355757:0:19042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cba00/0x2f18ee3fd845d9b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.355763:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cba00/0x2f18ee3fd845d9b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.355777:0:19042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845d9b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.355783:0:19042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845d9b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.355788:0:19042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845d9b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.355799:0:19042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc21ca600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785429.355802:0:19042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845d9b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.355809:0:19042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845d9b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.355817:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9dae827c1e00) 00010000:00010000:1.0:1789785429.355819:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785429.355822:0:19042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845d9b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.355828:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845d9b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.355861:0:19042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845d9ab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b17 expref: 10 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.355871:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dae827bf900) 00010000:00010000:1.0:1789785429.355873:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785429.355877:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845d9ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b17 expref: 10 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785429.355885:0:19042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc21cb000, rc 0) 00000100:00100000:0.0:1789785429.362033:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+9:15592:x1876725530230400:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 6543us (6802us total) trans 0 rc 301/301 00000100:00100000:0.0:1789785429.362046:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 27 00000100:00100000:1.0:1789785429.377428:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785429.377848:0:17220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530230528 00000100:00100000:2.0:1789785429.377859:0:17220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530230528 00000100:00100000:2.0:1789785429.378095:0:17220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 0 00000100:00100000:2.0:1789785429.378106:0:17220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:251bae80-9c0c-4669-a294-80064a3e231a+9:15592:x1876725530230528:12345-192.168.203.46@tcp:700:lfs.0 00000100:00100000:2.0:1789785429.378671:0:17220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:251bae80-9c0c-4669-a294-80064a3e231a+9:15592:x1876725530230528:12345-192.168.203.46@tcp:700:lfs.0 Request processed in 565us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785429.378681:0:17220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 0 00000100:00100000:0.0:1789785429.381648:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785429.381832:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530230784 00000100:00100000:3.0:1789785429.381842:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530230784 00000100:00100000:3.0:1789785429.381899:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 28 00000100:00100000:3.0:1789785429.381909:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+9:15592:x1876725530230784:12345-192.168.203.46@tcp:36:lfs.0 00010000:00010000:3.0:1789785429.381959:0:17213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785429.381987:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845d8d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8a84 expref: 9 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.382008:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dae827bf900) 00010000:00010000:3.0:1789785429.382013:0:17213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789785429.382067:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d9c0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.382095:0:17213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845d918 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8af4 expref: 5 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.382104:0:17213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d9c0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.382134:0:17213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845d918 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8af4 expref: 5 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.382148:0:17213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845d918 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8af4 expref: 5 pid: 17213 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785429.382162:0:17213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17213:1876725549184768:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789785429.382560:0:17213:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf85440000 going to sleep for 11 seconds 00000100:00100000:0.0:1789785429.388035:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785429.388106:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530230912 00000100:00100000:2.0:1789785429.388114:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530230912 00010000:00010000:2.0:1789785429.388168:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845d918 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8af4 expref: 6 pid: 17213 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785429.388182:0:17213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17213:1876725549184768:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785429.388206:0:17213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d9c0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785429.388223:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 15 00000100:00100000:2.0:1789785429.388233:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf452300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6563e207-f568-458d-9d37-e81c107e6f83+6:2398:x1876725530230912:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789785429.388247:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785429.388254:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845d918 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8af4 expref: 6 pid: 17213 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785429.388266:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845d918 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8af4 expref: 6 pid: 17213 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785429.388288:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845d918 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8af4 expref: 6 pid: 17213 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785429.388306:0:17196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dae827bf900) 00010000:00010000:2.0:1789785429.388311:0:17196:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d9c0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785429.388320:0:17196:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d9c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785429.388333:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d9c0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785429.388377:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785429.388441:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf452300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6563e207-f568-458d-9d37-e81c107e6f83+5:2398:x1876725530230912:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 208us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785429.388448:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 15 00010000:00010000:3.0:1789785429.388518:0:17213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d9c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.388526:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d9c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.388552:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845d9c7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.388562:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845d9c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.388575:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845d9c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.396308:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d9ce lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.396330:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d9ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.396470:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d9ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789785429.396492:0:17213:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9a80330 reply state 0000000014deebf0 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d9ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.396503:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d9ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.396511:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dae8266e100) 00010000:00010000:0.0:1789785429.396514:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789785429.396517:0:17213:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789785429.396522:0:17213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789785429.396534:0:17213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d9c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.396553:0:17213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d9c0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.396560:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d9c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.396566:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814ba600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785429.396570:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d9c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.396578:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d9c0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.396589:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dae827bf900) 00010000:00010000:0.0:1789785429.396592:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785429.396596:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d9c0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.396602:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d9c0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789785429.396621:0:17213:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9a80330 reply state 0000000014deebf0 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845d9c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.396711:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845d9c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.396718:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9dafac970400) 00010000:00010000:0.0:1789785429.396720:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789785429.396723:0:17213:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789785429.396881:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+10:15592:x1876725530230784:12345-192.168.203.46@tcp:36:lfs.0 Request processed in 14969us (15237us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789785429.396896:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 28 00000100:00100000:0.0:1789785429.485318:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785429.485385:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530231040 00000100:00100000:2.0:1789785429.485404:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530231040 00000100:00100000:3.0:1789785429.485530:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 29 00000100:00100000:3.0:1789785429.485543:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251bae80-9c0c-4669-a294-80064a3e231a+10:15600:x1876725530231040:12345-192.168.203.46@tcp:101:lctl.0 00010000:00010000:3.0:1789785429.485566:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785429.485589:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845d9d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8b1e expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.485660:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d9dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.485674:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d9dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.485686:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d9dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785429.485742:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789785429.485746:0:17211:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789785429.485784:0:17211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d9dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.485809:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845d9d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b1e expref: 12 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.485828:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bae00/0x2f18ee3fd845d9dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b1e expref: 11 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.485856:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafac970c00) 00010000:00010000:3.0:1789785429.485858:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789785429.485862:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bae00, rc 0) 00000100:00100000:3.0:1789785429.485923:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251bae80-9c0c-4669-a294-80064a3e231a+11:15600:x1876725530231040:12345-192.168.203.46@tcp:101:lctl.0 Request processed in 383us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785429.485931:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 29 00000100:00100000:1.0:1789785429.523650:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785429.523840:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530231168 00000100:00100000:3.0:1789785429.523849:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530231168 00000100:00100000:3.0:1789785429.523933:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 30 00000100:00100000:3.0:1789785429.523942:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafaca24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6563e207-f568-458d-9d37-e81c107e6f83+5:15601:x1876725530231168:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789785429.523963:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785429.523984:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845d9e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8b25 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.524051:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d9ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.524062:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.524070:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785429.524148:0:17212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789785429.524153:0:17212:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789785429.524175:0:17212:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.524836:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845d9e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b25 expref: 7 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.524859:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba600/0x2f18ee3fd845d9ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b25 expref: 6 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.524867:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafac970c00) 00010000:00010000:3.0:1789785429.524869:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789785429.524872:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814ba600, rc 0) 00000100:00100000:3.0:1789785429.524936:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafaca24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6563e207-f568-458d-9d37-e81c107e6f83+6:15601:x1876725530231168:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 995us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785429.524953:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 30 00000100:00100000:1.0:1789785429.528051:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785429.528237:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530231296 00000100:00100000:0.0:1789785429.528247:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530231296 00000100:00100000:0.0:1789785429.528335:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 31 00000100:00100000:0.0:1789785429.528370:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6563e207-f568-458d-9d37-e81c107e6f83+6:15601:x1876725530231296:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:0.0:1789785429.528389:0:19042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785429.528418:0:19042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d9f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8b2c expref: -99 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.528492:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d9f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.528505:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d9f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.528516:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d9f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.528528:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d9ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.528535:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d9ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.528541:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d9ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.528686:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eec00/0x2f18ee3fd845da06 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.528700:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eec00/0x2f18ee3fd845da06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.528706:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eec00/0x2f18ee3fd845da06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785429.528744:0:19042:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789785429.528747:0:19042:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789785429.528766:0:19042:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eec00/0x2f18ee3fd845da06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.528845:0:19042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d9f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.528855:0:19042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d9f8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.528861:0:19042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d9f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.528867:0:19042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf80030600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785429.528870:0:19042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d9f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.528877:0:19042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d9f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.528888:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafac970c00) 00010000:00010000:0.0:1789785429.528891:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785429.528895:0:19042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d9f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.528911:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030600/0x2f18ee3fd845d9f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.528925:0:19042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d9ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.528931:0:19042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d9ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.528937:0:19042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d9ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.528942:0:19042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf80030a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785429.528945:0:19042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d9ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.528952:0:19042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d9ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.528959:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9dafac970400) 00010000:00010000:0.0:1789785429.528962:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785429.528965:0:19042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d9ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.528971:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030a00/0x2f18ee3fd845d9ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.528997:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030c00/0x2f18ee3fd845d9f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b2c expref: 8 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.529024:0:19042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eec00/0x2f18ee3fd845da06 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b2c expref: 7 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.529032:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dae8266e100) 00010000:00010000:0.0:1789785429.529034:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789785429.529037:0:19042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb49eec00, rc 0) 00000100:00100000:0.0:1789785429.529185:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6563e207-f568-458d-9d37-e81c107e6f83+7:15601:x1876725530231296:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 815us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785429.529192:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 31 00000100:00100000:1.0:1789785429.532952:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785429.534376:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530231424 00000100:00100000:0.0:1789785429.534389:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530231424 00000100:00100000:0.0:1789785429.534464:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00100000:0.0:1789785429.534477:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6563e207-f568-458d-9d37-e81c107e6f83+5:15601:x1876725530231424:12345-192.168.203.46@tcp:900:lfs.0 00000100:00100000:0.0:1789785429.534567:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6563e207-f568-458d-9d37-e81c107e6f83+5:15601:x1876725530231424:12345-192.168.203.46@tcp:900:lfs.0 Request processed in 92us (1624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785429.534575:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00100000:1.0:1789785429.540194:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785429.540253:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530231680 00000100:00100000:0.0:1789785429.540263:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530231680 00000100:00100000:0.0:1789785429.540444:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 32 00000100:00100000:0.0:1789785429.540459:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6563e207-f568-458d-9d37-e81c107e6f83+7:15601:x1876725530231680:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:0.0:1789785429.540480:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785429.540500:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef200/0x2f18ee3fd845da0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8b33 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785429.540598:0:17213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789785429.540715:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef200/0x2f18ee3fd845da0d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b33 expref: 9 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.540729:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafac970c00) 00010000:00010000:0.0:1789785429.540732:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789785429.540737:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef200/0x2f18ee3fd845da0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b33 expref: 9 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.540749:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb49ef200, rc 0) 00000100:00100000:0.0:1789785429.540850:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6563e207-f568-458d-9d37-e81c107e6f83+8:15601:x1876725530231680:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 395us (664us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1789785429.540856:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 32 00000100:00100000:1.0:1789785429.550454:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785429.550572:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530231936 00000100:00100000:3.0:1789785429.550583:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530231936 00000100:00100000:3.0:1789785429.550641:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 33 00000100:00100000:3.0:1789785429.550651:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6563e207-f568-458d-9d37-e81c107e6f83+8:15601:x1876725530231936:12345-192.168.203.46@tcp:36:lfs.0 00010000:00010000:3.0:1789785429.550717:0:17211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785429.550743:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eec00/0x2f18ee3fd845da06 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b2c expref: 8 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.550763:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dae8266e100) 00010000:00010000:3.0:1789785429.550768:0:17211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789785429.550789:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845da1b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.550801:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845da1b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.550830:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845da1b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789785429.551042:0:17211:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000007efae4 reply state 000000006b63d9dd transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845da1b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.551054:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845da1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.551061:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dae8266e100) 00010000:00010000:3.0:1789785429.551064:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1789785429.551066:0:17211:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789785429.551073:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789785429.551301:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6563e207-f568-458d-9d37-e81c107e6f83+9:15601:x1876725530231936:12345-192.168.203.46@tcp:36:lfs.0 Request processed in 649us (855us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789785429.551309:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 33 00000100:00100000:1.0:1789785429.562632:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785429.562873:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530232192 00000100:00100000:3.0:1789785429.562883:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530232192 00000100:00100000:3.0:1789785429.563015:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 2 00000100:00100000:3.0:1789785429.563026:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6563e207-f568-458d-9d37-e81c107e6f83+9:15601:x1876725530232192:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:3.0:1789785429.563255:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6563e207-f568-458d-9d37-e81c107e6f83+10:15601:x1876725530232192:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 230us (632us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789785429.563262:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 2 00000100:00100000:1.0:1789785429.567767:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785429.568016:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530232448 00000100:00100000:3.0:1789785429.568026:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530232448 00000100:00100000:3.0:1789785429.568089:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 34 00000100:00100000:3.0:1789785429.568099:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6563e207-f568-458d-9d37-e81c107e6f83+10:15601:x1876725530232448:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789785429.568138:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785429.568158:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845da22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8b3a expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.568228:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845da29 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.568243:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845da29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.568254:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845da29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.568265:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845da30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.568272:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845da30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.568278:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845da30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785429.568413:0:17212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789785429.568532:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845da29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.568541:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845da29 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.568547:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845da29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.568562:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bb800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785429.568567:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845da29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.568575:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845da29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.568594:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafac970c00) 00010000:00010000:3.0:1789785429.568597:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785429.568601:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845da29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.568607:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845da29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.568621:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845da30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.568627:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845da30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.568633:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845da30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.568638:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814baa00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1789785429.568641:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845da30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.568646:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845da30 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.568734:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9dafac970400) 00010000:00010000:3.0:1789785429.568737:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789785429.568740:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845da30 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.568747:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845da30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.568792:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845da22 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b3a expref: 12 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.568802:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafac970c00) 00010000:00010000:3.0:1789785429.568805:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789785429.568809:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845da22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b3a expref: 12 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.568818:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bb000, rc 0) 00000100:00100000:3.0:1789785429.568880:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6563e207-f568-458d-9d37-e81c107e6f83+11:15601:x1876725530232448:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 782us (1310us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1789785429.568888:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 34 00000100:00100000:2.0:1789785429.572732:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785429.572824:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530232576 00000100:00100000:0.0:1789785429.572833:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530232576 00000100:00100000:0.0:1789785429.572894:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 35 00000100:00100000:0.0:1789785429.572906:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6563e207-f568-458d-9d37-e81c107e6f83+11:15601:x1876725530232576:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:0.0:1789785429.572929:0:19042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785429.572948:0:19042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef200/0x2f18ee3fd845da3e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8b41 expref: -99 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.573045:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eea00/0x2f18ee3fd845da45 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.573059:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eea00/0x2f18ee3fd845da45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.573069:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eea00/0x2f18ee3fd845da45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785429.573529:0:19042:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789785429.573534:0:19042:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789785429.573560:0:19042:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eea00/0x2f18ee3fd845da45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.573731:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef200/0x2f18ee3fd845da3e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b41 expref: 13 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.573751:0:19042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eea00/0x2f18ee3fd845da45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b41 expref: 12 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.573760:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dae8266e100) 00010000:00010000:0.0:1789785429.573763:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789785429.573767:0:19042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb49eea00, rc 0) 00000100:00100000:0.0:1789785429.573971:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6563e207-f568-458d-9d37-e81c107e6f83+12:15601:x1876725530232576:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 1066us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785429.573979:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 35 00000100:00100000:1.0:1789785429.579084:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785429.579723:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530232704 00000100:00100000:0.0:1789785429.579734:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530232704 00000100:00100000:0.0:1789785429.579893:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 3 00000100:00100000:0.0:1789785429.579905:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6563e207-f568-458d-9d37-e81c107e6f83+12:15601:x1876725530232704:12345-192.168.203.46@tcp:37:lfs.0 00000100:00100000:0.0:1789785429.593481:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6563e207-f568-458d-9d37-e81c107e6f83+12:15601:x1876725530232704:12345-192.168.203.46@tcp:37:lfs.0 Request processed in 13568us (14396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785429.593494:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 3 00000100:00100000:2.0:1789785429.622580:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785429.622731:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530232960 00000100:00100000:3.0:1789785429.622742:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530232960 00000100:00100000:3.0:1789785429.622799:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 4 00000100:00100000:3.0:1789785429.622809:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83bc6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6563e207-f568-458d-9d37-e81c107e6f83+12:15601:x1876725530232960:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:3.0:1789785429.623042:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83bc6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6563e207-f568-458d-9d37-e81c107e6f83+13:15601:x1876725530232960:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 234us (470us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789785429.623049:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 4 00010000:00010000:0.0:1789785429.698594:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785429.735670:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785429.735745:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530233088 00000100:00100000:0.0:1789785429.735764:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530233088 00000100:00100000:0.0:1789785429.735831:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 36 00000100:00100000:0.0:1789785429.735841:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+11:15607:x1876725530233088:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:0.0:1789785429.735860:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785429.735879:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef200/0x2f18ee3fd845da4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8b48 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.735939:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef800/0x2f18ee3fd845da53 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.735954:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef800/0x2f18ee3fd845da53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.735965:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef800/0x2f18ee3fd845da53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.735974:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef000/0x2f18ee3fd845da5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.735980:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef000/0x2f18ee3fd845da5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.735986:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef000/0x2f18ee3fd845da5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.736067:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef400/0x2f18ee3fd845da61 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.736075:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef400/0x2f18ee3fd845da61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.736082:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef400/0x2f18ee3fd845da61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785429.736119:0:17213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789785429.736123:0:17213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789785429.736157:0:17213:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef400/0x2f18ee3fd845da61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.736180:0:17213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef800/0x2f18ee3fd845da53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.736188:0:17213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef800/0x2f18ee3fd845da53 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.736194:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef800/0x2f18ee3fd845da53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.736199:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb49ef800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785429.736203:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef800/0x2f18ee3fd845da53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.736211:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef800/0x2f18ee3fd845da53 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.736224:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafac970c00) 00010000:00010000:0.0:1789785429.736227:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785429.736231:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef800/0x2f18ee3fd845da53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.736236:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef800/0x2f18ee3fd845da53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.736249:0:17213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef000/0x2f18ee3fd845da5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.736266:0:17213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef000/0x2f18ee3fd845da5a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.736272:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef000/0x2f18ee3fd845da5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.736277:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb49ef000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785429.736280:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef000/0x2f18ee3fd845da5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.736285:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef000/0x2f18ee3fd845da5a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.736293:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9dafac970400) 00010000:00010000:0.0:1789785429.736295:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785429.736298:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef000/0x2f18ee3fd845da5a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.736303:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef000/0x2f18ee3fd845da5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.736327:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef200/0x2f18ee3fd845da4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b48 expref: 13 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.736428:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef400/0x2f18ee3fd845da61 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b48 expref: 12 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.736444:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dae8266e100) 00010000:00010000:0.0:1789785429.736446:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789785429.736455:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb49ef400, rc 0) 00000100:00100000:0.0:1789785429.736508:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+12:15607:x1876725530233088:12345-192.168.203.46@tcp:101:bash.0 Request processed in 668us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785429.736515:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 36 00000100:00100000:1.0:1789785429.743727:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785429.743939:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530233216 00000100:00100000:2.0:1789785429.743949:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530233216 00000100:00100000:2.0:1789785429.744007:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:2.0:1789785429.744016:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:251bae80-9c0c-4669-a294-80064a3e231a+5:15607:x1876725530233216:12345-192.168.203.46@tcp:900:bash.0 00000100:00100000:2.0:1789785429.744089:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:251bae80-9c0c-4669-a294-80064a3e231a+5:15607:x1876725530233216:12345-192.168.203.46@tcp:900:bash.0 Request processed in 74us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785429.744096:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:1.0:1789785429.746477:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785429.746566:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530233472 00000100:00100000:3.0:1789785429.746576:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530233472 00000100:00100000:3.0:1789785429.746636:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 37 00000100:00100000:3.0:1789785429.746647:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251bae80-9c0c-4669-a294-80064a3e231a+12:15607:x1876725530233472:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:3.0:1789785429.746789:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785429.746811:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845da68 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8b4f expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.746917:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845da6f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.746933:0:17211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eea00/0x2f18ee3fd845da45 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b41 expref: 12 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.746941:0:17211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845da6f lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.746973:0:17211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eea00/0x2f18ee3fd845da45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b41 expref: 12 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785429.746986:0:17211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eea00/0x2f18ee3fd845da45 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b41 expref: 12 pid: 19042 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785429.746997:0:17211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17211:1876725549184896:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789785429.747075:0:17211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf85440600 going to sleep for 11 seconds 00000100:00100000:1.0:1789785429.753399:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785429.754309:0:17211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17211:1876725549184896:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785429.754366:0:17211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845da6f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785429.759240:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530233600 00000100:00100000:0.0:1789785429.759254:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530233600 00010000:00010000:0.0:1789785429.759305:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eea00/0x2f18ee3fd845da45 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b41 expref: 13 pid: 19042 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785429.759534:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:0.0:1789785429.759546:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87814000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6563e207-f568-458d-9d37-e81c107e6f83+13:2398:x1876725530233600:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789785429.759562:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785429.759570:0:17197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eea00/0x2f18ee3fd845da45 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b41 expref: 13 pid: 19042 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.759591:0:17197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eea00/0x2f18ee3fd845da45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b41 expref: 13 pid: 19042 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.759615:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eea00/0x2f18ee3fd845da45 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b41 expref: 13 pid: 19042 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.759632:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dae8266e100) 00010000:00010000:0.0:1789785429.759637:0:17197:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845da6f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.759646:0:17197:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845da6f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.759663:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845da6f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.759717:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789785429.759789:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87814000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6563e207-f568-458d-9d37-e81c107e6f83+12:2398:x1876725530233600:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 236us (6400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785429.759797:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 16 00010000:00010000:2.0:1789785429.759849:0:17211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845da6f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785429.759857:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845da6f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785429.759880:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08800/0x2f18ee3fd845da76 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785429.759889:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08800/0x2f18ee3fd845da76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785429.759897:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08800/0x2f18ee3fd845da76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785429.760406:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845da7d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785429.760415:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845da7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785429.760434:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845da7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789785429.760446:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789785429.760473:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845da6f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785429.760480:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845da6f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785429.760487:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845da6f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785429.760493:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814baa00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785429.760498:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845da6f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785429.760505:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845da6f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785429.760516:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dae8266e100) 00010000:00010000:2.0:1789785429.760519:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789785429.760522:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845da6f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785429.760528:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814baa00/0x2f18ee3fd845da6f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789785429.760539:0:17211:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fcc278a9 reply state 000000007b70e66b transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08800/0x2f18ee3fd845da76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785429.760561:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08800/0x2f18ee3fd845da76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785429.760568:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9dae8266f700) 00010000:00010000:2.0:1789785429.760570:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789785429.760573:0:17211:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789785429.760606:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb000/0x2f18ee3fd845da68 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b4f expref: 15 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785429.760622:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845da7d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b4f expref: 14 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785429.760629:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dae8266fe00) 00010000:00010000:2.0:1789785429.760632:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789785429.760634:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b08a00, rc 0) 00000100:00100000:2.0:1789785429.760666:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251bae80-9c0c-4669-a294-80064a3e231a+15:15607:x1876725530233472:12345-192.168.203.46@tcp:101:bash.0 Request processed in 14021us (14200us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789785429.760674:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 37 00000040:00080000:1.0:1789785429.766848:0:17971:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789785429.790274:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785429.790370:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530233728 00000100:00100000:0.0:1789785429.790380:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530233728 00000100:00100000:0.0:1789785429.790458:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 38 00000100:00100000:0.0:1789785429.790469:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+15:15607:x1876725530233728:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:0.0:1789785429.790494:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785429.790514:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eea00/0x2f18ee3fd845da8b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8b56 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.790578:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef200/0x2f18ee3fd845da92 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.790593:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef200/0x2f18ee3fd845da92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.790604:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef200/0x2f18ee3fd845da92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785429.790668:0:17213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789785429.790672:0:17213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789785429.790693:0:17213:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef200/0x2f18ee3fd845da92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.790703:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef200/0x2f18ee3fd845da92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.790728:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eea00/0x2f18ee3fd845da8b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b56 expref: 17 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.790761:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef200/0x2f18ee3fd845da92 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b56 expref: 16 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.790770:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dae8266fe00) 00010000:00010000:0.0:1789785429.790773:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789785429.790788:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb49ef200, rc 0) 00000100:00100000:0.0:1789785429.790845:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+16:15607:x1876725530233728:12345-192.168.203.46@tcp:101:bash.0 Request processed in 377us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785429.790853:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 38 00000100:00100000:1.0:1789785429.806437:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785429.806587:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530233984 00000100:00100000:3.0:1789785429.806597:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530233984 00000100:00100000:3.0:1789785429.806647:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:3.0:1789785429.806657:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251bae80-9c0c-4669-a294-80064a3e231a+16:15607:x1876725530233984:12345-192.168.203.46@tcp:35:bash.0 00000100:00100000:3.0:1789785429.807198:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251bae80-9c0c-4669-a294-80064a3e231a+17:15607:x1876725530233984:12345-192.168.203.46@tcp:35:bash.0 Request processed in 541us (769us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789785429.807205:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:1.0:1789785429.942676:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785429.950881:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530234240 00000100:00100000:0.0:1789785429.950897:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530234240 00000100:00100000:0.0:1789785429.951052:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 39 00000100:00100000:0.0:1789785429.951064:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+17:15617:x1876725530234240:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:0.0:1789785429.951437:0:19042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785429.951459:0:19042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eea00/0x2f18ee3fd845da99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8b5d expref: -99 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785429.951564:0:19042:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789785429.951658:0:19042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eea00/0x2f18ee3fd845da99 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b5d expref: 19 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.951673:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dafac970c00) 00010000:00010000:0.0:1789785429.951676:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789785429.951680:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eea00/0x2f18ee3fd845da99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b5d expref: 19 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785429.953456:0:19042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb49eea00, rc 0) 00000100:00100000:0.0:1789785429.955173:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+18:15617:x1876725530234240:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 4102us (12508us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1789785429.955185:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 39 00000100:00100000:1.0:1789785429.958882:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785429.959031:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530234496 00000100:00100000:3.0:1789785429.959040:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530234496 00000100:00100000:3.0:1789785429.959096:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00100000:3.0:1789785429.959114:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251bae80-9c0c-4669-a294-80064a3e231a+18:15617:x1876725530234496:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:3.0:1789785429.959314:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251bae80-9c0c-4669-a294-80064a3e231a+19:15617:x1876725530234496:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 209us (438us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789785429.959322:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00100000:1.0:1789785430.007278:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785430.007403:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530234752 00000100:00100000:0.0:1789785430.007413:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530234752 00000100:00100000:0.0:1789785430.007500:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 40 00000100:00100000:0.0:1789785430.007512:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+19:15620:x1876725530234752:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:0.0:1789785430.007536:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785430.007557:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eea00/0x2f18ee3fd845daa7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8b64 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785430.007663:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef000/0x2f18ee3fd845daae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785430.007678:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef000/0x2f18ee3fd845daae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785430.007688:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef000/0x2f18ee3fd845daae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785430.007698:0:17213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789785430.007796:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eea00/0x2f18ee3fd845daa7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b64 expref: 22 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785430.007815:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef000/0x2f18ee3fd845daae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b64 expref: 21 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785430.007843:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dae8266fe00) 00010000:00010000:0.0:1789785430.007846:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789785430.007850:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb49ef000, rc 0) 00000100:00100000:0.0:1789785430.007907:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+21:15620:x1876725530234752:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 397us (638us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789785430.007914:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 40 00000100:00080000:2.0:1789785430.008120:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789785430.011597:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785430.011724:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530234880 00000100:00100000:2.0:1789785430.011734:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530234880 00000100:00100000:2.0:1789785430.011797:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 41 00000100:00100000:2.0:1789785430.011807:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251bae80-9c0c-4669-a294-80064a3e231a+21:15620:x1876725530234880:12345-192.168.203.46@tcp:54:lfs.0 00010000:00010000:2.0:1789785430.011869:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845dabc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785430.011884:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845dabc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785430.011908:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845dabc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785430.011943:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845dabc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785430.011950:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845dabc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785430.011956:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845dabc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785430.011962:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b08400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1789785430.011966:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845dabc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785430.011972:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845dabc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785430.011985:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dae8266fe00) 00010000:00010000:2.0:1789785430.011987:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789785430.011991:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845dabc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785430.011997:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845dabc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785430.012071:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251bae80-9c0c-4669-a294-80064a3e231a+21:15620:x1876725530234880:12345-192.168.203.46@tcp:54:lfs.0 Request processed in 265us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785430.012078:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 41 00000100:00100000:3.0:1789785430.013881:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785430.013988:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530235008 00000100:00100000:2.0:1789785430.013997:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530235008 00000100:00100000:2.0:1789785430.014460:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 0 00000100:00100000:2.0:1789785430.014472:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251bae80-9c0c-4669-a294-80064a3e231a+21:2397:x1876725530235008:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789785430.014537:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785430.014559:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef000/0x2f18ee3fd845daae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b64 expref: 21 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785430.014576:0:17196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dae8266fe00) 00010000:00010000:2.0:1789785430.014581:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785430.014624:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251bae80-9c0c-4669-a294-80064a3e231a+20:2397:x1876725530235008:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 154us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785430.014631:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 0 00000100:00100000:1.0:1789785430.019125:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000040:00080000:3.0:1789785430.019166:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789785430.019277:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530235264 00000100:00100000:2.0:1789785430.019286:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530235264 00000100:00100000:2.0:1789785430.019412:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:2.0:1789785430.019423:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251bae80-9c0c-4669-a294-80064a3e231a+20:15620:x1876725530235264:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:2.0:1789785430.019680:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251bae80-9c0c-4669-a294-80064a3e231a+21:15620:x1876725530235264:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 258us (563us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789785430.019689:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:1.0:1789785430.421615:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785430.421723:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530235520 00000100:00100000:3.0:1789785430.421733:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530235520 00000100:00100000:3.0:1789785430.421851:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 42 00000100:00100000:3.0:1789785430.421862:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251bae80-9c0c-4669-a294-80064a3e231a+21:15651:x1876725530235520:12345-192.168.203.46@tcp:101:cat.0 00010000:00010000:3.0:1789785430.421887:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785430.421908:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845dac3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8b6b expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785430.422011:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845daca lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785430.422041:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845daca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785430.422053:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845daca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789785430.422066:0:17212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789785430.422192:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845dac3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b6b expref: 24 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785430.422210:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845daca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b6b expref: 23 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785430.422218:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dae8266fe00) 00010000:00010000:3.0:1789785430.422221:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789785430.422225:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814ba400, rc 0) 00000100:00100000:3.0:1789785430.422281:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251bae80-9c0c-4669-a294-80064a3e231a+23:15651:x1876725530235520:12345-192.168.203.46@tcp:101:cat.0 Request processed in 421us (675us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1789785430.422288:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 42 00000100:00100000:0.0:1789785430.429460:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785430.429514:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785430.429637:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530235776 00000100:00100000:1.0:1789785430.429646:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530235776 00000100:00100000:1.0:1789785430.429697:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 8 00000100:00100000:1.0:1789785430.429705:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251bae80-9c0c-4669-a294-80064a3e231a+23:15651:x1876725530235776:12345-192.168.203.46@tcp:35:cat.0 00000100:00100000:1.0:1789785430.429951:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251bae80-9c0c-4669-a294-80064a3e231a+24:15651:x1876725530235776:12345-192.168.203.46@tcp:35:cat.0 Request processed in 246us (501us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1789785430.429959:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 8 00000100:00100000:3.0:1789785430.430791:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530235904 00000100:00100000:3.0:1789785430.430798:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530235904 00000100:00100000:3.0:1789785430.430843:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 1 00000100:00100000:3.0:1789785430.430853:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251bae80-9c0c-4669-a294-80064a3e231a+24:2398:x1876725530235904:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789785430.430865:0:17963:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785430.430888:0:17963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845daca lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b6b expref: 24 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785430.430927:0:17963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dae8266fe00) 00010000:00010000:3.0:1789785430.430932:0:17963:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785430.430967:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251bae80-9c0c-4669-a294-80064a3e231a+23:2398:x1876725530235904:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 115us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785430.430973:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 1 00000100:00100000:0.0:1789785430.505548:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785430.505704:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530236160 00000100:00100000:2.0:1789785430.505714:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530236160 00000100:00100000:2.0:1789785430.505788:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 43 00000100:00100000:2.0:1789785430.505799:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251bae80-9c0c-4669-a294-80064a3e231a+23:15657:x1876725530236160:12345-192.168.203.46@tcp:101:dd.0 00010000:00010000:2.0:1789785430.505825:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789785430.505844:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845dad8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8b72 expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785430.505965:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845dadf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785430.505979:0:17211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845da7d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b4f expref: 24 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785430.505986:0:17211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef200/0x2f18ee3fd845da92 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b56 expref: 24 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785430.505994:0:17211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845dadf lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785430.506026:0:17211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef200/0x2f18ee3fd845da92 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b56 expref: 24 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785430.506039:0:17211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef200/0x2f18ee3fd845da92 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b56 expref: 24 pid: 17213 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785430.506052:0:17211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84526d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17211:1876725549185024:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789785430.506152:0:17211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845da7d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b4f expref: 24 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785430.506160:0:17211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845da7d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b4f expref: 24 pid: 17211 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785430.506291:0:17211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84526680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17211:1876725549185152:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789785430.506325:0:17211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafac73ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1789785430.517277:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785430.517319:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785430.517551:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530236416 00000100:00100000:3.0:1789785430.517561:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530236416 00010000:00010000:3.0:1789785430.517601:0:17198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845da7d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b4f expref: 25 pid: 17211 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785430.517640:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530236288 00000100:00100000:3.0:1789785430.517643:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530236288 00010000:00010000:3.0:1789785430.517654:0:17198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef200/0x2f18ee3fd845da92 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b56 expref: 26 pid: 17213 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785430.517676:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:3.0:1789785430.517684:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87817b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251bae80-9c0c-4669-a294-80064a3e231a+26:2397:x1876725530236416:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789785430.517697:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785430.517703:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845da7d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b4f expref: 26 pid: 17211 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785430.517714:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845da7d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b4f expref: 26 pid: 17211 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785430.517737:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dae8266fe00) 00010000:00010000:3.0:1789785430.517742:0:17198:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845dadf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785430.517756:0:17198:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845dadf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785430.517762:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785430.517810:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87817b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251bae80-9c0c-4669-a294-80064a3e231a+26:2397:x1876725530236416:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 125us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785430.517818:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:3.0:1789785430.517835:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 18 00000100:00100000:3.0:1789785430.517842:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf3f6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251bae80-9c0c-4669-a294-80064a3e231a+25:2398:x1876725530236288:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789785430.517849:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785430.517854:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef200/0x2f18ee3fd845da92 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b56 expref: 25 pid: 17213 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785430.517864:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef200/0x2f18ee3fd845da92 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b56 expref: 25 pid: 17213 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785430.517875:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dae8266fe00) 00010000:00010000:3.0:1789785430.517879:0:17198:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845dadf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785430.517887:0:17198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845dadf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785430.517894:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845dadf lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785430.517912:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785430.517932:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf3f6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251bae80-9c0c-4669-a294-80064a3e231a+25:2398:x1876725530236288:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 90us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785430.517946:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 18 00010000:00010000:2.0:1789785430.518713:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef200/0x2f18ee3fd845da92 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b56 expref: 24 pid: 17213 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785430.518732:0:17211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84526d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17211:1876725549185024:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789785430.518745:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08a00/0x2f18ee3fd845da7d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b4f expref: 23 pid: 17211 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785430.518756:0:17211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84526680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17211:1876725549185152:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789785430.518776:0:17211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845dadf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785430.518785:0:17211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845dadf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785430.518791:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845dadf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789785430.518809:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789785430.518951:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845dad8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b72 expref: 24 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785430.518964:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b09600/0x2f18ee3fd845dadf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b72 expref: 23 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785430.518971:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dae8266fe00) 00010000:00010000:2.0:1789785430.518974:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789785430.518977:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc1b09600, rc 0) 00000100:00100000:2.0:1789785430.519184:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251bae80-9c0c-4669-a294-80064a3e231a+23:15657:x1876725530236160:12345-192.168.203.46@tcp:101:dd.0 Request processed in 13239us (13498us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1789785430.519195:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 43 00000100:00100000:1.0:1789785430.525401:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785430.525580:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530236544 00000100:00100000:0.0:1789785430.525590:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530236544 00000100:00100000:0.0:1789785430.525646:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 44 00000100:00100000:0.0:1789785430.525655:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+23:15657:x1876725530236544:12345-192.168.203.46@tcp:101:dd.0 00010000:00010000:0.0:1789785430.525678:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785430.525696:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef800/0x2f18ee3fd845daed lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8b79 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785430.525727:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efc00/0x2f18ee3fd845daf4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785430.525740:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efc00/0x2f18ee3fd845daf4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785430.525750:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efc00/0x2f18ee3fd845daf4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785430.525870:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef800/0x2f18ee3fd845daed lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b79 expref: 25 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785430.525892:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efc00/0x2f18ee3fd845daf4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b79 expref: 24 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785430.525900:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dae8266fe00) 00010000:00010000:0.0:1789785430.525903:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789785430.525906:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb49efc00, rc 0) 00000100:00100000:0.0:1789785430.525962:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+24:15657:x1876725530236544:12345-192.168.203.46@tcp:101:dd.0 Request processed in 308us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785430.525969:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 44 00000100:00100000:0.0:1789785430.532380:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785430.532649:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530236800 00000100:00100000:3.0:1789785430.532660:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530236800 00000100:00100000:3.0:1789785430.532720:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 45 00000100:00100000:3.0:1789785430.532731:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae847d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+24:15657:x1876725530236800:12345-192.168.203.46@tcp:36:dd.0 00010000:00010000:3.0:1789785430.532947:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845dafb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785430.532962:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845dafb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785430.532973:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845dafb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789785430.533013:0:19042:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1789785430.533035:0:19042:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ea786dc reply state 000000002ab6e24e transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845dafb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785430.533047:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845dafb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785430.533054:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dae8266fe00) 00010000:00010000:3.0:1789785430.533057:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789785430.533060:0:19042:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789785430.533157:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae847d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+27:15657:x1876725530236800:12345-192.168.203.46@tcp:36:dd.0 Request processed in 423us (781us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1789785430.533285:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 45 00000020:00080000:3.0:1789785430.533292:0:19042:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789785430.535910:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785430.536029:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530236928 00000100:00100000:0.0:1789785430.536155:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530236928 00000100:00100000:0.0:1789785430.536254:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 46 00000100:00100000:0.0:1789785430.536265:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+27:15657:x1876725530236928:12345-192.168.203.46@tcp:101:dd.0 00010000:00010000:0.0:1789785430.536289:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785430.536308:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef800/0x2f18ee3fd845db02 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8b80 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785430.536436:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef800/0x2f18ee3fd845db02 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b80 expref: 28 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785430.536452:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef800/0x2f18ee3fd845db02 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b80 expref: 28 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785430.536469:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dae8266fe00) 00010000:00010000:0.0:1789785430.536487:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789785430.536491:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb49ef800, rc 0) 00000100:00100000:0.0:1789785430.536545:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+28:15657:x1876725530236928:12345-192.168.203.46@tcp:101:dd.0 Request processed in 281us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785430.536552:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 46 00000100:00100000:1.0:1789785430.548454:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785430.548856:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530237184 00000100:00100000:3.0:1789785430.548882:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530237184 00000100:00100000:3.0:1789785430.548954:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 2 00000100:00100000:3.0:1789785430.548966:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87815c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251bae80-9c0c-4669-a294-80064a3e231a+28:15657:x1876725530237184:12345-192.168.203.46@tcp:103:dd.0 00010000:00010000:3.0:1789785430.548981:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789785430.549112:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef800/0x2f18ee3fd845db02 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b80 expref: 28 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785430.549133:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dae8266fe00) 00010000:00010000:3.0:1789785430.549138:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789785430.549206:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87815c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251bae80-9c0c-4669-a294-80064a3e231a+27:15657:x1876725530237184:12345-192.168.203.46@tcp:103:dd.0 Request processed in 242us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785430.549213:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 2 00000100:00100000:1.0:1789785430.552957:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785430.553095:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530237312 00000100:00100000:2.0:1789785430.553105:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530237312 00000100:00100000:2.0:1789785430.553193:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 47 00000100:00100000:2.0:1789785430.553203:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251bae80-9c0c-4669-a294-80064a3e231a+27:15657:x1876725530237312:12345-192.168.203.46@tcp:58:dd.0 00010000:00010000:2.0:1789785430.553310:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845db09 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785430.553331:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845db09 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785430.553392:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845db09 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789785430.555142:0:17211:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789785430.555928:0:17211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789785430.556097:0:17211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789785430.556915:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251bae80-9c0c-4669-a294-80064a3e231a+27:15657:x1876725530237312:12345-192.168.203.46@tcp:58:dd.0 Request processed in 3706us (3960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785430.556927:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 47 00000100:00100000:0.0:1789785430.571678:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785430.572079:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530237440 00000100:00100000:3.0:1789785430.572090:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530237440 00000100:00100000:3.0:1789785430.572149:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 48 00000100:00100000:3.0:1789785430.572160:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251bae80-9c0c-4669-a294-80064a3e231a+27:15657:x1876725530237440:12345-192.168.203.46@tcp:101:dd.0 00010000:00010000:3.0:1789785430.572191:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785430.572213:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845db10 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8b87 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785430.572267:0:17212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845db09 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785430.572279:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845db10 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b87 expref: 28 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785430.572297:0:17212:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845db09 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785430.572333:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845db10 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b87 expref: 28 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785430.572417:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dae8266fe00) 00010000:00010000:3.0:1789785430.572420:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789785430.572425:0:17212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845db10 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b87 expref: 28 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785430.572433:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bb800, rc 0) 00000100:00100000:3.0:1789785430.573131:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251bae80-9c0c-4669-a294-80064a3e231a+28:15657:x1876725530237440:12345-192.168.203.46@tcp:101:dd.0 Request processed in 970us (1461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785430.573139:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 48 00010000:00010000:0.0:1789785430.723807:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789785430.850665:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789785430.850677:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549185408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789785430.850680:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549185536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789785430.850805:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789785430.850814:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549185664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789785430.851447:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9daf87817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549185792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789785430.857020:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785430.857113:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549185536 00000100:00100000:0.0:1789785430.857123:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549185536 00000100:00100000:0.0:1789785430.857185:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789785430.857196:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb417b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549185536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789785430.857228:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789785430.857283:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb417b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549185536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785430.857290:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1789785430.857308:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789785430.857362:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549185536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789785430.858611:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549186176:0@lo:400:kworker.0 00000100:00100000:0.0:1789785430.858680:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785430.858712:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549186688:0@lo:400:kworker.0 00000100:00100000:0.0:1789785430.858736:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785430.858753:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549187200:0@lo:400:kworker.0 00000100:00100000:0.0:1789785430.858794:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785430.858826:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789785430.858833:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad642144-cf43-4df2-a5e5-a426cdb5453e:3660:1876725549186048:0@lo:400:kworker.0 00000100:00100000:0.0:1789785430.858863:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785430.858889:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549186560:0@lo:400:kworker.0 00000100:00100000:0.0:1789785430.858912:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785430.858930:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1876725549187072:0@lo:400:kworker.0 00000100:00100000:0.0:1789785430.858949:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785430.858976:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549186176 00000100:00100000:0.0:1789785430.858982:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549186176 00000100:00100000:0.0:1789785430.859013:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549186560 00000100:00100000:0.0:1789785430.859016:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549186560 00000100:00100000:0.0:1789785430.859029:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789785430.859036:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549186176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785430.859080:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1876725549186176:12345-0@lo:400:kworker.0 Request processed in 43us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785430.859086:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789785430.859101:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789785430.859107:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549186560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785430.859135:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549186560:12345-0@lo:400:kworker.0 Request processed in 28us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785430.859141:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789785430.859173:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549186560:0@lo:400:kworker.0 00000100:00100000:0.0:1789785430.859182:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1876725549186176:0@lo:400:kworker.0 00000100:00100000:0.0:1789785430.859213:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549186688 00000100:00100000:0.0:1789785430.859216:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549186688 00000100:00100000:0.0:1789785430.859245:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789785430.859258:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549186688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785430.859291:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876725549186688:12345-0@lo:400:kworker.0 Request processed in 35us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785430.859297:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1789785430.859312:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789785430.859328:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1876725549186688:0@lo:400:kworker.0 00000100:00100000:0.0:1789785430.859378:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549186048 00000100:00100000:0.0:1789785430.859392:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549186048 00000100:00100000:0.0:1789785430.859421:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789785430.859427:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:3660:x1876725549186048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785430.859457:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad642144-cf43-4df2-a5e5-a426cdb5453e+24:3660:x1876725549186048:12345-0@lo:400:kworker.0 Request processed in 31us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785430.859462:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789785430.859488:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad642144-cf43-4df2-a5e5-a426cdb5453e:3660:1876725549186048:0@lo:400:kworker.0 00000100:00100000:0.0:1789785430.859529:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549187200 00000100:00100000:0.0:1789785430.859532:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549187200 00000100:00080000:0.0:1789785430.859545:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789785430.859564:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549187072 00000100:00100000:0.0:1789785430.859567:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549187072 00000100:00080000:0.0:1789785430.859577:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789785430.859586:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789785430.859592:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1876725549187200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785430.859624:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1876725549187200:12345-0@lo:400:kworker.0 Request processed in 33us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785430.859630:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1789785430.859654:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb416300 x1876725549187200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789785430.859675:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1876725549187200:0@lo:400:kworker.0 00000100:00100000:0.0:1789785430.859710:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789785430.859716:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1876725549187072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785430.859749:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1876725549187072:12345-0@lo:400:kworker.0 Request processed in 34us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785430.859756:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789785430.859778:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1876725549187072:0@lo:400:kworker.0 00000100:00100000:3.0:1789785430.860291:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785430.860314:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549185280:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789785430.860364:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785430.860395:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549185280 00000100:00100000:3.0:1789785430.860399:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549185280 00000100:00100000:0.0:1789785430.860402:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549185408 00000100:00100000:0.0:1789785430.860406:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549185408 00000100:00100000:3.0:1789785430.860487:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789785430.860494:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549185280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789785430.860519:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1789785430.860540:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789785430.860548:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549185408:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789785430.860551:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549185280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785430.860556:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00002000:00000024:0.0:1789785430.860565:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789785430.860589:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549185280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789785430.860595:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549185408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785430.860601:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789785430.860613:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549185920:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789785430.860617:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789785430.860635:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785430.860652:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1876725549186432:0@lo:400:kworker.0 00000100:00100000:0.0:1789785430.860656:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549185920 00000100:00100000:0.0:1789785430.860659:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549185920 00000100:00100000:3.0:1789785430.860673:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785430.860678:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789785430.860683:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549185920:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789785430.860687:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725549186944:0@lo:400:kworker.0 00002000:00000024:0.0:1789785430.860693:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789785430.860715:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549185920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 32us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785430.860720:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789785430.860739:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785430.860754:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549186432 00000100:00100000:3.0:1789785430.860755:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1876725549187456:0@lo:400:kworker.0 00000100:00100000:0.0:1789785430.860756:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549186432 00000100:00100000:3.0:1789785430.860775:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785430.860851:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549186944 00000100:00100000:3.0:1789785430.860855:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549186944 00000100:00100000:3.0:1789785430.860871:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549187456 00000100:00100000:3.0:1789785430.860874:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549187456 00000100:00100000:3.0:1789785430.860895:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789785430.860900:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1876725549186432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785430.860927:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1876725549186432:12345-0@lo:400:kworker.0 Request processed in 28us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785430.860932:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789785430.860944:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789785430.860949:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725549186944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785430.860973:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1876725549186944:12345-0@lo:400:kworker.0 Request processed in 25us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785430.860978:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789785430.860988:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789785430.860993:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1876725549187456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785430.861015:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1876725549187456:12345-0@lo:400:kworker.0 Request processed in 23us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785430.861027:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1789785430.861040:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789785430.861059:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dafbb416a00 x1876725549187456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789785446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789785430.861068:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1876725549187456:0@lo:400:kworker.0 00000100:00100000:3.0:1789785430.861082:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549185408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789785430.861101:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549185920:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789785430.861110:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1876725549186432:0@lo:400:kworker.0 00000100:00100000:3.0:1789785430.861117:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1876725549186944:0@lo:400:kworker.0 00000100:00100000:3.0:1789785430.861126:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789785430.861132:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549186304:0@lo:400:kworker.0 00000100:00100000:3.0:1789785430.861153:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785430.861171:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549186816:0@lo:400:kworker.0 00000100:00100000:3.0:1789785430.861187:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785430.861397:0:3662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbb417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1876725549187328:0@lo:400:kworker.0 00000100:00100000:3.0:1789785430.861913:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789785430.861944:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549187328 00000100:00100000:3.0:1789785430.861948:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549187328 00000100:00100000:3.0:1789785430.861980:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789785430.861987:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1876725549187328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785430.862014:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549186304 00000100:00100000:3.0:1789785430.862018:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1876725549187328:12345-0@lo:400:kworker.0 Request processed in 32us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785430.862018:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549186304 00000100:00100000:3.0:1789785430.862023:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789785430.862039:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549186816 00000100:00100000:0.0:1789785430.862041:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549186816 00000100:00080000:3.0:1789785430.862045:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789785430.862049:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789785430.862060:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789785430.862066:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549186304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789785430.862069:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1876725549187328:0@lo:400:kworker.0 00000100:00100000:3.0:1789785430.862104:0:19259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789785430.862106:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1876725549186304:12345-0@lo:400:kworker.0 Request processed in 41us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785430.862110:0:19259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549186816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789785430.862112:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789785430.862140:0:19259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1876725549186816:12345-0@lo:400:kworker.0 Request processed in 30us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785430.862145:0:19259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789785430.862167:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1876725549186304:0@lo:400:kworker.0 00000100:00100000:3.0:1789785430.862181:0:3662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbb415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1876725549186816:0@lo:400:kworker.0 00000100:00100000:2.0:1789785430.862294:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785430.862563:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549185664 00000100:00100000:0.0:1789785430.862568:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549185664 00000100:00100000:0.0:1789785430.862648:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789785430.862658:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549185664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789785430.862682:0:17216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789785430.862727:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549185664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785430.862732:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789785430.862801:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549185664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789785430.863409:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789785430.863438:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549185792 00000100:00100000:1.0:1789785430.863443:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549185792 00000100:00100000:1.0:1789785430.863469:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789785430.863477:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549185792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789785430.863503:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789785430.865327:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1876725549185792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1845us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785430.865354:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789785430.865648:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9daf87817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1876725549185792:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1789785431.043168:0:17247:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789785431.043178:0:17247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789785431.043207:0:17247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789785431.043216:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789785431.043371:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83a21f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17247:1876725549187584:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789785431.043474:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafa0b25d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789785431.047613:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83a21f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17247:1876725549187584:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789785431.052812:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785431.052912:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530237568 00000100:00100000:0.0:1789785431.052922:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530237568 00000100:00100000:0.0:1789785431.052988:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 49 00000100:00100000:0.0:1789785431.052998:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf87817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+28:15658:x1876725530237568:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789785431.053029:0:17213:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789785431.053168:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf87817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+28:15658:x1876725530237568:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 Request processed in 171us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785431.053185:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 49 00000100:00100000:3.0:1789785431.064753:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785431.065068:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530237696 00000100:00100000:1.0:1789785431.065078:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530237696 00000100:00100000:1.0:1789785431.065147:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 50 00000100:00100000:1.0:1789785431.065157:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251bae80-9c0c-4669-a294-80064a3e231a+28:15658:x1876725530237696:12345-192.168.203.46@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789785431.065227:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845db17 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065241:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845db17 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065254:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845db17 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065305:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db1e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065328:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db1e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065336:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db1e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065397:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845db25 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065407:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845db25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065414:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845db25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789785431.065469:0:17212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789785431.065473:0:17212:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789785431.065486:0:17212:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845db25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065496:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845db17 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065502:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845db17 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065510:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845db17 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065517:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc21cb800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785431.065521:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845db17 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065535:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845db17 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065547:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dae8266ed00) 00010000:00010000:1.0:1789785431.065550:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785431.065555:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845db17 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065562:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845db17 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065576:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db1e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065582:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db1e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065588:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db1e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065593:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc21cb000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785431.065596:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db1e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065602:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db1e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065610:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9dae827c1e00) 00010000:00010000:1.0:1789785431.065612:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785431.065615:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db1e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065632:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db1e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065648:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845db25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065654:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845db25 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065659:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845db25 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065663:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc21ca600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785431.065666:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845db25 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065671:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845db25 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065680:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dae8266fe00) 00010000:00010000:1.0:1789785431.065682:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785431.065685:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845db25 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.065691:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21ca600/0x2f18ee3fd845db25 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785431.065767:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251bae80-9c0c-4669-a294-80064a3e231a+28:15658:x1876725530237696:12345-192.168.203.46@tcp:34:lhsmtool_posix.0 Request processed in 611us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785431.065775:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 50 00000100:00100000:1.0:1789785431.075327:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785431.075610:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530237952 00000100:00100000:0.0:1789785431.075620:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530237952 00000100:00100000:0.0:1789785431.075683:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 51 00000100:00100000:0.0:1789785431.075694:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+28:15658:x1876725530237952:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789785431.075715:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785431.075736:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ee400/0x2f18ee3fd845db2c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8b8e expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.075858:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845db33 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.075874:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845db33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.075886:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845db33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785431.075897:0:17213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789785431.075971:0:17213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845db33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.075979:0:17213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845db33 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.075986:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845db33 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.075992:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb49efe00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785431.075997:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845db33 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.076019:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845db33 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.076034:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dae8266fe00) 00010000:00010000:0.0:1789785431.076037:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789785431.076042:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845db33 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.076049:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845db33 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.076090:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ee400/0x2f18ee3fd845db2c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b8e expref: 30 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.076113:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dae8266ed00) 00010000:00010000:0.0:1789785431.076115:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789785431.076120:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ee400/0x2f18ee3fd845db2c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b8e expref: 30 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.076131:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb49ee400, rc 0) 00000100:00100000:0.0:1789785431.076195:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+29:15658:x1876725530237952:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 502us (876us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1789785431.076203:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 51 00000100:00100000:0.0:1789785431.080646:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785431.080732:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530238080 00000100:00100000:1.0:1789785431.080744:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530238080 00000100:00100000:1.0:1789785431.080821:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 52 00000100:00100000:1.0:1789785431.080832:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251bae80-9c0c-4669-a294-80064a3e231a+29:15658:x1876725530238080:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789785431.080868:0:17212:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789785431.081001:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251bae80-9c0c-4669-a294-80064a3e231a+29:15658:x1876725530238080:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 Request processed in 170us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785431.081009:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 52 00000100:00100000:3.0:1789785431.088265:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785431.088388:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530238336 00000100:00100000:0.0:1789785431.088397:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530238336 00000100:00100000:0.0:1789785431.088462:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 53 00000100:00100000:0.0:1789785431.088473:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+29:15658:x1876725530238336:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789785431.088508:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785431.088531:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ee400/0x2f18ee3fd845db41 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8b95 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789785431.088884:0:17213:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:0.0:1789785431.088892:0:17213:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:0.0:1789785431.088927:0:17213:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:0.0:1789785431.089062:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845db48 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.089075:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845db48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.089085:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845db48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.089139:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ee400/0x2f18ee3fd845db41 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b95 expref: 32 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.089156:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845db48 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b95 expref: 31 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.089164:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dae8266e400) 00010000:00010000:0.0:1789785431.089167:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789785431.089171:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb49efe00, rc 0) 00000100:00100000:0.0:1789785431.089240:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+31:15658:x1876725530238336:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 769us (985us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1789785431.089248:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 53 00000100:00100000:2.0:1789785431.095372:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785431.095566:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530238592 00000100:00100000:1.0:1789785431.095576:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530238592 00000100:00100000:1.0:1789785431.095636:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 54 00000100:00100000:1.0:1789785431.095646:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251bae80-9c0c-4669-a294-80064a3e231a+31:15658:x1876725530238592:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789785431.095701:0:17212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785431.095728:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845db48 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b95 expref: 31 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.095745:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dae8266e400) 00010000:00010000:1.0:1789785431.095755:0:17212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789785431.095786:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db56 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.095798:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db56 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.095807:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db56 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.095822:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845db5d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4f33f448 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.095844:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845db5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4f33f448 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.095851:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845db5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4f33f448 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.095895:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db56 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.095902:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db56 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.095919:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db56 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.095924:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc21cb000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785431.095929:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db56 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.095937:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db56 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.095945:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dae8266e100) 00010000:00010000:1.0:1789785431.095948:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785431.095952:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db56 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.095957:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db56 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.095969:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845db5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4f33f448 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.095980:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845db5d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4f33f448 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.095986:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845db5d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4f33f448 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.095995:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc21cb800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785431.095998:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845db5d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4f33f448 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.096004:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845db5d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4f33f448 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.096024:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x4f33f448 (ffff9dae827c1e00) 00010000:00010000:1.0:1789785431.096027:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785431.096030:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845db5d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4f33f448 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.096036:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb800/0x2f18ee3fd845db5d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4f33f448 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785431.096128:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251bae80-9c0c-4669-a294-80064a3e231a+30:15658:x1876725530238592:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 482us (796us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789785431.096135:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 54 00000100:00100000:1.0:1789785431.103615:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785431.103720:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530238720 00000100:00100000:0.0:1789785431.103745:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530238720 00000100:00100000:0.0:1789785431.103815:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 55 00000100:00100000:0.0:1789785431.103826:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+30:15658:x1876725530238720:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789785431.103847:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785431.103871:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ee400/0x2f18ee3fd845db64 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8b9c expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.103907:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ee800/0x2f18ee3fd845db6b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.103918:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ee800/0x2f18ee3fd845db6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.103929:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ee800/0x2f18ee3fd845db6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.104033:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ee400/0x2f18ee3fd845db64 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b9c expref: 32 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.104052:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ee800/0x2f18ee3fd845db6b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b9c expref: 31 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.104061:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dae8266e800) 00010000:00010000:0.0:1789785431.104064:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789785431.104068:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb49ee800, rc 0) 00000100:00100000:0.0:1789785431.104149:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+31:15658:x1876725530238720:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 324us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785431.104157:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 55 00000100:00100000:3.0:1789785431.111789:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785431.112046:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530238976 00000100:00100000:1.0:1789785431.112057:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530238976 00000100:00100000:1.0:1789785431.112128:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 56 00000100:00100000:1.0:1789785431.112140:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251bae80-9c0c-4669-a294-80064a3e231a+31:15658:x1876725530238976:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789785431.112237:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db72 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.112253:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.112264:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789785431.112637:0:17212:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1789785431.112647:0:17212:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 539366308437ns, next at 540366305921ns, rc = 0 00000004:00010000:1.0:1789785431.112690:0:17212:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035b72d70 reply state 00000000822cb8e9 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.112702:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db72 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.112709:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dae8266e800) 00010000:00010000:1.0:1789785431.112712:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789785431.112715:0:17212:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789785431.112845:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251bae80-9c0c-4669-a294-80064a3e231a+33:15658:x1876725530238976:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 707us (1063us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1789785431.112851:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 56 00000100:00100000:1.0:1789785431.116712:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785431.116810:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530239104 00000100:00100000:0.0:1789785431.116835:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530239104 00000100:00100000:0.0:1789785431.116893:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 57 00000100:00100000:0.0:1789785431.116903:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+33:15658:x1876725530239104:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789785431.116939:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785431.116960:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ee400/0x2f18ee3fd845db79 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8ba3 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.117016:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ee400/0x2f18ee3fd845db79 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8ba3 expref: 34 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.117030:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ee400/0x2f18ee3fd845db79 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8ba3 expref: 34 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.117049:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dae8266e800) 00010000:00010000:0.0:1789785431.117052:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789785431.117055:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb49ee400, rc 0) 00000100:00100000:0.0:1789785431.117116:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+34:15658:x1876725530239104:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 214us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785431.117123:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 57 00000100:00100000:2.0:1789785431.120677:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785431.120839:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530239232 00000100:00100000:0.0:1789785431.120850:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530239232 00000100:00080000:3.0:1789785431.120978:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789785431.121244:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 21 00000100:00100000:0.0:1789785431.121256:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251bae80-9c0c-4669-a294-80064a3e231a+5:2398:x1876725530239232:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789785431.121550:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251bae80-9c0c-4669-a294-80064a3e231a+6:2398:x1876725530239232:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 Request processed in 295us (878us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1789785431.121558:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 21 00000100:00100000:3.0:1789785431.124231:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785431.124592:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530239488 00000100:00100000:2.0:1789785431.124601:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530239488 00000100:00100000:2.0:1789785431.124667:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00100000:2.0:1789785431.124676:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251bae80-9c0c-4669-a294-80064a3e231a+34:15658:x1876725530239488:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789785431.124903:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251bae80-9c0c-4669-a294-80064a3e231a+35:15658:x1876725530239488:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 227us (679us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1789785431.124922:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00100000:2.0:1789785431.127757:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785431.127893:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530239744 00000100:00100000:3.0:1789785431.127902:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530239744 00000100:00100000:3.0:1789785431.127960:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 58 00000100:00100000:3.0:1789785431.127970:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251bae80-9c0c-4669-a294-80064a3e231a+35:15658:x1876725530239744:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789785431.128106:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251bae80-9c0c-4669-a294-80064a3e231a+35:15658:x1876725530239744:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 129us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785431.128113:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 58 00000100:00100000:2.0:1789785431.131751:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785431.131929:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530239872 00000100:00100000:0.0:1789785431.131953:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530239872 00000100:00100000:0.0:1789785431.132010:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 59 00000100:00100000:0.0:1789785431.132020:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+35:15658:x1876725530239872:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789785431.132038:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785431.132057:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef600/0x2f18ee3fd845db80 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8baa expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.132132:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eee00/0x2f18ee3fd845db87 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.132146:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eee00/0x2f18ee3fd845db87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.132157:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eee00/0x2f18ee3fd845db87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789785431.132199:0:17213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789785431.132216:0:17213:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eee00/0x2f18ee3fd845db87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.132239:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef600/0x2f18ee3fd845db80 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8baa expref: 37 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.132255:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eee00/0x2f18ee3fd845db87 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8baa expref: 36 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.132262:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dae8266e800) 00010000:00010000:0.0:1789785431.132264:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789785431.132268:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb49eee00, rc 0) 00000100:00100000:0.0:1789785431.132440:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+36:15658:x1876725530239872:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 421us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785431.132455:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 59 00000100:00100000:2.0:1789785431.145216:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785431.145668:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530240000 00000100:00100000:3.0:1789785431.145678:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530240000 00000100:00100000:3.0:1789785431.145727:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 22 00000100:00100000:3.0:1789785431.145737:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9daf84bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251bae80-9c0c-4669-a294-80064a3e231a+6:2397:x1876725530240000:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789785431.145753:0:18718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789785431.145780:0:18718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845db8e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8bb1 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789785431.145806:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aadf556, blocks: 0x0 00010000:00010000:3.0:1789785431.145825:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1789785431.145829:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785431.145838:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845db8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8bb1 expref: 7 pid: 18718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785431.145857:0:18718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845db8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8bb1 expref: 7 pid: 18718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785431.145870:0:18718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9daf814bb400, rc 0) 00000100:00100000:3.0:1789785431.145921:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9daf84bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251bae80-9c0c-4669-a294-80064a3e231a+7:2397:x1876725530240000:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 185us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785431.145928:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 22 00000100:00100000:1.0:1789785431.149511:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785431.149760:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530240256 00000100:00100000:3.0:1789785431.149792:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530240256 00000100:00100000:3.0:1789785431.149849:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 60 00000100:00100000:3.0:1789785431.149859:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251bae80-9c0c-4669-a294-80064a3e231a+36:15658:x1876725530240256:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789785431.149958:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251bae80-9c0c-4669-a294-80064a3e231a+36:15658:x1876725530240256:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 99us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785431.149965:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 60 00000100:00100000:2.0:1789785431.153315:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785431.153456:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530240384 00000100:00100000:1.0:1789785431.153465:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530240384 00000100:00100000:1.0:1789785431.153522:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 61 00000100:00100000:1.0:1789785431.153531:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+36:15658:x1876725530240384:12345-192.168.203.46@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789785431.158595:0:17191:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1789785431.158612:0:17191:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:0.0:1789785431.158743:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845d9c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.158756:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845d9c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.158764:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845d9c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.158783:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bac00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785431.158788:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845d9c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.158796:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845d9c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.158812:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9dafac970400) 00010000:00010000:0.0:1789785431.158815:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785431.158820:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845d9c7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.158826:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bac00/0x2f18ee3fd845d9c7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.158849:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d9ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.158856:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d9ce lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.158878:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d9ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.158884:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf80030800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785431.158887:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d9ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.158893:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d9ce lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.158903:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dae8266e100) 00010000:00010000:0.0:1789785431.158905:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785431.158908:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d9ce lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.158914:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf80030800/0x2f18ee3fd845d9ce lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.158929:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08800/0x2f18ee3fd845da76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.158935:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08800/0x2f18ee3fd845da76 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.158941:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08800/0x2f18ee3fd845da76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.158946:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b08800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785431.158949:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08800/0x2f18ee3fd845da76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.158967:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08800/0x2f18ee3fd845da76 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.158977:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9dae8266f700) 00010000:00010000:0.0:1789785431.158979:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785431.158982:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08800/0x2f18ee3fd845da76 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.158988:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08800/0x2f18ee3fd845da76 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.159004:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845dafb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.159011:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845dafb lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.159016:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845dafb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.159022:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814ba400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785431.159025:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845dafb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.159031:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845dafb lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.159040:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dae8266fe00) 00010000:00010000:0.0:1789785431.159042:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789785431.159045:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845dafb lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.159057:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba400/0x2f18ee3fd845dafb lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.159070:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db72 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.159076:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db72 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.159081:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db72 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.159086:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc21cb000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1789785431.159089:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db72 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.159096:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db72 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.159116:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dae8266e800) 00010000:00010000:0.0:1789785431.159118:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789785431.159121:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db72 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.159127:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cb000/0x2f18ee3fd845db72 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785431.160282:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84787100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549187712:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789785431.160375:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785431.160474:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549187712 00000100:00100000:0.0:1789785431.160483:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549187712 00000100:00100000:0.0:1789785431.160533:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789785431.160543:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876725549187712:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789785431.160668:0:18720:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789785431.160672:0:18720:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1789785431.160674:0:18720:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789785431.160677:0:18720:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789785430 -> 1789785430 00002000:00010000:0.0:1789785431.160679:0:18720:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000001:00080000:3.0:1789785431.160954:0:17191:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:1.0:1789785431.161130:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845da1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.161140:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845da1b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.161147:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845da1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.161153:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814ba200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785431.161158:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845da1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.161166:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845da1b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.161180:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dae8266e100) 00010000:00010000:1.0:1789785431.161183:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789785431.161187:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845da1b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.161193:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814ba200/0x2f18ee3fd845da1b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785431.161312:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251bae80-9c0c-4669-a294-80064a3e231a+15:15658:x1876725530240384:12345-192.168.203.46@tcp:44:lhsmtool_posix.0 Request processed in 7779us (8002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785431.161322:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 61 00000100:00100000:3.0:1789785431.165443:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785431.165543:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530240512 00000100:00100000:1.0:1789785431.165553:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530240512 00000100:00100000:1.0:1789785431.165598:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 24 00000100:00100000:1.0:1789785431.165608:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251bae80-9c0c-4669-a294-80064a3e231a+7:2398:x1876725530240512:12345-192.168.203.46@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789785431.165717:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251bae80-9c0c-4669-a294-80064a3e231a+7:2398:x1876725530240512:12345-192.168.203.46@tcp:16:lhsmtool_posix.0 Request processed in 109us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785431.165725:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 24 00000100:00100000:0.0:1789785431.170426:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3659:x1876725549187712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 9872us (10039us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789785431.170441:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000004:00080000:2.0:1789785431.170597:0:3659:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dae84787100/2, rc 0, transno 8589934596 00000100:00100000:2.0:1789785431.170604:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84787100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1876725549187712:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789785431.172495:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785431.172717:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530240768 00000100:00100000:0.0:1789785431.172726:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530240768 00000100:00100000:0.0:1789785431.172788:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 62 00000100:00100000:0.0:1789785431.172797:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251bae80-9c0c-4669-a294-80064a3e231a+15:15658:x1876725530240768:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789785431.172848:0:17211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789785431.172873:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49eee00/0x2f18ee3fd845db87 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8baa expref: 15 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.172891:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dae8266e800) 00010000:00010000:0.0:1789785431.172895:0:17211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789785431.173223:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef600/0x2f18ee3fd845db95 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.173236:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef600/0x2f18ee3fd845db95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.173246:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef600/0x2f18ee3fd845db95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789785431.173419:0:17211:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000568e3af0 reply state 00000000735a77e3 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef600/0x2f18ee3fd845db95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.173518:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ef600/0x2f18ee3fd845db95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.173524:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dae8266e800) 00010000:00010000:0.0:1789785431.173527:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789785431.173530:0:17211:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789785431.173624:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251bae80-9c0c-4669-a294-80064a3e231a+16:15658:x1876725530240768:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 827us (1135us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1789785431.173631:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 62 00000100:00100000:3.0:1789785431.176506:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785431.176995:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530240896 00000100:00100000:1.0:1789785431.177005:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530240896 00000100:00100000:1.0:1789785431.177111:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 25 00000100:00100000:1.0:1789785431.177122:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251bae80-9c0c-4669-a294-80064a3e231a+7:15658:x1876725530240896:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789785431.177140:0:18717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789785431.177158:0:18717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc16526c/0x2f18ee3fd845db9c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8bb8 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.177189:0:18717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845db8e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8bb1 expref: 8 pid: 18718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.177199:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789785431.177203:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789785431.177208:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc16526c/0x2f18ee3fd845db9c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8bb8 expref: 8 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.177241:0:18717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845db8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8bb1 expref: 8 pid: 18718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.177254:0:18717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845db8e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8bb1 expref: 8 pid: 18718 timeout: 639 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785431.177288:0:18717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84785180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18717:1876725549187840:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789785431.177409:0:18717:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf844229c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789785431.184113:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785431.184194:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530241024 00000100:00100000:2.0:1789785431.184203:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530241024 00010000:00010000:2.0:1789785431.184244:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845db8e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8bb1 expref: 9 pid: 18718 timeout: 639 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785431.184287:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:2.0:1789785431.184297:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf444e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251bae80-9c0c-4669-a294-80064a3e231a+9:2398:x1876725530241024:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789785431.184311:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785431.184332:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845db8e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8bb1 expref: 9 pid: 18718 timeout: 639 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785431.184400:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845db8e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8bb1 expref: 9 pid: 18718 timeout: 639 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785431.184423:0:17196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785431.184427:0:17196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789785431.184433:0:17196:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc16526c/0x2f18ee3fd845db9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8bb8 expref: 9 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785431.184456:0:17196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc16526c/0x2f18ee3fd845db9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8bb8 expref: 9 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785431.184491:0:17196:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fc16526c/0x2f18ee3fd845db9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8bb8 expref: 9 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785431.184506:0:17196:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84526300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17196:1876725549187968:192.168.203.46@tcp:105: 00000100:00100000:2.0:1789785431.184576:0:17196:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8280a0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789785431.184735:0:18717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c83e8ca6/0x2f18ee3fd845db8e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8bb1 expref: 9 pid: 18718 timeout: 639 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785431.184753:0:18717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84785180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18717:1876725549187840:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789785431.184775:0:18717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fc16526c/0x2f18ee3fd845db9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8bb8 expref: 8 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.184786:0:18717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafc21cba00, rc 0) 00000100:00100000:1.0:1789785431.184813:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251bae80-9c0c-4669-a294-80064a3e231a+8:15658:x1876725530240896:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 7693us (8315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785431.184821:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 25 00000100:00100000:0.0:1789785431.197396:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785431.197516:0:17196:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84526300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17196:1876725549187968:192.168.203.46@tcp:105: 00010000:00010000:2.0:1789785431.197540:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785431.197590:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf444e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251bae80-9c0c-4669-a294-80064a3e231a+7:2398:x1876725530241024:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 13295us (13492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785431.197600:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:3.0:1789785431.198962:0:19259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530241152 00000100:00100000:3.0:1789785431.198974:0:19259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530241152 00000100:00100000:3.0:1789785431.199034:0:19259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 26 00000100:00100000:3.0:1789785431.199043:0:19259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251bae80-9c0c-4669-a294-80064a3e231a+7:2397:x1876725530241152:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789785431.199486:0:19259:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789785431.199490:0:19259:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789785429 00002000:00010000:3.0:1789785431.199493:0:19259:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789785428 00002000:00010000:3.0:1789785431.199495:0:19259:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789785430 -> 1789785429 00002000:00010000:3.0:1789785431.199497:0:19259:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789785431.199545:0:19259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251bae80-9c0c-4669-a294-80064a3e231a+8:2397:x1876725530241152:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 Request processed in 502us (2215us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789785431.199553:0:19259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 26 00000100:00100000:0.0:1789785431.206660:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785431.206749:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530241280 00000100:00100000:3.0:1789785431.206759:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530241280 00000100:00100000:3.0:1789785431.206824:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 27 00000100:00100000:3.0:1789785431.206852:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251bae80-9c0c-4669-a294-80064a3e231a+8:2400:x1876725530241280:12345-192.168.203.46@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789785431.206897:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845dba3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785431.206922:0:18718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc16526c/0x2f18ee3fd845db9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8bb8 expref: 8 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785431.206931:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789785431.206935:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789785431.206939:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845dba3 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785431.206973:0:18718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fc16526c/0x2f18ee3fd845db9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8bb8 expref: 8 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789785431.206987:0:18718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fc16526c/0x2f18ee3fd845db9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8bb8 expref: 8 pid: 18717 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785431.207000:0:18718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae83a23100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18718:1876725549188096:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789785431.207083:0:18718:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafa0b25d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789785431.210109:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785431.210629:0:18718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae83a23100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18718:1876725549188096:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789785431.210657:0:18718:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845dba3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785431.211495:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530241408 00000100:00100000:1.0:1789785431.211504:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530241408 00010000:00010000:1.0:1789785431.211548:0:17198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fc16526c/0x2f18ee3fd845db9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8bb8 expref: 9 pid: 18717 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785431.211607:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 20 00000100:00100000:1.0:1789785431.211618:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf444000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251bae80-9c0c-4669-a294-80064a3e231a+9:2398:x1876725530241408:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789785431.211633:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785431.211655:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fc16526c/0x2f18ee3fd845db9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8bb8 expref: 9 pid: 18717 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.211694:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fc16526c/0x2f18ee3fd845db9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8bb8 expref: 9 pid: 18717 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.211719:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc16526c/0x2f18ee3fd845db9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8bb8 expref: 9 pid: 18717 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.211739:0:17198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789785431.211744:0:17198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789785431.211749:0:17198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845dba3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.211759:0:17198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845dba3 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.211804:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789785431.211836:0:18718:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845dba3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.211848:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845dba3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785431.211868:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf444000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251bae80-9c0c-4669-a294-80064a3e231a+8:2398:x1876725530241408:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 250us (1779us total) trans 0 rc 0/0 00010000:00010000:0.0:1789785431.211873:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845dba3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785431.211879:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 20 00010000:00010000:0.0:1789785431.211888:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845dba3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.211898:0:18718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845dba3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.211914:0:18718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9daf814bbe00 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:0.0:1789785431.211918:0:18718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845dba3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.211927:0:18718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845dba3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.211939:0:18718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845dba3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.211947:0:18718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0dcb455/0x2f18ee3fd845dba3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785431.211993:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251bae80-9c0c-4669-a294-80064a3e231a+7:2400:x1876725530241280:12345-192.168.203.46@tcp:1:lhsmtool_posix.0 Request processed in 5142us (5342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785431.212001:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 27 00000100:00100000:1.0:1789785431.217723:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789785431.217817:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530241664 00000100:00100000:2.0:1789785431.217827:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530241664 00000100:00100000:2.0:1789785431.217886:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 63 00000100:00100000:2.0:1789785431.217915:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+16:15658:x1876725530241664:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789785431.218124:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845dbaa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785431.218143:0:19042:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efc00/0x2f18ee3fd845daf4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b79 expref: 16 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785431.218153:0:19042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845dbaa lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785431.218187:0:19042:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efc00/0x2f18ee3fd845daf4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b79 expref: 16 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785431.218201:0:19042:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efc00/0x2f18ee3fd845daf4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b79 expref: 16 pid: 17213 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785431.218214:0:19042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84526300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19042:1876725549188224:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789785431.218300:0:19042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dae8280ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789785431.222333:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785431.222445:0:17963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530241792 00000100:00100000:3.0:1789785431.222479:0:17963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530241792 00010000:00010000:3.0:1789785431.222523:0:17963:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efc00/0x2f18ee3fd845daf4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b79 expref: 17 pid: 17213 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789785431.222594:0:17963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 21 00000100:00100000:2.0:1789785431.222606:0:17963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84524000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251bae80-9c0c-4669-a294-80064a3e231a+17:2397:x1876725530241792:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789785431.222620:0:17963:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789785431.222627:0:17963:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efc00/0x2f18ee3fd845daf4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b79 expref: 17 pid: 17213 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785431.222641:0:17963:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efc00/0x2f18ee3fd845daf4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b79 expref: 17 pid: 17213 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785431.222674:0:17963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dae8266fe00) 00010000:00010000:2.0:1789785431.222680:0:17963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845db10 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b87 expref: 17 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785431.222690:0:17963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845dbaa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785431.222698:0:17963:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845dbaa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785431.222706:0:17963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845dbaa lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785431.222721:0:17963:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789785431.222770:0:17963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84524000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251bae80-9c0c-4669-a294-80064a3e231a+17:2397:x1876725530241792:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 167us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789785431.222777:0:17963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 21 00010000:00010000:0.0:1789785431.223200:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efc00/0x2f18ee3fd845daf4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b79 expref: 16 pid: 17213 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785431.223218:0:19042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84526300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19042:1876725549188224:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789785431.223237:0:19042:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845dbaa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.223245:0:19042:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845dbaa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.223261:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845dbaa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.223493:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845dbb1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.223504:0:19042:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ee400/0x2f18ee3fd845db79 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8ba3 expref: 16 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.223513:0:19042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845dbb1 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.223538:0:19042:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ee400/0x2f18ee3fd845db79 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8ba3 expref: 16 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.223550:0:19042:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ee400/0x2f18ee3fd845db79 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8ba3 expref: 16 pid: 17213 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785431.223573:0:19042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf446d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19042:1876725549188352:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789785431.223633:0:19042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafa58d2180 going to sleep for 11 seconds 00000100:00100000:2.0:1789785431.227795:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785431.227881:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530241920 00000100:00100000:1.0:1789785431.227891:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530241920 00010000:00010000:1.0:1789785431.227930:0:17198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ee400/0x2f18ee3fd845db79 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8ba3 expref: 17 pid: 17213 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785431.227975:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 22 00000100:00100000:1.0:1789785431.228013:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84524700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251bae80-9c0c-4669-a294-80064a3e231a+17:2398:x1876725530241920:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789785431.228027:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789785431.228035:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ee400/0x2f18ee3fd845db79 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8ba3 expref: 17 pid: 17213 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.228047:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ee400/0x2f18ee3fd845db79 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8ba3 expref: 17 pid: 17213 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.228068:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dae8266e800) 00010000:00010000:1.0:1789785431.228073:0:17198:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845dbb1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.228082:0:17198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845dbb1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.228089:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845dbb1 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.228107:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789785431.228165:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84524700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251bae80-9c0c-4669-a294-80064a3e231a+17:2398:x1876725530241920:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 155us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789785431.228172:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 22 00010000:00010000:0.0:1789785431.228878:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ee400/0x2f18ee3fd845db79 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8ba3 expref: 16 pid: 17213 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785431.228897:0:19042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf446d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19042:1876725549188352:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789785431.228918:0:19042:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845dbb1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.228926:0:19042:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845dbb1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.228941:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845dbb1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789785431.229043:0:19042:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1789785431.229157:0:19042:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1789785431.229192:0:19042:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1789785431.229264:0:19042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dafbf446d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19042:1876725549188480:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789785431.229309:0:19042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789785431.229403:0:19042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafa58d2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789785431.229763:0:18200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549188480 00000100:00100000:3.0:1789785431.229771:0:18200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549188480 00000100:00100000:3.0:1789785431.229822:0:18200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789785431.229832:0:18200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbf446a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:19042:x1876725549188480:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789785431.229919:0:18200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbf446a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:19042:x1876725549188480:12345-0@lo:1000:mdt00_003.0 Request processed in 89us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785431.229927:0:18200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789785431.230000:0:19042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dafbf446d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19042:1876725549188480:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789785431.230173:0:19042:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1789785431.230225:0:19042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84527800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19042:1876725549188608:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789785431.230275:0:19042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789785431.230368:0:19042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9dafc1b3e300 going to sleep for 11 seconds 00000100:00100000:3.0:1789785431.234427:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725549188608 00000100:00100000:3.0:1789785431.234443:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725549188608 00000100:00100000:3.0:1789785431.234519:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789785431.234532:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19042:x1876725549188608:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789785431.234876:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:19042:x1876725549188608:12345-0@lo:1000:mdt00_003.0 Request processed in 345us (4609us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1789785431.234884:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789785431.234976:0:19042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84527800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19042:1876725549188608:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789785431.235431:0:19042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845dbb1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.235445:0:19042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845dbb1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.235478:0:19042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845dbb1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.235485:0:19042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb49efe00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785431.235490:0:19042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845dbb1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.235498:0:19042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845dbb1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.235514:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dae8266e800) 00010000:00010000:1.0:1789785431.235518:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789785431.235523:0:19042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845dbb1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.235530:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efe00/0x2f18ee3fd845dbb1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.235569:0:19042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845db09 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.235576:0:19042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845db09 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.235582:0:19042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845db09 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.235587:0:19042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b08400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785431.235590:0:19042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845db09 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.235670:0:19042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845db09 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.235680:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dae8266fe00) 00010000:00010000:1.0:1789785431.235683:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789785431.235691:0:19042:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845db10 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b87 expref: 19 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.235703:0:19042:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845db10 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b87 expref: 19 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.235712:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845db10 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b87 expref: 19 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.235778:0:19042:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9daf814bb800/0x2f18ee3fd845db10 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8b87 expref: 19 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789785431.235792:0:19042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9dae84785f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19042:1876725549188736:192.168.203.46@tcp:105: 00000100:00100000:1.0:1789785431.235870:0:19042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9daf84422600 going to sleep for 11 seconds 00000100:00100000:2.0:1789785431.239144:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785431.239232:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530242048 00000100:00100000:3.0:1789785431.239240:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530242048 00000100:00100000:3.0:1789785431.239329:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:3.0:1789785431.239363:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83bc4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251bae80-9c0c-4669-a294-80064a3e231a+20:15657:x1876725530242048:12345-192.168.203.46@tcp:49:dd.0 00000100:00100000:1.0:1789785431.239412:0:19042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9dae84785f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19042:1876725549188736:192.168.203.46@tcp:105: 00010000:00010000:1.0:1789785431.239440:0:19042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845db09 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.239451:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08400/0x2f18ee3fd845db09 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.239485:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845dbb8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789785431.239491:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83bc4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251bae80-9c0c-4669-a294-80064a3e231a+20:15657:x1876725530242048:12345-192.168.203.46@tcp:49:dd.0 Request processed in 152us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785431.239500:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 10 00010000:00010000:1.0:1789785431.239518:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845dbb8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.239530:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845dbb8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.239540:0:19042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845dbb8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.239547:0:19042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845dbb8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.239554:0:19042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845dbb8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.239560:0:19042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc21cbc00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785431.239564:0:19042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845dbb8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.239571:0:19042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845dbb8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.239582:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dae8266fe00) 00010000:00010000:1.0:1789785431.239585:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789785431.239588:0:19042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845dbb8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.239594:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc21cbc00/0x2f18ee3fd845dbb8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.239605:0:19042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845dbaa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.239617:0:19042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845dbaa lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.239623:0:19042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845dbaa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.239627:0:19042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b08000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1789785431.239630:0:19042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845dbaa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.239635:0:19042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845dbaa lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.239644:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dae8266fe00) 00010000:00010000:1.0:1789785431.239646:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789785431.239649:0:19042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845dbaa lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.239654:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08000/0x2f18ee3fd845dbaa lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789785431.239840:0:17247:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789785431.239845:0:17247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789785431.239870:0:17247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789785431.239875:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789785431.239946:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+19:15658:x1876725530241664:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 22034us (22232us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1789785431.239955:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 63 00000020:00080000:1.0:1789785431.239959:0:19042:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789785431.243945:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785431.244012:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530242176 00000100:00100000:0.0:1789785431.244021:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530242176 00000100:00100000:0.0:1789785431.244089:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 64 00000100:00100000:0.0:1789785431.244101:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251bae80-9c0c-4669-a294-80064a3e231a+19:15657:x1876725530242176:12345-192.168.203.46@tcp:101:dd.0 00010000:00010000:0.0:1789785431.244122:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789785431.244142:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ee400/0x2f18ee3fd845dbbf lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4bb55fb540dd8bbf expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.244175:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efc00/0x2f18ee3fd845dbc6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.244187:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efc00/0x2f18ee3fd845dbc6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.244266:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efc00/0x2f18ee3fd845dbc6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.244432:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49ee400/0x2f18ee3fd845dbbf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8bbf expref: 21 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.244462:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafb49efc00/0x2f18ee3fd845dbc6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0x4bb55fb540dd8bbf expref: 20 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.244470:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dae8266fe00) 00010000:00010000:0.0:1789785431.244473:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789785431.244476:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dafb49efc00, rc 0) 00000100:00100000:0.0:1789785431.244526:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251bae80-9c0c-4669-a294-80064a3e231a+20:15657:x1876725530242176:12345-192.168.203.46@tcp:101:dd.0 Request processed in 428us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785431.244533:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 64 00000100:00100000:2.0:1789785431.249538:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785431.249847:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530242432 00000100:00100000:3.0:1789785431.249873:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530242432 00000100:00100000:3.0:1789785431.250068:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:3.0:1789785431.250078:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251bae80-9c0c-4669-a294-80064a3e231a+20:15658:x1876725530242432:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789785431.250915:0:17215:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789785431.251023:0:17215:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1789785431.251080:0:17215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08800/0x2f18ee3fd845dbcd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785431.251165:0:17215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08800/0x2f18ee3fd845dbcd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785431.251179:0:17215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08800/0x2f18ee3fd845dbcd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785431.251187:0:17215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08800/0x2f18ee3fd845dbcd lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785431.251192:0:17215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08800/0x2f18ee3fd845dbcd lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785431.251264:0:17215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08800/0x2f18ee3fd845dbcd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789785431.251392:0:17215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789785431.251492:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251bae80-9c0c-4669-a294-80064a3e231a+22:15658:x1876725530242432:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 1414us (1962us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1789785431.251501:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 11 00000020:00080000:2.0:1789785431.251506:0:17215:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789785431.252279:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789785431.252298:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08800/0x2f18ee3fd845dbcd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.252306:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafc1b08800 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:1.0:1789785431.252310:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08800/0x2f18ee3fd845dbcd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.252319:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08800/0x2f18ee3fd845dbcd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.252333:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dae8266e800) 00010000:00010000:1.0:1789785431.252421:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789785431.252427:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08800/0x2f18ee3fd845dbcd lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.252434:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dafc1b08800/0x2f18ee3fd845dbcd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789785431.252448:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785431.252450:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789785431.252451:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789785431.500872:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789785431.500982:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789785431.501050:0:18723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530242560 00000100:00100000:0.0:1789785431.501061:0:18723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530242560 00000100:00100000:0.0:1789785431.501128:0:18723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530242688 00000100:00100000:0.0:1789785431.501132:0:18723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530242688 00000100:00100000:0.0:1789785431.501165:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 0 00000100:00100000:0.0:1789785431.501176:0:18723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251bae80-9c0c-4669-a294-80064a3e231a+8:2399:x1876725530242560:12345-192.168.203.46@tcp:4:dd.0 00002000:00010000:0.0:1789785431.501234:0:18723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6aadf555, atime: 0x6aadf554, ctime: 0x6aadf555, blocks: 0x0 00010000:00010000:0.0:1789785431.501243:0:18723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e8c9b27/0x2f18ee3fd845dbd4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.501258:0:18723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=539s v=(0 0) 00010000:00010000:0.0:1789785431.501263:0:18723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789785431.501269:0:18723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e8c9b27/0x2f18ee3fd845dbd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.501281:0:18723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e8c9b27/0x2f18ee3fd845dbd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789785431.591562:0:19533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1789785431.591579:0:19533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:0.0:1789785431.591974:0:18723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1789785431.591979:0:18723:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1789785429 -> 1789785430 00002000:00010000:0.0:1789785431.591982:0:18723:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789785429 -> 1789785430 00002000:00010000:0.0:1789785431.591985:0:18723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:0.0:1789785431.592003:0:18723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e8c9b27/0x2f18ee3fd845dbd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.592015:0:18723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e8c9b27/0x2f18ee3fd845dbd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.592023:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e8c9b27/0x2f18ee3fd845dbd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.592031:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb49ee400 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:0.0:1789785431.592036:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e8c9b27/0x2f18ee3fd845dbd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.592045:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e8c9b27/0x2f18ee3fd845dbd4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.592065:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e8c9b27/0x2f18ee3fd845dbd4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.592073:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e8c9b27/0x2f18ee3fd845dbd4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785431.592212:0:18723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251bae80-9c0c-4669-a294-80064a3e231a+6:2399:x1876725530242560:12345-192.168.203.46@tcp:4:dd.0 Request processed in 91033us (91345us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789785431.592224:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 0 00000100:00100000:0.0:1789785431.592255:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 1 00000100:00100000:0.0:1789785431.592268:0:18723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae83a20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251bae80-9c0c-4669-a294-80064a3e231a+5:2400:x1876725530242688:12345-192.168.203.46@tcp:4:dd.0 00002000:00010000:0.0:1789785431.592307:0:18723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 4194304, mtime: 0x6aadf556, atime: 0x6aadf554, ctime: 0x6aadf556, blocks: 0x2000 00010000:00010000:0.0:1789785431.592314:0:18723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3c76a71/0x2f18ee3fd845dbdb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.592325:0:18723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=539s v=(0 0) 00010000:00010000:0.0:1789785431.592329:0:18723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789785431.592336:0:18723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3c76a71/0x2f18ee3fd845dbdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.592398:0:18723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3c76a71/0x2f18ee3fd845dbdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789785431.659962:0:19533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:0.0:1789785431.660242:0:18723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:0.0:1789785431.660248:0:18723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:0.0:1789785431.660263:0:18723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3c76a71/0x2f18ee3fd845dbdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.660277:0:18723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3c76a71/0x2f18ee3fd845dbdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.660302:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3c76a71/0x2f18ee3fd845dbdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.660310:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dafb49ef200 already unused, calling callback (ffffffffc0cc5370) 00010000:00010000:0.0:1789785431.660315:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3c76a71/0x2f18ee3fd845dbdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.660325:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3c76a71/0x2f18ee3fd845dbdb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.660361:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3c76a71/0x2f18ee3fd845dbdb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789785431.660369:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3c76a71/0x2f18ee3fd845dbdb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789785431.660510:0:18723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae83a20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251bae80-9c0c-4669-a294-80064a3e231a+5:2400:x1876725530242688:12345-192.168.203.46@tcp:4:dd.0 Request processed in 68241us (159522us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789785431.660520:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 1 00010000:00010000:0.0:1789785431.753903:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789785432.770795:0:18743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789785433.392997:0:20388:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1789785433.794862:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789785434.103842:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785434.103889:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785434.103926:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785434.103945:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785434.103970:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785434.103989:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785434.104005:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785434.104040:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785434.104058:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789785434.104152:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530243072 00000100:00100000:1.0:1789785434.104161:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530243072 00000100:00100000:3.0:1789785434.104382:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530242816 00000100:00100000:3.0:1789785434.104387:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530242816 00000100:00100000:1.0:1789785434.104695:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530243584 00000100:00100000:1.0:1789785434.104699:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530243584 00000100:00100000:1.0:1789785434.104715:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530242944 00000100:00100000:1.0:1789785434.104718:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530242944 00000100:00100000:1.0:1789785434.104730:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530243456 00000100:00100000:1.0:1789785434.104733:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530243456 00000100:00100000:3.0:1789785434.104836:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 168 00000100:00100000:3.0:1789785434.104846:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dafbb424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49f881b2-94cc-4d23-9aec-10664f83ddca+13:2398:x1876725530242816:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785434.104912:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dafbb424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:49f881b2-94cc-4d23-9aec-10664f83ddca+13:2398:x1876725530242816:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 67us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785434.104921:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 168 00000100:00080000:3.0:1789785434.104952:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789785434.104956:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789785434.105040:0:19259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530243328 00000100:00100000:0.0:1789785434.105045:0:19259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530243328 00000100:00100000:0.0:1789785434.105073:0:19259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530243840 00000100:00100000:0.0:1789785434.105194:0:19259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530243840 00000100:00100000:0.0:1789785434.105213:0:19259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530243200 00000100:00100000:0.0:1789785434.105224:0:19259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530243200 00000100:00100000:0.0:1789785434.105238:0:19259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876725530243712 00000100:00100000:0.0:1789785434.105240:0:19259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876725530243712 00000100:00100000:0.0:1789785434.105254:0:19259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 23 00000100:00100000:0.0:1789785434.105271:0:19259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84784380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251bae80-9c0c-4669-a294-80064a3e231a+5:2398:x1876725530243328:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785434.105300:0:19259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84784380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251bae80-9c0c-4669-a294-80064a3e231a+5:2398:x1876725530243328:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 31us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785434.105307:0:19259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 23 00000100:00100000:0.0:1789785434.105319:0:19259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 24 00000100:00100000:0.0:1789785434.105325:0:19259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6563e207-f568-458d-9d37-e81c107e6f83+5:2398:x1876725530243840:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785434.105381:0:19259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6563e207-f568-458d-9d37-e81c107e6f83+5:2398:x1876725530243840:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 55us (1410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785434.105388:0:19259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 24 00000100:00100000:1.0:1789785434.105654:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 60 00000100:00100000:1.0:1789785434.105665:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+5:2398:x1876725530243072:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789785434.105696:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251bae80-9c0c-4669-a294-80064a3e231a+5:2398:x1876725530243072:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 34us (1806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785434.105715:0:19259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 25 00000100:00100000:0.0:1789785434.105725:0:19259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84785880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251bae80-9c0c-4669-a294-80064a3e231a+5:2398:x1876725530243200:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785434.105760:0:19259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84785880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251bae80-9c0c-4669-a294-80064a3e231a+5:2398:x1876725530243200:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 37us (1754us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785434.105766:0:19259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 25 00000100:00100000:0.0:1789785434.105779:0:19259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 26 00000100:00100000:0.0:1789785434.105785:0:19259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6563e207-f568-458d-9d37-e81c107e6f83+5:2398:x1876725530243712:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789785434.105807:0:19259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6563e207-f568-458d-9d37-e81c107e6f83+5:2398:x1876725530243712:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 23us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789785434.105812:0:19259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 26 00000100:00100000:3.0:1789785434.105980:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 61 00000100:00100000:3.0:1789785434.105990:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6563e207-f568-458d-9d37-e81c107e6f83+5:2398:x1876725530243584:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785434.106016:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6563e207-f568-458d-9d37-e81c107e6f83+5:2398:x1876725530243584:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 29us (2070us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785434.106023:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 61 00000100:00100000:3.0:1789785434.106038:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 62 00000100:00100000:3.0:1789785434.106044:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251bae80-9c0c-4669-a294-80064a3e231a+22:2398:x1876725530242944:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785434.106070:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251bae80-9c0c-4669-a294-80064a3e231a+22:2398:x1876725530242944:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 27us (2081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785434.106099:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 62 00000100:00100000:3.0:1789785434.106112:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 63 00000100:00100000:3.0:1789785434.106118:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dae84784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6563e207-f568-458d-9d37-e81c107e6f83+6:2398:x1876725530243456:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789785434.106146:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dae84784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6563e207-f568-458d-9d37-e81c107e6f83+6:2398:x1876725530243456:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 24us (2102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789785434.106152:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 63 00000100:00080000:3.0:1789785434.106172:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789785434.106175:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789785434.108096:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 60 00010000:00010000:0.0:1789785434.821078:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 42553 lines, 42553 kept, 0 dropped, 0 bad.